
Salesforce bulk data ingestion using Application Integration
This demo showcases large scale data ingestion from Salesforce using Application Integration and the Bulk API V2. The demo employs a resilient asynchronous orchestrator worker model to efficiently transfer massive datasets.
The orchestrator manages the job setup and status, while the worker retrieves data in chunks and uploads them to Google Cloud Storage (GCS). This pattern ensures reliable, sequential processing for millions of records and can be adapted to any connector supporting a bulk mechanism.
#GoogleCloud #Salesforce #DataMigration
? Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
Speaker: Abirami Thangavel
Products Mentioned: Cloud Storage, Application Integration
The orchestrator manages the job setup and status, while the worker retrieves data in chunks and uploads them to Google Cloud Storage (GCS). This pattern ensures reliable, sequential processing for millions of records and can be adapted to any connector supporting a bulk mechanism.
#GoogleCloud #Salesforce #DataMigration
? Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
Speaker: Abirami Thangavel
Products Mentioned: Cloud Storage, Application Integration
Google Cloud Tech
Helping you build what's next with secure infrastructure, developer tools, APIs, data analytics and machine learning....