Data Loading Approach For Datalake
I'm looking for for best practices for loading data from one source (HubSpot, Salesforce, etc.) to a data lake (AWS S3 in our case). My thought is that for the initial data load I would select the export type of "All - always export all data" and then once that flow has completed switch the export type to "Delta - export only modified data". Will that approach work or is there an alternative method that would be better?
0
Comments
Yes, the best practice is to use 'All' for your initial mass loads, and then switch it over to 'Delta' when you are done.
Perfect. Thanks so much Scott!
Please sign in to leave a comment.