Data Loading Approach For Datalake

I'm looking for for best practices for loading data from one source (HubSpot, Salesforce, etc.) to a data lake (AWS S3 in our case). My thought is that for the initial data load I would select the export type of "All - always export all data" and then once that flow has completed switch the export type to "Delta - export only modified data". Will that approach work or is there an alternative method that would be better?

0

Comments

2 comments
Date Votes
  • Yes, the best practice is to use 'All' for your initial mass loads, and then switch it over to 'Delta' when you are done.

    0
  • Perfect. Thanks so much Scott!

    0

Please sign in to leave a comment.

 

Didn't find what you were looking for?

New post