Ensuring a Flow Step runs only after the previous has finished

Comments

4 comments

  • Tyler Lamparter Principal Product Manager
    Awesome Follow-up
    Engaged
    Top Contributor
    Answer Pro
    Celigo University Level 4: Legendary

    Marcelo Borges the are only a few ways to do this.

    1. If there isn't much data exporting from your source application, then you can set a very large page size so that all records fit within 1 page. Celigo works off of pages of records so by doing this you would accomplish what you want. However, if you have a lot of data from your export, you would end up with multiple pages of data and then this may not solve your use case.
    2. Use multiple flows. To do this, at the very end of your first flow, you would dump the data you want to pass to the next flow into a S3 bucket, ftp file, google drive file, etc.. The second flow would pick that file up and continue processing.
    3. Create a myapi that is called from the flow itself where the myapi can handle multiple requests in a row for the same records before moving to the next set.
    1
  • Marcelo Borges

    Thank you for the prompt ideas, Tyler. I'll look into the myApi option to see what I can get out of that. 

    Has this type of request been made as a possible improvement on the platform? It would be great if some flow steps had a flag determining they cannot be run until all previous steps have been processed.

    TY

    0
  • Marcelo Borges

    Tyler Lamparter, using the Page attribute actually helped a lot here. Thanks for that tip!

    0
  • Tyler Lamparter Principal Product Manager
    Awesome Follow-up
    Engaged
    Top Contributor
    Answer Pro
    Celigo University Level 4: Legendary

    Marcelo Borges good to hear

    0

Please sign in to leave a comment.