Skip to main content

New flow FTP to API runs way to slowly

Answered

Comments

5 comments

  • viliandy leonardo Product Management Director
    Answer Pro
    Top Contributor

    Sinclair Dental IT Admin

    Hi, what error message do you get when you set the batch size?

    Thanks

    0
  • Pridhvi Product Manager
    Answer Pro
    Great Answer

    Hi Sinclair Dental IT Admin

    Could you confirm if this is the error that you are noticing while trying to save the FTP export after setting the batch size. 

    If yes, let us know what file type you are trying to export from FTP, it will help us to guide you further. Because, while I tried to replicate the error I noticed this error occurs only when the option "Parse files being transferred" is set to "No" (This must be set to "No" if the customer want to send the raw files as-is). Currently we are not supporting batching in Blob export.

     

    Regards,

    Pridhvi

    0
  • Sinclair Dental IT Admin
    Engaged

    Yes this Blob export message is the one preventing us from testing batching. 

    0
  • Sinclair Dental IT Admin
    Engaged

    I missed part of your question. In the integration flow we are struggling with we are transferring a number of files with .csv and .txt file extensions from an inhouse integration gateway to our ecommerce site where we are dropping the files in an Azure Blob. We are not parsing or transforming these files just delivering them. 

    0
  • Scott Henderson CTO
    Answer Pro
    Top Contributor

    Batch exporting raw files should be supported as of this morning's product release.  Please use the below field on your source FTP export bubble.  I would try 100 first to see the performance increase, and then if that is not fast enough you can go all the way to 1000.  If the field is left blank, then we are only processing 1 file at a time by default, which is going to be super slow for thousands of smaller files.

    0

Please sign in to leave a comment.