Skip to main content

Anyway to get around the filename timestamp requirement for FTP import?

Comments

4 comments

  • Dan Claypool NetSuite Integration Whiz Strategic Support Lead
    Celigo University Level 4: Legendary

    Hi Steve,

    This requirement is for when you have the Advanced "Skip Aggregation" option in the import step set to true (checked). When Skipping aggregation, this means that multiple files will be uploaded to the FTP endpoint. The Timestamp option is then required because the timestamp (so long as it includes seconds or milliseconds) in the filename will be different for each file that gets created by the import. Otherwise, the files that are being created on the FTP server will be overwritten one after another until the last file is written, causing a loss of data.

    To remove this requirement, uncheck the "Skip Aggregation" option in the FTP import step.

    Best Regards,

    Dan

    0
  • Bas van Ditzhuijzen NetSuite Integration Whiz Salesforce Integration Whiz
    Answer Pro
    Engaged
    Celigo University Level 4: Legendary

    We also ran into this issue, had to supply a predefined filename per file, and using pagesize=1 had already ensured filenames would always be unique. My workaround was to use a 'constant' timestamp: 

    {{data.0.uniquename}}{{timestamp "." "Europe/Amsterdam"}}xml

    which nicely renders out to uniquename.xml 

    1
  • Steve Klett Channel Partner
    Awesome Follow-up
    Engaged
    Celigo University Level 2: Seasoned

    Hi @...,

    I missed the replies from you and Bas, I must have ignored the emails. Either way, I came here to see if anyone has updated this and I'm glad to see there are some answers.

    Thank you for your response. I think this feature can be improved to provide more flexibility to the developers. Dictating the format of the filename to avoid overwriting is getting in the way. In my case I want to generate a filename that has the order number in it which would take care of the overwriting files concern.

    If IO still wanted to help users avoid overwrite bugs the UI could warn users based on the filename value:

    Your filename may not be unique and could result in overwriting data on the FTP server

    Or some such thing. I really hope you'll consider removing this demand that we use a timestamp in the filename.

    Thanks again for your reply.

     

    0
  • Steve Klett Channel Partner
    Awesome Follow-up
    Engaged
    Celigo University Level 2: Seasoned

    Bas van Ditzhuijzen

    Excellent workaround!

    I was thinking about using a pagesize of 1 and turning off aggregation, but from the field help in IIO it sounds like it will aggregate ALL the pages.

    I'm curious how your filename example has the syntax 

    {{data.0....}}

    Mine is:

    {{batch_of_records.0.rows.0...

    The rows part I understand, but I'm curious how you start with data and I start with batch_of_records.

    Thank you for your response. I'll try your workaround now.

    0

Please sign in to leave a comment.