Possible to sort across all pages of export?

Steve Klett Channel Partner

• July 24, 2020 04:42

Hello,

I have a flow that loads a CSV file from an FTP server. I do not have any control over the file or  how it's generated. The sorting of the rows is incorrect and I need to sort it in IO. I added a preSavePage javascript function which works perfect on a page of results. The problem is when my data spans multiple pages, I can't sort across pages. I know you can increase the page size and I've done this, but there's a 5MB limit so this isn't a bulletproof solution.

My question: Is there a way in IO to combine pages or a hook/event to operate on all pages of results?

 

-Steve

0

• 

  Courtney Jordan Experience Strategy & Design Director Community moderator

  • July 24, 2020 15:32

  

  

  

  Hi Steve Klett,

  Great to hear from you! Unfortunately, there's currently no way to handle this scenario, although we do have some concepts in the planning stage. Let me check with our PM on these, Vili, and get back to you. Thanks so much for letting us know about this need!

  0
• 

  viliandy leonardo Product Management Director

  • July 24, 2020 18:24

  Steve Klett

  There is no alternative or a creative way in IO to sort file records that span multiple pages.

  We have a feature backlog to sort file content to address your use case. I am gathering customer's feedback on how they plan or want to use this sort. Would you please explain what your flow scenario is and provide some examples of the file layout along with sorting rule.

  Thanks

   

  0
• 

  Abhinav Kaushal

  • March 27, 2021 19:33

  Hi,

  I have similar ask where I need to sort and then use group by on CSV so I can eliminate the duplicates from CSV. I was thinking of having a parent work flow which dumps the CSV and then next work flow will consume it and do group by. Looks like it won't work as for group by we need to sort the content.

  Is there any global variable which has scope within integration and can ne written and called in various flows so it will eliminate the CSV dump and can be sorted out using JS?

  Thanks,

  Abhinav Kaushal

  0
• 

  Kate Larson Community moderator Principal Technical Writer

  • March 30, 2021 19:08

  

  Thanks for posting to the community, Abhinav Kaushal. I’m checking with our experts and will get to back to you with their recommendation.

  0
• 

  Kate Larson Community moderator Principal Technical Writer

  • March 30, 2021 21:38

  

  Abhinav Kaushal - I heard back from our engineers. We don't have any global variable that has scope beyond the current execution. All variables are passed in as arguments for the hooks or other function being called.

  0
• 

  Shrehith

  • June 08, 2022 17:22

  Hello,

  I am having the same issue. Do we have any solution developed to handle this scenario now?

  0

Please sign in to leave a comment.