FTP export - looking for file size and content type
Hi everyone, I'm building my first custom flow. This flow is a FTP to REST API combo. This will be used to transfer files from our ERP to Ecommerce platform.
For the REST API export I need the file size and file content type. We have successfully passed the filename by using a PreSave function to save and export the filename via fileMeta.fileName. Is there an equivalent for the file size and content type?
-
You might be able to determine the content type from the file name.
Unfortunately, we do not expose file size. I will pass these along to a product manager to consider for future enhancements.
0 -
I'm very surprised the the file size is not available. As this is the case we ABSOLUTELY can not use this product for one of the intended purposes. We can not use the Azure Put Blob feature without specifying the file size.
0 -
See pics below for context. If you are using our standard Azure Blob Storage connector, then we should be doing this for you behind the scenes. Does this help at all?
0 -
Hi Scott we started with the native Azure connector but we are unable to use this.
We are migrating from a SAP Hybris On Prem installation to a SAP Commerce Cloud installation. As part of this project SAP requires flat file integration to place files in an Azure Blob Storage container. As we started to set up this Flow and Connector we realize that Celigo only seems to support the AD Authentication method with Azure. As this is not our Azure service but SAP's they do not support us using an AD connect but rather only via Shared Access Signature (SAS). It does not appear that your native connector supports SAS authentication. After spending several days digging deeper into this we determined that we could use your REST connector and got this working except that the transfer requires the file size to be passed in an http header. We assumed that much like the FTP source contained the original file name that it would also contain the original file size. We attempted to hardcode a fake (too large) file size but the transfer times out and fails.
I'm going to estimate that we spent about 35 hours so far attempting to make this work but now we need to build manual connectors and bypass Celigo, it seems.
Dale Marthaller - IT Director
0 -
Hey Dale,
I feel your pain. :(
I am not sure if this helps, but we might be able to expose a 'fileSize' property in time for our upcoming quarterly release on/around May 10th (i.e. just for FTP file transfers). I tried to rally the team to do a patch for this, but there is no way we can pull off a production patch so close to our major quarterly release. Is May 10th even helpful, or is that too late for your project timelines?
The only other work around I can think of is does SAP allow for file uploads to Amazon S3 instead of Azure Blob?
0 -
If this could be added the next quarterly release this would be fantastic news :)
All of the Commerce Cloud portfolio has been implemented in Azure so we can not take advantage of the S3 infrastructure.
0 -
If you are able to confirm that this feature will be added to the FTP file transfer on this next scheduled release I will push the project timeline.
Thank you.
0 -
Hey Dale, I met with all the teams this morning, and I got confirmation from everyone that we can rush expose 'fileMeta.fileSize' in time for our next scheduled product release in May.
0 -
That is fantastic thank you. I love how responsive your company has been. :)
0 -
Hi Scott, are you able to provide an update on this scheduled release. Earlier you indicated that it may be as early as today.
0 -
We change the target release date from this week to May 17th to accommodate additional testing effort for our QA team.
Thanks
0 -
Are we still targeting May 17th?
0 -
The release date is still targeted May 17th. For your future reference, you can also check the platform planned release calendar at https://www.celigo.com/ipaas-integration-platform/platform-release-calendar
Thanks
0 -
I see that the release is still scheduled for today. Has this been implemented already or is it scheduled for this evening?
0 -
It is in progress, we expect completion in the next 4 hours. Thank you
0 -
Fantastic, thank you!
0 -
Hi, the R2 release is now live. here is the updated kb about getting file size.
Thanks
0
Please sign in to leave a comment.
Comments
17 comments