Skip to main content

AMAZON SQS / S3

Comments

15 comments

  • Courtney Jordan Experience Strategy & Design Director Community moderator
    Celigo University Level 4: Legendary
    Awesome Follow-up
    Top Contributor

    Hi Anthony Rosenkrantz, 
    Thanks for letting us know about your integration scenario needs! We're looking into your first question and will get back to you shortly. For your second question, you should be able to do that. I'm checking with our PM team on this. If you could provide any more detail on this one, that would be very helpful!

    0
  • viliandy leonardo Product Management Director

    Anthony Rosenkrantz

    When you create an S3 export step and choose "No" for Parse files being transferred, then in the Advanced section, you can enable the "File metadata only" setting. You'll get the file name and file last modified date.

    Thanks

     

    0
  • Courtney Jordan Experience Strategy & Design Director Community moderator
    Celigo University Level 4: Legendary
    Awesome Follow-up
    Top Contributor

    Hi Anthony Rosenkrantz, let us know if the solution Vili provided above doesn't work! Thanks and good luck!

    0
  • Anthony Rosenkrantz

    I am trying todo to an S3 Import , and do not see those options

    0
  • viliandy leonardo Product Management Director

    Anthony Rosenkrantz Could you please elaborate about "passing the file name used in S3", is it about getting the file name after creating the file in S3?

    Thanks

    0
  • Anthony Rosenkrantz

    yes i would like to pass the "file-key{documentname.xml}" that is dynamically created on to the next step which needs to be an sqs step, as i am required to send an sqs  message with the file name.  (in our case document-name = item-name.xml).

     

     

    core process flow 

    1: extract all items from netsuite (works)

    2: create a new file for each item and post to s3.  document-name = item-name.xml.  (basics work) but i am unable to get the dynamically created file-key/file-name so i can pass it on to the next step

    3: post a message to sqs for every file created within s3....

    issues:

    1:Ping works and post to SQS..... (good)

    2: unable to access the dynamically created filename created/used in the previous step

    3: unable to get restapi to talk to SQS various issues (weird as the ping works)

     

    0
  • viliandy leonardo Product Management Director

    Anthony Rosenkrantz

    The information you need is available inside a _json variable which is the complete response data from the import application (Check here for more info on responseData (see this article for more info)Here is an example of the responseData from my S3 test:

    {
       "statusCode":200,
       "id":"5b2969b3c0b14e8581d04da63424b13b",
       "_json":{
            "name":"file-2020-08-11T20-14-06"
          },
       "errors":[
         ]
    }

    Do a response mapping in your S3 import step like so:

    Then, in the next flow step field mapping, you can refer to that dynamically generated file name variable as "_json.name". 

    Thanks

    0
  • Anthony Rosenkrantz

    Perfect thank you, Got it.

     

    Now all that is left is trying to get AMAZON SQS to work.  DO you have any information on SQS?

     

    0
  • Courtney Jordan Experience Strategy & Design Director Community moderator
    Celigo University Level 4: Legendary
    Awesome Follow-up
    Top Contributor

    Hi Anthony Rosenkrantz,

    Glad to hear that worked for you. We don't have any documentation in our Help Center on SQS, as it's not an application we explicitly support via an SQS application connector (adaptor). What information are you looking for on SQS?

    0
  • Anthony Rosenkrantz

    i need to post a message to AWS-SQS .... and i am trying to do it via RESTAPI?  what is interesting the connection-ping will connect and post a message but when i try via it restapi i get  the error "The request signature we calculated does not match the signature you provided"

    0
  • Courtney Jordan Experience Strategy & Design Director Community moderator
    Celigo University Level 4: Legendary
    Awesome Follow-up
    Top Contributor

    Hi Anthony Rosenkrantz, 

    • Please ensure that your Connection base URI has a region name in it. (e.g: sqs.us-west-2.amazonaws.com). With a base URI like sqs.<region>.amazonaws.com integrator.io invokes special logic regarding the HMAC signature that this service needs.
    • integrator.io does generate a signature for every request, but it's done in the background. Unlike Postman, integrator.io doesn't take input from the user for signature calculation, but rather depends on the baseURI to identify the service you are connecting to (in this case, SQS) and calculates the signature accordingly.

    What is the REST call (POST?) you are making? Can you share details (screenshots) of that and the Connection settings, please?

    0
  • Matt Graney VP of Product Management
    Answer Pro
    Top Contributor

    Anthony Rosenkrantz -- I edited Courtney Jordan's earlier response, so just tagging you here explicitly to be sure you're notified.

    Thanks,
    Matt

    0
  • Anthony Rosenkrantz

    Morning Jordan yes i am using Post, unfortunately i am still getting signature issues, is it recalculating the signature based on the relative url?

     

    0
  • Courtney Jordan Experience Strategy & Design Director Community moderator
    Celigo University Level 4: Legendary
    Awesome Follow-up
    Top Contributor

    Hi Anthony Rosenkrantz,

    Could you also go to your AWS-SQS connection and take a screenshot of that for us to see connection details? You can click into your integration tile to the Integration details page, then click Connections to see all connections used by that integration. In the Actions ... column, select Edit connection. 

    0
  • Ugene Jude Channel Partner
    Engaged
    Celigo University Level 4: Legendary

    Anthony Rosenkrantz

    Hi Anthony

    I am facing the exact same issue and would be very helpful to know whether you managed to get this resolved?

    Thanks

    0

Please sign in to leave a comment.