Google Sheet Blank Rows Between Data

Avatar
Dave Guderian
Engaged
Celigo University Level 4: Legendary
Awesome Follow-up

I am importing to google sheets using the marketplace connector (which is awesome). The total number of rows being imported matches (when I add up the rows in google sheets) between Celigo and google sheets so I am not concerned with data loss, but I am consistently seeing blank rows between data. The number of blank rows varies and isn't consistent and I cant figure out what would be causing this. Has anyone else seen this type of behavior using the marketplace connector?

0

Comments

5 comments
Date Votes
  • Avatar
    Bhavik Shah
    Senior Product Manager
    Answer Pro
    Great Answer

    Thanks Dave Guderian for your post. I suspect this could be because of the source configuration/data or the data coming from previous steps prior to the import. Could you please share your source config/data ? Please mask any PII or confidential information. 

    Alternatively, you can troubleshoot the issue using platform tools such as flow debugger. Learn more about this here

     

    0
  • Avatar
    Scott Henderson
    CTO
    Celigo University Level 1: Skilled
    Answer Pro
    Top Contributor

    Hey Dave Guderian, this is really strange and unexpected. Can you delete your flow and try installing the template brand new again? And then, can you try where you have headers in your spreadsheet, and make sure you configure your import to have headers, etc... I wonder if this is an issue with spreadsheets that do not contain headers, and knowing this will help us debug the problem further on our side.

    0
  • Avatar
    Brian Hampel

    I am getting the same. I installed the marketplace template yesterday and tested it as Google to Google with about 30 records; then, I cloned the import for use with a Salesforce to Google flow. I tested that with export limit=10 records and it looked good, so I let it run with All records.

    Of 901 records exported, 575 failed to import to Google with Code 429 "Quota exceeded... RESOURCE_EXHAUSTED... RATE_LIMIT_EXCEEDED" errors.

    Of the 326 successes, they were spread across 341 rows with 15 sporadically placed blank rows.

    I've only just begun to troubleshoot. This is the first help thread that came up for me. (I can't add screenshots, this interface is not accepting them.)

    0
  • Avatar
    Scott Henderson
    CTO
    Celigo University Level 1: Skilled
    Answer Pro
    Top Contributor

    Hey Brian Hampel, can you make the following changes to your Google connection. This should help mitigate the issues you are seeing. See pic below for context.

    1. Set Auto-recover rate limit errors to true.
    2. Set Target concurrency level to 1.

    On a side note, to improve the performance of importing into Google Sheets I am going to explore how to enhance the marketplace import bubble to submit batches of updates in the same request. I am not sure how feasible this will be to implement generically, but I will give it my best shot. Stay tuned!

     

    0
  • Avatar
    Scott Henderson
    CTO
    Celigo University Level 1: Skilled
    Answer Pro
    Top Contributor

    Okay good news. I just uploaded a new version of the template to the marketplace, and now the Google Sheets import uses Google's batchUpdate API, and it is super fast and efficient now! 

    Here are some important notes for using the latest version:

    1. Target concurrency level on the connection should still be set to 1. This is very important to avoid race conditions.
    2. Set the 'Page size' property on your source export to a really big value (like 1000) to maximize the number of records sent to Google in each individual HTTP request payload.
    3. Use the 'HTTP' toggle view to make changes to the import. The 'Simple' view for the batch update endpoint has some bugs that we need to fix still.
    0

Please sign in to leave a comment.

 

Didn't find what you were looking for?

New post