Filter HubSpot data to configure a delta export

A delta export retrieves only those matching records that were changed or created since the previous flow ran or a specified date. Certain HubSpot API requests do offer the Delta export type as a built-in option. However, integrator.io is not always able to set the HubSpot query parameters to check the “last exported” (lastExportDateTime) value that it typically relies on to export only unsynced records.

As a safeguard, you can achieve full delta functionality in v3 of the HubSpot API by setting an output filter on the exported records, as described below. In short, this example compares the “last modified” value returned by HubSpot with a record’s “last exported” value. 

1. Create a HubSpot export with the following settings:
   • API version: v3
   • API name: CRM API: Companies
   • Operation: List
2. Click the Preview button, and record the JSON path to the “last modified” field in the response data – in this case, properties.hs_lastmodifieddate. 

3. Save and close the export.
4. Returning to Flow Builder, create an output filter:
   1. Click Define options (+) on the export, and select Output filter (  ). The Define output filter panel opens with an empty initial rule. 
   2. Click to edit the Operand settings (), set the Operand type to Expression, and click Save to close the dialog. 
   3. Paste the following expression into the first operand field, where last-modified is the value from step 2 (see image below):
      ["subtract",["number",["epochtime",["extract","last-modified"]]],["epochtime",["context","lastExportDateTime"]]]
   4. Choose is greater-than for the operator.
   5. Change the second operand’s Operand type to Value and its Data type to Number, and set its value to 0.
5. Save and close the filter, and run the flow.

This new filter excludes all records that were modified before they were last exported, based on calculating the difference between the timestamps in properties.hs_lastmodifieddate and lastExportDateTime. Thus, a record with a negative value – meaning that its “last exported” date/time is earlier than its “last modified” date/time – proceeds in the flow.