Before processing large inbound EDI payloads, ensure you meet the following requirements:
-
Subscription plan: You must have a B2B Manager license to utilize large file optimization streams for EDI ingestion.
Inbound EDI large file processing in integrator.io introduces an optimized streaming memory architecture that ingests and parses large inbound EDI files from trading partners. The platform eliminates the previous 5MB restriction, processing oversized documents safely without causing runtime transformations to fail or blocking downstream supply chain pipelines. This update enables high-volume B2B data ingestion, such as bulk purchase orders, consolidated invoices, and complex advance shipment notices (ASNs), while maintaining platform stability and performance.
The updated parsing runtime allocates processing memory dynamically based on the incoming file size
|
File volume threshold |
Processing architecture |
System impact |
|
Standard payloads (Under 5MB) |
Standard in-memory translation buffer. |
Low latency parsing with immediate data transformation. |
|
Oversized payloads (5MB and above) |
Chunked memory allocation and streaming parsing blocks. |
Prevents ingestion failures and isolates high-volume streams to protect concurrent flow executions. |
The large file engine resolves critical data ingestion and parsing limits for scaling businesses.
-
Support high-volume data use cases: High-volume transaction drops from major trading partners often exceed standard memory limits during the data ingestion phase. The platform handles heavy payloads automatically, parsing extensive data lines into structured formats without requiring your partners to manually split files.
-
Maintain operational continuity: When inbound file parsing fails due to size limitations, downstream inventory updates and fulfillment schedules stall. Processing large payloads directly inside integrator.io removes data blocks, eliminates partner retransmissions, and lowers order processing delays.
-
Onboard enterprise trading partners: Enterprise distributors and retail partners frequently mandate consolidated, high-density bulk document transmissions. This performance enhancement provides the technical capacity you need to comply with stringent trading partner agreements and clear external audit thresholds.
integrator.io now features an optimized memory and streaming architecture that allows you to generate large outbound EDI files, up to 1 GB from source JSON payloads that exceed 5MB. Previously, over-sized payloads caused runtime transformation failures that blocked downstream supply chain workflows.
The updated processing dynamically scales memory to serialize high-volume data streams sequentially, preventing platform timeouts and eliminating the need to manually split files.
-
High-volume support: Process intensive business-to-business (B2B) document pipelines, including bulk purchase orders, consolidated invoices, and complex advance shipment notices (ASNs).
-
Operational continuity: Maintain active fulfillment and shipping schedules by eliminating runtime data blocks and reducing customer payload rework.
-
Partner onboarding: Satisfy the strict transaction volume thresholds and data compliance standards mandated by major retail and logistics distributors.
When handling large file transformations, monitor your flow runs:
-
Run Console: Go to the flow run console to monitor long-running steps. The platform provides details to verify pipeline health.
-
EDI activity dashboard: Select Dashboard > EDI Activity to verify transmission timestamps, incoming file, and partner delivery receipts once ingestion finishes.