Generating JSONL Files in Celigo
Need to generate JSONL files but don’t see JSONL listed as a file type in Celigo’s file provider imports? No problem—here’s a method to create JSONL files effectively.
Steps to Generate JSONL Files:
-
File Provider Setup:
- In your file provider import step, select EDI X12 as the file type. While CSV might seem like another obvious choice, it isn’t suitable here because the quotes within the generated CSV file will be escaped with an additional double quote, causing issues with JSONL formatting.
-
Define EDI File Rules:
-
Use the following EDI file definition to generate JSONL files:
{ "name": "JSONL", "sandbox": false, "description": "JSONL", "version": "1", "format": "delimited", "skipEmptyEndColDelimiter": true, "delimited": { "rowSuffix": "", "rowDelimiter": "\n", "colDelimiter": "*" }, "rules": [ { "maxOccurrence": 99999, "required": true, "elements": [ { "name": "ISA", "value": "{{{jsonSerialize this}}}" } ] } ] }
- This configuration ensures that each record is serialized into a valid JSON object and formatted with line breaks (
\n
) to create JSONL.
-
-
Limitations:
- Data Size Limitation: This approach will not aggregate pages of data, so the maximum file size is limited to 5 MB. Ensure your data volume aligns with this constraint.



0
Comments
Please sign in to leave a comment.