Extract File Split Size
The file size to split extracted files into multiple files for. Applied if the file is larger than 2x this size. Use 0 to not split files. Size in MB.
In the file-processing step of the source-to-file package, a value greater than 0 splits the extracted file into numbered chunk files (_1, _2, …) of approximately this size in MB. A file smaller than twice the split size is left as a single file. Each chunk is then compressed or converted to UTF-8 individually, and the original unsplit file is removed. A value of 0 — or a non-numeric value — disables splitting.
When to Change This Setting
Keep the default 0 unless very large extract files cause problems for downstream transfer or load steps, in which case set the chunk size that suits the downstream consumer.
Related Settings
| Setting | Interaction |
|---|---|
| Extract File Encoding | The encoding the file is read with during the same processing step |
| Zip Output File | Compresses each resulting file |
Notes
- This setting is part of the Staging settings category.
- The default value for this setting is
0.