ConvertCSVToDocuments
Many systems output data in comma-separated (CSV) format. The ConvertCSVToDocuments processor automatically detects any FlowFile that represents a text or CSV file and attempts to parse the data into IDOL documents. Each row in the CSV file becomes a new IDOL document.
Properties
Name | Default Value | Description |
---|---|---|
IDOL License Service |
An IdolLicenseServiceImpl that provides a way to communicate with an IDOL License Server. |
|
Document Registry Service | A DocumentRegistryServiceImpl controller service that manages and updates a document registry database. This ensures that documents are indexed in the correct order. | |
Use CSV Header Row | True | A Boolean value that specifies whether the first row of the CSV file specifies field names and should not become a document. |
CSV Field Names | The names of the fields in the CSV file. Setting this property overrides any values read from the file when Use CSV Header Row is true. | |
Reference Field | DREREFERENCE | The name of the field (in the CSV file header row or CSV Field Names property) to use as the document reference. If there isn't a suitable field, you can set this property to an empty string and set Base Reference instead. |
Content Field | DRECONTENT | The name of the field (in the CSV file header row or CSV Field Names property) to use as the document content. If you don't want to populate the document content, set this property to an empty string. |
Map all fields to content | False | A Boolean value that specifies whether to add all of the values to the document content, separated by new lines. |
Base Reference | If the CSV file doesn't contain a suitable reference field, you can specify a base reference. The documents extracted from the CSV file will be given references in form BaseReference:N where N is the line number in the source CSV file. |
|
Commit Batch Size | 100 | The processor outputs documents in batches to limit memory use and allow subsequent tasks to begin processing the documents sooner. This property specifies the maximum batch size. |
Relationships
Name | Description |
---|---|
extracted | New FlowFiles for individual IDOL documents that were extracted from a CSV file. |
success | Original FlowFiles that were successfully processed. |
failure | Original FlowFiles that do not represent CSV files, or from which there were parsing errors. |