ConvertCSVToDocuments

Many systems output data in comma-separated (CSV) format. The ConvertCSVToDocuments processor automatically detects any FlowFile that represents a text or CSV file and attempts to parse the data into IDOL documents. Each row in the CSV file becomes a new IDOL document.

Properties

Name Default Value Description
IDOL License Service  

An IdolLicenseServiceImpl that provides a way to communicate with an IDOL License Server.

Document Registry Service   A DocumentRegistryServiceImpl controller service that manages and updates a document registry database. This ensures that documents are indexed in the correct order.
Use CSV Header Row True A Boolean value that specifies whether the first row of the CSV file specifies field names and should not become a document.
CSV Field Names   The names of the fields in the CSV file. Setting this property overrides any values read from the file when Use CSV Header Row is true.
Reference Field DREREFERENCE The name of the field (in the CSV file header row or CSV Field Names property) to use as the document reference. If there isn't a suitable field, you can set this property to an empty string and set Base Reference instead.
Content Field DRECONTENT The name of the field (in the CSV file header row or CSV Field Names property) to use as the document content. If you don't want to populate the document content, set this property to an empty string.
Map all fields to content False A Boolean value that specifies whether to add all of the values to the document content, separated by new lines.
Base Reference   If the CSV file doesn't contain a suitable reference field, you can specify a base reference. The documents extracted from the CSV file will be given references in form BaseReference:N where N is the line number in the source CSV file.
Commit Batch Size 100 The processor outputs documents in batches to limit memory use and allow subsequent tasks to begin processing the documents sooner. This property specifies the maximum batch size.

Relationships

Name Description
extracted New FlowFiles for individual IDOL documents that were extracted from a CSV file.
success Original FlowFiles that were successfully processed.
failure Original FlowFiles that do not represent CSV files, or from which there were parsing errors.