Add a File System Connector
The first component you should add to your ingestion pipeline is a connector. Connectors provide a way to get data into NiFi. There are IDOL Connectors for dozens of different repositories, but this example demonstrates how to add a File System Connector.
To add a File System Connector
-
Add a processor, by dragging the processor icon
from the components toolbar to the canvas.
The Add Processor dialog box opens.
-
In the Source list, click idol.nifi.connector.
The list of processors is filtered to show only IDOL NiFi Ingest connectors.
-
Select the GetFileSystem processor and click ADD.
The processor is added to the canvas.
-
Right-click the processor and click Configure.
The Configure Processor dialog box opens.
- Click the Properties tab.
-
Set the following properties:
IDOL License Service Specify the name of the IDOL License Service that you created in Create a License Service. Directory Paths Specify a comma-separated list of paths to retrieve data from. There are many other properties that you can set to configure the behavior of the connector. For more information about each option, hover the mouse pointer over the associated help icon. For example:
- Click APPLY.