Configure Synchronize Schedules
Your NiFi Ingest dataflow can include any number of IDOL Connectors. The scheduling feature allows you to configure when your connectors synchronize data (when they connect to your data repositories and retrieve the latest data for processing or indexing into IDOL).
NOTE: Using this feature, you can configure multiple NiFi Ingest Connectors (of the same type, for example all File System Connectors or all Web Connectors) at the same time. However, a NiFi Ingest Connector can not be configured if it is running, or if it has an incoming connection. (If the connector has an incoming connection it performs a synchronize cycle only when it receives a FlowFile, and you must schedule synchronize cycles by generating FlowFiles as described in Synchronize with a Repository).
To configure synchronize schedules for IDOL NiFi Ingest Connectors
- Stop the IDOL NiFi Ingest Connectors that you want to configure. You can configure schedules for multiple processors - of the same type, for example all File System Connectors - at the same time.
- Right-click one of the IDOL NiFi Ingest Connectors and click Configure.
- Click Advanced.
-
Click the Scheduling tab.
The scheduling options are displayed.
- Configure the schedules as necessary. The Max Duration box sets the maximum duration of a synchronize cycle. If a cycle exceeds this duration, the connector stops and the remaining documents are not synchronized until the next cycle. Specify a time duration such as "2 hours" or "90 mins".
- To save the schedules, click SET.