View Connector Statistics
NiFi Ingest Connectors collect statistics about the work that has been completed. The statistics that are available depend on the connector you are using, but all connectors provide information about the number and frequency of ingest-adds, ingest-updates, and ingest-deletes.
Some connectors can collect statistics about the number and frequency of API calls made to the repository, but these statistics are not enabled by default. See the advanced property adv:EnableDebugStatistics.
To view connector statistics
- Right-click the IDOL NiFi Ingest processor and click View Configuration.
- Click Advanced.
-
Click the Statistics tab.
The statistics are displayed.
The image above is from a GetFileSystem processor. The charts show the number of files processed per second, averaged across the last 10 seconds, 60 seconds, 5 minutes, and so on. You can see the rate in files per second, per minute, per hour, or per day by clicking the relevant option at the top of the dialog.
You can configure the intervals for collecting statistics by setting the advanced property adv:StatisticsIntervals. If the connector has not yet collected information for all of your chosen time intervals, the corresponding bars appear partially transparent.
The information used to generate statistics is stored in memory, so is lost if you stop NiFi.
The following information is presented above the chart for each statistic:
- Total is a running total since NiFi started.
- Current Total is the total for the synchronize task that is currently running.
- Previous Total provides the total for previous tasks. To see the totals for the most recent tasks, hover your mouse pointer over the value.
You can use the Name Filter box to choose the charts that appear in the dialog. The title of the chart (such as "Files Analyzed" or "Ingest Deletes" in the example above) must match the regular expression that you enter, otherwise the chart is hidden.