Configure Apache NiFi

You can configure Apache NiFi to suit your needs, by following the Apache NiFi documentation. However, OpenText recommends making the following configuration changes.

Java Virtual Machine Memory

OpenText recommends that you increase the maximum amount of memory that can be used by the Java Virtual Machine (JVM).

To increase the maximum amount of memory for the JVM

  1. Open the Apache NiFi installation directory.
  2. Open the file conf/bootstrap.conf in a text editor.
  3. Find the line java.arg.3=-Xmx512m.
  4. Increase the maximum amount of memory available to the JVM, for example:

    java.arg.3=-Xmx2048m

Maximum Number of Threads

NiFi limits the number of tasks that can run simultaneously, by limiting the number of available threads. OpenText recommends that you configure a suitable number of threads for your ingest pipeline and machine specifications.

A NiFi Ingest processor, by default, processes one document at a time. If you want to process multiple documents concurrently, or you have a data flow that includes a large number of processors, the default maximum number of threads might be insufficient.

To choose the maximum number of threads

  1. Open the Apache NiFi user interface.
  2. Click followed by Controller Settings.

    The NiFi Settings dialog box opens.

  3. Set the Maximum Timer Driven Thread Count and Maximum Event Driven Thread Count options. By default, most IDOL NiFi Ingest processors are timer driven.
  4. Click APPLY.