Configure Apache NiFi

You can configure Apache NiFi to suit your needs, by following the Apache NiFi documentation. However, Micro Focus recommends making the following configuration changes.

Java Virtual Machine Memory

Micro Focus recommends that you increase the maximum amount of memory that can be used by the Java Virtual Machine (JVM).

To increase the maximum amount of memory for the JVM

  1. Open the Apache NiFi installation directory.
  2. Open the file conf/bootstrap.conf in a text editor.
  3. Find the line java.arg.3=-Xmx512m.
  4. Increase the maximum amount of memory available to the JVM, for example:

    java.arg.3=-Xmx2048m

Maximum Number of Threads

NiFi limits the number of tasks that can run simultaneously, by limiting the number of available threads. Micro Focus recommends that you configure a suitable number of threads for your ingest pipeline and machine specifications.

A NiFi Ingest processor, by default, processes one document at a time. If you want to process multiple documents concurrently, or you have a data flow that includes a large number of processors, the default maximum number of threads might be insufficient.

To choose the maximum number of threads

  1. Open the Apache NiFi user interface.
  2. Click followed by Controller Settings.

    The NiFi Settings dialog box opens.

  3. Set the Maximum Timer Driven Thread Count and Maximum Event Driven Thread Count options. By default, most IDOL NiFi Ingest processors are timer driven.
  4. Click APPLY.

KeyView Configuration on Linux

If you are running NiFi Ingest on Linux, Micro Focus recommends that you set the environment variable KV_CLOSEINHERITEDFH=1. Setting this environment variable instructs the KeyView out-of-process server (KVOOP) to release handles - to files and sockets - that it inherited from its parent process. If you do not set this environment variable, you might see unexpected behavior such as processors failing to start because ports are already in use.