QueryIDOL
A processor that sends a query to an IDOL Content component and outputs the resulting documents as FlowFiles.
You can specify a query in one of the following ways:
- Define a query using the Text, Field Text, Database Match, and other relevant properties in the processor configuration. With this approach you can define a single, pre-configured query and there is no incoming connection. The processor sends a
Query
action to IDOL Content each time it is scheduled to run, so Micro Focus recommends that you check the scheduling settings and configure a reasonable interval between each cycle. You can choose whether the second and subsequent queries return all matching documents, or only new documents, by setting the property New documents only. - Initiate a query by routing a FlowFile to the processor. The query parameters (including text, field text, and database name) can be set as FlowFile attributes. In this case, configure the processor properties using NiFi expression language that references the FlowFile attributes. The incoming FlowFile is routed to the "original" relationship, with additional attributes that you can use to construct a new query to retrieve new documents (the same query performed later could return additional results, if new documents are indexed). In this case the scheduling options define how often the processor checks its incoming connection for queued FlowFiles.
This processor can be useful when you want to re-ingest some of the documents in your IDOL index. You can send a query to IDOL Content and then route the result documents back to an IDOL Connector so that the connector retrieves those documents again.
NOTE: The connector must support the synchronize from identifiers feature.
NOTE: Your query results might contain documents retrieved by many different connectors. Each document must be routed back to the correct connector. You can route the resulting FlowFiles by the value of the idol.doc.source
attribute (for a description of this attribute, see Introduction to FlowFiles and Documents). Apache NiFi includes a built-in processor named RouteOnAttribute
that can route FlowFiles based on attribute values.
Properties
Name | Default Value | Description |
---|---|---|
IDOL License Service |
An IdolLicenseServiceImpl that provides a way to communicate with an IDOL License Server. |
|
IDOL Host | The host name or IP address of the IDOL Content component. | |
IDOL ACI Port | The ACI port of the IDOL Content component. | |
SSL Config Service | An optional IdolSSLConfigServiceImpl that specifies the settings to use to communicate over SSL/TLS. Set this property only if your IDOL Content component has been configured to accept connections over SSL. | |
Batch Size | 100 | The number of documents to release to the output relationship at one time. |
Text | Sets the value of the Text parameter in the Query action. |
|
Field Text | Sets the value of the FieldText parameter in the Query action. |
|
Database Match | Sets the value of the DatabaseMatch parameter in the Query action. |
|
AllSections | Sets the value of the Print parameter in the Query action. |
|
Print Fields | AUTN_SOURCE, AUTN_IDENTIFIER | Sets the value of the PrintFields parameter in the Query action. |
New documents only | True |
Specifies whether to return only new documents.
|
XML reference path | DREREFERENCE | The field, in documents in the index, that contains the document reference. |
XML source path | AUTN_SOURCE | The field, in documents in the index, that contains the document source. |
XML identifier path | AUTN_IDENTIFIER | The field, in documents in the index, that contains the document identifier. |
XML content path | DRECONTENT | The field, in documents in the index, that contains the document content. |
Dynamic properties |
Any dynamic properties that you set are added to the NOTE: You cannot set the action parameters |
|
attr:name |
When you configure the processor to run queries in response to incoming FlowFiles, you might want to add information about a query to all of the results. To do this, add dynamic properties named |
Relationships
View and Clear State Information
When there is no incoming connection, the processor stores state information so that it can obtain only new documents. If you change the query that you have configured, Micro Focus recommends clearing the state information.
To clear the state information
- Stop the processor.
-
Right-click the processor and click View State.
A dialog box opens.
- Click Clear state and then click CLOSE.
Stored State Tokens
When a query is complete the processor uses the TokenManagement
action to delete the state token in IDOL Content. This is an administrative action and fails unless NiFi is authorized to use it. There is no effect on NiFi Ingest if the TokenManagement
action fails, but the state token is not deleted.