PutAwsFirehose

Sends IDOL documents to an Amazon Kinesis Data Firehose. The Amazon Kinesis Data Firehose is a cloud service that can optionally transform the data before delivering it to one or more destinations, such as an Amazon S3 bucket.

Properties

Name Default Value Description
IDOL License Service  

An IdolLicenseServiceImpl that provides a way to communicate with an IDOL License Server.

Aws Firehose Stream Name   The name of the Amazon Kinesis Data Firehose stream to send documents to. This is the name that you provided when you created the stream. You can create a Kinesis Data Firehose stream through the AWS Management Console, and the stream must exist before you configure NiFi Ingest.
Aws Firehose Access Key   The access key for the Amazon Kinesis Data Firehose stream.
Aws Firehose Secret Key   The secret key for the Amazon Kinesis Data Firehose stream.
Aws Firehose Enable Logging false A Boolean value that specifies whether to enable additional logging.
Aws Firehose Region us-east-1 The Amazon Web Services region that is hosting your Amazon Kinesis Data Firehose stream.
SSL Config Service   An IdolSSLConfigServiceImpl that specifies the settings to use to index documents over SSL/TLS.
Document Registry Service   A DocumentRegistryServiceImpl controller service that manages and updates a document registry database. This ensures that documents are indexed in the correct order.
Indexer Batch Size 100

The maximum number of FlowFiles to accumulate before indexing documents.

Indexing documents in larger batches can be more efficient; indexing smaller batches more frequently means that an individual document might spend less time in the queue.

Documents might be indexed in incomplete batches if the Indexing Interval Duration is reached first.

Indexing Interval Duration 5 min

The maximum amount of time to wait between indexing batches of documents. Documents might be indexed more frequently than this if the Indexer Batch Size is reached first.

Waiting longer and indexing documents in larger batches can be more efficient; indexing smaller batches more frequently means that an individual document might spend less time in the queue.

Relationships

Name Description
success FlowFiles that were indexed successfully.
failure FlowFiles that were not indexed successfully.