Set up the Field Index Process
IDOL connectors aggregate content and metadata, process it and then index it into the IDOL Content component in the form of fields. To improve IDOL Server performance, divide these fields into the following groups:
-
Prevent from storing. Prevent Content from storing fields that you do not want to query by setting the
CantHaveFieldsCSVs
parameter in your IDOL Content component configuration file. Alternatively, add theCantHaveFields
parameter to yourDREADD
orDREADDDATA
index action. -
Index fields. Store fields that contain text that you want to query frequently as Index fields. Content processes Index fields linguistically when it stores them. Content applies stemming and stop word lists to the text, which allows it to process queries for these fields more quickly. Typically, you set up
DRETITLE
andDRECONTENT
as Index fields.Do not use Index fields to store URLs or content that you are unlikely to use. Also, when you query the value only in its entirety, it is more efficient to query with a field specifier (for example,
MATCH)
, than to store the data in an Index field.OpenText does not recommend indexing all fields in documents because it can potentially slow the indexing process, increase disk usage, and increase requirements.
-
Numeric fields. Store fields that contain numerical values or dates as numeric fields and numeric date fields. When Content indexes these fields, it stores them in a fast look-up table in memory, which enables it to return the fields more quickly.
-
Field-check fields. If a large number of the documents that you want to store in Content contain a field whose entire value is frequently used to restrict results, store this field as a
FieldCheckType
field. When Content indexes these fields, it stores them in a fast look-up table in memory, which enables it to return the fields more quickly. -
Ordinary fields. By default Content stores all fields that are not identified as special fields as ordinary fields.
NOTE: You can query all stored fields using field specifiers in FieldText
queries. You can also query Index
fields using text queries.
For more information about fields, see Fields.