NumProcessors

The number of processors to use to run the LLM generation.

This parameter has an effect only when Type is set to Transformer.

IMPORTANT: The value for NumProcessors applies to all your Transformer, GenerativeLLM, and ExtractiveQuestionAnsweringLLMmodels (see LLM Module Configuration Parameters). If you set this parameter in multiple sections, Answer Server uses the last value.

Type: Integer
Default: the LLM uses all available processors
Required: No
Configuration Section: MyEmbedding
Example: NumProcessors=1
See Also: Type