NumProcessors

The number of processors to use to run the LLM generation.

This parameter has an effect only when Type is set to GenerativeLLM or ExtractiveQuestionAnsweringLLM.

IMPORTANT: The value for NumProcessors applies to all your GenerativeLLM, ExtractiveQuestionAnsweringLLM, and Transformer models (see My Embeddings Configuration Parameters). If you set this parameter in multiple sections, Answer Server uses the last value.

Type: Integer
Default: the LLM uses all available processors
Required: No
Configuration Section: MyLLMModule
Example: NumProcessors=1
See Also: Type