NumProcessors
The number of processors to use to run the LLM generation.
This parameter has an effect only when Type is set to GenerativeLLM
or ExtractiveQuestionAnsweringLLM
.
IMPORTANT: The value for NumProcessors
applies to all your GenerativeLLM
, ExtractiveQuestionAnsweringLLM
, and Transformer
models (see My Embeddings Configuration Parameters). If you set this parameter in multiple sections, Answer Server uses the last value.
Type: | Integer |
Default: | the LLM uses all available processors |
Required: | No |
Configuration Section: | MyLLMModule |
Example: | NumProcessors=1
|
See Also: | Type
|