NumProcessors
The number of processors to use to run the LLM generation.
This parameter has an effect only when Type is set to Transformer
.
IMPORTANT: The value for NumProcessors
applies to all your Transformer
, GenerativeLLM
, and ExtractiveQuestionAnsweringLLM
models (see LLM Module Configuration Parameters). If you set this parameter in multiple sections, Answer Server uses the last value.
Type: | Integer |
Default: | the LLM uses all available processors |
Required: | No |
Configuration Section: | MyEmbedding |
Example: | NumProcessors=1
|
See Also: | Type
|