NumProcessors
The number of processors to use to run the LLM generation.
This parameter has an effect only when Type is set to Transformer
.
IMPORTANT: The value for NumProcessors
applies to all your Transformer
and GenerativeLLM
models (see Generative Configuration Parameters). If you set this parameter in multiple sections, QMS uses the last value.
Type: | Integer |
Default: | the LLM uses all available processors |
Required: | No |
Configuration Section: | MyEmbedding |
Example: | NumProcessors=1
|
See Also: | Type
|