NumProcessors

The number of processors to use to run the LLM generation.

This parameter has an effect only when Type is set to GenerativeLLM.

IMPORTANT: The value for NumProcessors applies to all your GenerativeLLM and Transformer models (see Embeddings Configuration Parameters). If you set this parameter in multiple sections, QMS uses the last value.

Type: Integer
Default: the LLM uses all available processors
Required: No
Configuration Section: MyGenerativeModel
Example: NumProcessors=1
See Also: Type