NumProcessors

The number of processors to use to run the LLM generation.

This parameter has an effect only when Type is set to Transformer.

IMPORTANT: The value for NumProcessors applies to all your Transformer and GenerativeLLM models (see Generative Configuration Parameters). If you set this parameter in multiple sections, QMS uses the last value.

Type: Integer
Default: the LLM uses all available processors
Required: No
Configuration Section: MyEmbedding
Example: NumProcessors=1
See Also: Type