Device
The type of processor to use to process generative models. You can use one of the following values:
-
CPU
-
CUDA
To use the CUDA option, you must have a compatible GPU available for use, or QMS fails with an error. It does not default to using the CPU if there is no compatible GPU available.
This parameter has an effect only when Type is set to GenerativeLLM
.
Type: | String |
Default: | CPU |
Required: | No |
Configuration Section: | MyGenerativeModel |
Example: | Device=cuda
|
See Also: | Type
|