OfflineMode
Set OfflineMode
to True
to use only a locally cached version of the configured model (and never download an updated version from Hugging Face). In this case, you must have the required models cached in the appropriate place.
NOTE: If QMS cannot connect to the internet, QMS looks for the model in the local cache directory even if you have set OfflineMode
to False
.
This parameter has an effect only when Type is set to GenerativeLLM
.
Type: | Boolean |
Default: | False |
Required: | No |
Configuration Section: | MyGenerativeModel |
Example: | OfflineMode=True
|
See Also: | ModelName
|