DataLimit

The maximum start offset (in bytes) of text used to generate any embedding input. You can use this option to limit the amount of processing QMS performs if it receives a large file.

When QMS generates embeddings, it can use a chunk of text that ends after this limit, but not a chunk of text that starts after this limit. For example, if you set DataLimit to 3000, then you might get an embedding with start and end offsets [2300, 3100], but not an embedding with start offset 3050.

DataLimit must be either a positive integer, or -1 to specify no limit.

This parameter has an effect only when Type is set to Transformer.

Type: Integer
Default: -1 (no limit)
Required: No
Configuration Section: MyEmbedding
Example: DataLimit=1000
See Also: