MinFinalSummaryChunkSize
The minimum number of tokens that the final chunk of text must include for QMS to use it to generate a summary.
When QMS performs summarization on pieces of text larger than the configured ChunkSize, QMS breaks the text up into chunks that each contain a maximum of ChunkSize tokens. QMS then generates summaries for each chunk and combines the results.
When the input text length results in a small final chunk, the generated summary for that final chunk is often poor quality. Set MinFinalSummaryChunkSize
to include a summary for the final chunk only when that chunk is larger than the specified number of tokens.
Set MinFinalSummaryChunkSize
to 0 to use summaries from final chunks of any size.
NOTE: When the text input contains only one chunk, QMS generates a summary regardless of the size, and does not enforce the MinFinalSummaryChunkSize
limit.
This parameter has an effect only when Type is set to GenerativeLLM
.
Type: | String |
Default: | 50 |
Required: | No |
Configuration Section: | MyGenerativeModel |
Example: | MinFinalSummaryChunkSize=120
|
See Also: | Type
|