MinFinalSummaryChunkSize

The minimum number of tokens that the final chunk of text must include for QMS to use it to generate a summary.

When QMS performs summarization on pieces of text larger than the configured ChunkSize, QMS breaks the text up into chunks that each contain a maximum of ChunkSize tokens. QMS then generates summaries for each chunk and combines the results.

When the input text length results in a small final chunk, the generated summary for that final chunk is often poor quality. Set MinFinalSummaryChunkSize to include a summary for the final chunk only when that chunk is larger than the specified number of tokens.

Set MinFinalSummaryChunkSize to 0 to use summaries from final chunks of any size.

NOTE: When the text input contains only one chunk, QMS generates a summary regardless of the size, and does not enforce the MinFinalSummaryChunkSize limit.

This parameter has an effect only when Type is set to GenerativeLLM.

Type: String
Default: 50
Required: No
Configuration Section: MyGenerativeModel
Example: MinFinalSummaryChunkSize=120
See Also: Type