TokenWithPunctuation

Set TokenWithPunctuation to True to treat all punctuation characters as part of a word token, rather than treating them as word boundaries. This option is equivalent to setting TangibleCharacters to all punctuation characters.

This parameter has no effect when MatchWholeWord is set to False.

Type: Boolean
Default: False
Required: No
Configuration Section:

Any section that you have defined for Eduction settings

Example: TokenWithPunctuation=True
See Also: MatchWholeWord
TangibleCharacters

For more information on using TokenWithPunctuation to configure all punctuation marks as tangible characters, refer to the Eduction User and Programming Guide.