A Perl-compatible regular expression to restrict the content retrieved by the connector. The full URL of a page must match the regular expression, otherwise the page is not ingested. This parameter applies to all file types, for example HTML pages, images, text documents, and so on.
Type: | String |
Default: | |
Required: | No |
Configuration Section: | TaskName or FetchTasks or Default |
Example: | UrlMustHaveRegex=.*data\.mywebsite\.com/index.*|.*internal\.mywebsite\.com/index.*
|
See Also: | UrlCantHaveRegex |
|