ResourceUrlMustHaveRegex
The URL of a resource must match the specified regular expression, otherwise it is not downloaded.
Resources include stylesheets, JavaScript files, images, and other items that are used to construct a page. You can prevent the Web Connector ingesting documents for resources by setting parameters like UrlMustHaveRegex or ContentTypeMustHaveRegex, but the connector still downloads resources so that it can render pages correctly.
You can set this parameter to prevent the connector downloading resources, other than those specified, under any circumstances.
This parameter cannot be used to exclude pages (such as HTML files).
Type: | String |
Default: | |
Required: | No |
Configuration Section: | TaskName or FetchTasks |
Example: |
The following example permits the connector to download resources, but only when the URL starts with
|
See Also: | ResourceUrlCantHaveRegex |