Block Resource Downloads

You can configure Web Connector so that it does not download certain resources, such as scripts or advertisements. This can result in fewer HTTP requests, reduce the amount of time required for a synchronize task, and prevent unwanted content from contaminating your IDOL index.

Resources include stylesheets, JavaScript files, images, and other items that are used to construct a page. You can block resources from being downloaded by regular expression or by using block lists.

To block page resources

  • Set the configuration parameters ResourceUrlCantHaveRegex and ResourceUrlMustHaveRegex. These block resources where the URL of the resource matches, or does not match, a regular expression. For example, you could exclude all resources that do not originate from your own domain:

    ResourceUrlMustHaveRegex=https://www\.example\.com.*
  • Set the configuration parameter BlockingFiltersDirectory to the path of a directory that contains filter lists. You can use filter lists from https://easylist.to, or create your own in the same format. The filter lists are used to block undesirable content.