Crawl Parameters

The parameters in this section configure how the connector crawls the Web.

Depth

FollowFlash

FollowRobotProtocol

IgnoreCanonicalLinks

SpiderUrlCantHaveRegex

SpiderUrlMustHaveRegex

StayOnSite


_HP_HTML5_bannerTitle.htm