The MaxPageDate
parameter filters the pages that are ingested by date. The connector only ingests pages that are newer than the specified date. Older pages are not ingested, though links from these pages might still be followed, depending on the value of SpiderDateFilteredPages.
Specify the date in any of the formats specified by DateFormats.
To use this parameter you must set either DateInUrl or PageDateSelector so that the Web Connector can extract a date for each page.
If you set the parameter MaxPageAge, this parameter is ignored.
Type: | String |
Default: | |
Required: | No |
Configuration Section: | TaskName or FetchTasks or Default |
Example: | MaxPageDate=2015-Feb-17
|
See Also: |
|