SpiderAccept
Use this parameter to specify the string that the spider sends in its header to accept pages. If you enter */*
all pages are accepted.
Type: | String |
Default: | */* |
Required: | No |
Configuration Section: | TaskName or Default |
Example: | SpiderAccept=*/*
|
See Also: |