6 lines
No EOL
91 B
Text
6 lines
No EOL
91 B
Text
User-agent: AHRQ Search Appliance
|
|
Crawl-delay: 1
|
|
Disallow:
|
|
|
|
User-agent: *
|
|
Disallow: / |