# For use by search.w3.org User-agent: W3Crobot/1 Disallow: /Out-Of-Date User-agent: * Disallow: /ftp Disallow: /stats Disallow: /includes Disallow: /_private Disallow: /ARCHIVE Disallow: /DRAFT Disallow: /communicate Disallow: /job_postings/Old_Listings Disallow: /marketing # User-agent: * # Disallow: