# Robots.txt file # For domain: http://www.cycleclassifieds.us User-agent: Mediapartners-Google* Disallow: Allow: / User-agent: oodlebot Disallow: / User-Agent: OmniExplorer_Bot Disallow: / User-agent: ia_archiver Disallow: / User-agent: dotbot Disallow: / User-agent: * Disallow: /c/0/Main.html Disallow: /index.php? Disallow: /*?* Disallow: /? Disallow: /aff.php? Disallow: /index.php/ Disallow: /js/ Disallow: /geo_templates/ Disallow: /p/ Disallow: /404.html