User-agent: * Disallow: / User-agent: MSNPTC Disallow: User-agent: AdsBot-Google Disallow: User-agent: AdsBot-Google-Mobile Disallow: User-agent: Mediapartners-Google Disallow: User-agent:Applebot Disallow: /