User-agent: *
Crawl-delay: 30
Sitemap: http://wad-medani.mobi/sitemap.xml
404 Not Found
Not Found
The requested URL /robots.txt was not found on this server.
Additionally, a 404 Not Found
error was encountered while trying to use an ErrorDocument to handle the request.
Apache/2.2.16 (Unix) mod_ssl/2.2.16 OpenSSL/0.9.8e-fips-rhel5 mod_fcgid/2.3.5 Server at www.wad-medani.com Port 80
User-agent: *
Crawl-delay: 30
Sitemap: http://wad-medani.mobi/sitemap.xml