# Robots.txt file from http://www.Goonline.co.il # # All robots will spider the domain # Disallow /Heb/ # Disallow /Coral/ # Disallow: /DirectMarketing/ # Disallow: /wcadi/ # Disallow: /Mail/ # Disallow: /DB/ # Disallow: /Data/ User-agent: * User-agent: ia_archiver Disallow: / Disallow: /tech/ Disallow: /Heb/ Disallow: /Coral/ Disallow: /DirectMarketing/ Disallow: /wcadi/ Disallow: /Mail/ Disallow: /DB/ Disallow: /Data/ Disallow: /MYASG/ Disallow: /bannerad/