# Robots.txt file from http://www.searchengineworld.com # # Built from text file http://info.webcrawler.com/mak/projects/robots/active/all.txt # # This restricts access to only known and registered robots. # User-agent: * Disallow: / #Disallow: /test/ #Disallow: /_ #Disallow: /ExhibitorList #Disallow: /ExhibitorDetails #Disallow: /links/ #Disallow: /store/ #Disallow: /SMEInfoRequest #Disallow: /scrd/ #Disallow: /view.cfm #Disallow: /membersignup #Disallow: /css #Disallow: /dynamic #Disallow: /ViewProductInfo #Disallow: /CallForPapers