# All robots will spider the domain User-agent: * Disallow: User-agent: * Disallow: /aspnet_client/ Disallow: /cgi-bin/ Disallow: /control/ Disallow: /include/ Disallow: /mail/ Disallow: /styles/ Disallow: /temp/ Disallow: /undefined/ Disallow: /updates/ Disallow: /barkerscollier/ Disallow: /carr/webControl.mdb Disallow: /carr/webRecords.mdb Disallow: /carr/blackpool/ Disallow: /carr/include/ Disallow: /carr/styles/ Disallow: /carr/control/ Disallow: /clarke/webControl.mdb Disallow: /clarke/webRecords.mdb Disallow: /clarke/blackpool/ Disallow: /clarke/include/ Disallow: /clarke/styles/ Disallow: /clarke/control/ Disallow: /barkerscollier/webControl.mdb Disallow: /barkerscollier/webRecords.mdb Disallow: /barkerscollier/blackpool/ Disallow: /barkerscollier/include/ Disallow: /barkerscollier/styles/ Disallow: /barkerscollier/control/ Disallow: webControl.mdb Disallow: webRecords.mdb