# Robots.txt file for http://www.mi-st.org.uk # # All Robots will spider the domain except those directories disallowed below User-agent: * Disallow: /images/ Disallow: /html/images/ Disallow: /html/docs/ Disallow: /docs/ Disallow: /menus/ Disallow: /research_projects/ Disallow: /html//menus/ Disallow: /html//research_projects/