# Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for everyone # Disallow: if this matches first part of requested path, forget it User-agent: * Disallow: /cgi-bin/ Disallow: /gallery/ Disallow: /gallery Disallow: /teaching/ Disallow: /erth6350/ Disallow: mars/ Disallow: /mars/ Disallow: /4450/ Disallow: 4450/ Disallow: courses/ Disallow: /courses Disallow: /1030 Disallow: 1030/ Disallow: /2440/ Disallow: 2440/ Disallow: lab/thesisguidelines.html