# Tells Scanning Robots Where They Are And Are Not Welcome # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # User-agent: NetMechanic Disallow: User-agent: * Disallow: /cgi-bin Disallow: /include Disallow: /sempo Disallow: /temp Disallow: /grehan Disallow: /includes Disallow: /clients Disallow: /tools Disallow: /training Disallow: /reports Disallow: /mail