# # robot exclusion file for NTWGS.ORG # # we only want the main <>.html files to be indexed. # # User-Agent: * Disallow: images/* Disallow: *.map Disallow: stats/* Disallow: adpages/* Disallow: OldStuff/* Disallow: MembersOnly/* Disallow: PondTour/* Disallow: PondDB/* Disallow: maps/* Disallow: local-cgi/*