############################### # # User-agent: * # # list folders robots are not allowed to index # Disallow: /_database/ Disallow: /whatever/else/ Disallow: /Applications/ Disallow: /ClientData/ Disallow: /Flash_FLA_Files/ Disallow: /Images/ Disallow: /Test/ Disallow: /PodcastCenter/flash/ Disallow: /WebServices/ Disallow: /Stores/EvolutionGear/Util/ Disallow: /Stores/EvolutionGear/Womens/Util/ Disallow: /Stores/TheAsianSexSpot/Util/ Disallow: Disallow: /SiteAdmin/ Disallow: /Community/SkeeWeeTV/Admin/ # # list specific files robots are not allowed to index # Disallow: /FlashMovies/MJQmultimedia.swf Disallow: /crossdomain.xml Disallow: /Web.config # # ###############################