############################### # # User-agent: WebZIP/2.75 (http://www.spidersoft.com) User-agent: WebZIP/3.65 (http://www.spidersoft.com) User-agent: WebZIP/3.80 (http://www.spidersoft.com) User-agent: WebZIP/4.0 (http://www.spidersoft.com) User-agent: WebZIP/4.1 (http://www.spidersoft.com) User-agent: WebZIP/4.21 User-agent: WebZIP/4.21 (http://www.spidersoft.com) User-agent: WebZIP/5.0 User-agent: WebZIP/5.0 (http://www.spidersoft.com) User-agent: WebZIP/5.0 PR1 (http://www.spidersoft.com) User-agent: WebZip User-agent: WebZip/4.0 # # list folders robots are not allowed to index # Disallow: /include/ Disallow: /css/ Disallow: /js/ Disallow: /fonts/ # # list specific files robots are not allowed to index # # # ###############################