# robots.txt # note: this file needs to be stored at http://www.yourdomain.tld/robots.txt # otherwise it will not show any effect # note: robots.txt only can control robots. using robots.txt is no measure # to prevent humans and browsers to visit certain page # learn more on robots.txt at http://de.selfhtml.org/diverses/robots.htm # statement on robots, asterisk means all are allowed # to allow only a certain robot use: User-agent: example-robot User-agent: * # all old TYPO3 content pages forbidden Disallow: /public-business-strategy-area/ # exclude pages in upper menu, footer menu and user area for various languages # standard language english Disallow: /upper-menu/ Disallow: /footer-menu/ Disallow: /user-area/ Disallow: /en/ Sitemap: http://www.tssf.biz/sitemap.xml