## Website Sitemap Sitemap: https://www.madura.fr/sitemaps/fr_fr/sitemap.xml Sitemap: https://www.madura.fr/sitemaps/uk_en/sitemap.xml Sitemap: https://www.madurahome.com/sitemaps/us_en/sitemap.xml ## Crawlers Setup User-agent: * # Crawl-delay: 30 ## Do not crawl common Magento folders Disallow: /app/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ Disallow: /lib/ Disallow: /pkginfo/ Disallow: /shell/ Disallow: /var/ ## Do not crawl common Magento files Disallow: /api.php Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /get.php Disallow: /install.php Disallow: /php.ini.sample Disallow: /index.php.sample Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_EE.html Disallow: /LICENSE_EE.txt Disallow: /LICENSE_AFL.txt Disallow: /README.txt Disallow: /RELEASE_NOTES.txt ## Do not crawl pages that are sorted/filtered or paginated with extra params Disallow: /*?dir= Disallow: /*?limit= Disallow: /*?mode= ## Do not crawl homepage copies Disallow: /home ## Uncomment the below only if SEO Url rewrites are activated # Disallow: /index.php/ ## Do not crawl links with session IDs and not clean Urls Disallow: /*?SID= Disallow: /*.php$ ## Do not crawl checkout and customer account pages Disallow: /checkout/ Disallow: /checkout/cart/ Disallow: /checkout/cart/add/ Disallow: /onestepcheckout/ ## Do not crawl seach pages and not-SEO optimized catalog links Disallow: /*catalogsearch/ Disallow: /*catalogsearch/advanced/ Disallow: /*catalogsearch/advanced/result/ Disallow: /*catalogsearch/result/ Disallow: /*catalogsearch/term/ Disallow: /*catalogsearch/term/popular/ Disallow: /*catalog/product_compare/ Disallow: /*catalog/category/view/ Disallow: /*catalog/product/view/ Disallow: /*add/ ## Do not crawl not-SEO optimized other links Disallow: /customize/ Disallow: /newsletter/ Disallow: /poll/ Disallow: /review/ Disallow: /sendfriend/ Disallow: /tag/ Disallow: /wishlist/