Shop Laptops, Desktops, Gaming PCs & Accessories in Lebanon | Best Prices, Fast Delivery, Amazing Deals. تسوق الآن بأفضل العروض
i installed prestablog in my shop, and their Master sitemap url is domain.com/modules/prestablog/sitemap/1/master.xml
while in my robots.txt i already have Disallow: /modules/ , adding my master blog sitemap returns with couldnt fetch, and also inspecting the url returns by blocked by robots.txt
i tried adding Allow: /modules/prestablog/sitemap/ in my robots.txt before disallow: /modules/ and after it. and still no luck.
any help would be appreciated
Admin
May 18, 2025, 10:25am
2
Who or what says it can’t fetch?
Please note that most automated access to websites hosted with us is blocked:
InfinityFree is a website hosting service. That means that the hosting accounts we provided are intended for hosting websites. Websites contain pages that are accessed through web browsers. InfinityFree is not intended to be used for file sharing, API hosting, database hosting or background tasks/tools.
To help enforce this, free hosting enforces a security system that makes sure that anyone trying to access your website is using a normal web browser. This is done by checking whether the web br…
Search engine crawlers are excluded from this, but SEO checkers are not.
3 Likes