Issue with robots.txt file serving JavaScript instead of plain text

[Faimus]

Hello,

I have noticed that the robots.txt file on my website (https://casicensurado.site/robots.txt) is not being served correctly. When I try to access it through the browser or via tools like curl, the file appears to contain JavaScript injection and is being served with the content type text/html instead of text/plain.

This issue is preventing Googlebot from reading the file correctly, which could negatively affect my site’s indexing in Google search results.

I have already tried several adjustments, including configuring the .htaccess file to force the content type to text/plain, but the issue persists.

Could you please look into this and ensure that my robots.txt file is served correctly as plain text (text/plain) without the JavaScript injection (such as the aes.js script)?

Thank you in advance for your help.

Best regards,

[wasik405]

Hi, Access to your website outside a browser is restricted with a JavaScript security system, which will affect tools like CURL:

Ensuring only web browsers can access your website

InfinityFree is a website hosting service. That means that the hosting accounts we provided are intended for hosting websites. Websites contain pages that are accessed through web browsers. InfinityFree is not intended to be used for file sharing, API hosting, database hosting or background tasks/tools. To help enforce this, free hosting enforces a security system that makes sure that anyone trying to access your website is using a normal web browser. This is done by checking whether the web br…

However, most search engine crawlers, like GoogleBot, can still properly crawl and index your website. They won’t be affected by this restriction.

[dan3008]

I’m getting the following

which seems to be plain text.

[Greenreader9]

Google’s crawler is whitelisted from the system, so it will not receive the JS code that is otherwise delivered.