This is intentional. The security system is designed to block crawler’s and bots, as the service is designed to run websites to be accessed by a browser not apps or APIs to be accessed by bots or other systems.
Gemini might be able to with because it uses one of the Google crawlers that isn’t blocked.
@dan3008 thank you for your reply.
is it possible to change that?
i found out that users can reach me from the chatbots now and not regular searches and the bot being able to read the website can help a lot
I don’t work for infinityfree so can’t give an absolute answer. But when people have asked admin previously the answer has always been no. Because doing so would open up the whole system to bot attacks
Infinityfree is designed for hosting websites for visitors to access with a browser.
The only solution is to buy premium hosting afaik.