Bingbot reading HTTPS robots.txt incorrectly

[Thewebuser22]

The response looks like it is related to this:

Ensuring only web browsers can access your website

InfinityFree is a website hosting service. That means that the hosting accounts we provided are intended for hosting websites. Websites contain pages that are accessed through web browsers. InfinityFree is not intended to be used for file sharing, API hosting, database hosting or background tasks/tools. To help enforce this, free hosting enforces a security system that makes sure that anyone trying to access your website is using a normal web browser. This is done by checking whether the web br…

However, I know that Bing can crawl IF websites, so I did some searching on previous forum topics and found this:

Bingbot can't crawl my website

Bing bot can crawl…but that tool from bing webmaster is not a real bing bot, but only a tool and comes from different IPs you use Cloudflare (which otherwise solves the problem), but probably the PHP files are called directly from the origin.

The other user had that problem where things were reported missing and got the same response from the request, but as Oxy stated, the Bing bot itself can crawl your webpage.