Googlebot getting 5xx server error - please whitelist

[mechanicalghosh]

Hello,

My website: mechanicalghosh.rf.gd

Issue: Google Search Console shows “Server error (5xx)” when trying to fetch my sitemap and index my pages. Bing Webmaster Tools works fine with no errors.

Error details:

• URL Inspection shows: “Page cannot be indexed: Server error (5xx)”
• Sitemap status: “Couldn’t fetch”
• Live test shows: “General HTTP error”

My site was recently flagged by Google Safe Browsing but has been cleared. I believe Googlebot may be blocked by the server.

Can you please check if Googlebot is being blocked and whitelist it?

Thank you.

[dan3008]

@mechanicalghosh

Can you please check if Googlebot is being blocked and whitelist it?

I don’t believe googlebot is blocked. But if it is, Admin can’t just whitelist bots for the asking.

[Greenreader9]

If Google was being blocked it would return a different error code. 500 means your code is crashing.

Http error 500

When trying to access your website, you may see a page which returns the status code “500”. In Google Chrome, you’ll see a page with the error code HTTP ERROR 500. There are typically two reasons which can cause this error: The PHP code has crashed. The .htaccess file contains invalid rules. Here are some things you can try to debug and fix this. Fixing crashing PHP code A HTTP ERROR 500 simply tells you that the PHP code has crashed, but gives no information as to why it has crashed. Gett…