It could be because of the WordPress cache. You an try using incognito mode to see if the favicon is removed or click on the 3 dots < More tools < Clear Browsing Data < check the Cached Images and Files section (everything else i optional) < Clear Data.