The file manager and FTP server do not support creating or deleting files and directories with invalid characters. Only PHP code can do that.
You can find a few topics with examples of scripts you can use, like this one: Cannot delete folder
Also, make sure to removed the bootstrap/cache folder from your website. Caching the configuration on your own computer and uploading that here causes this issue.