This is probably your issue. I recommend downloading all your files from your InfinityFree account to your computer via FTP and then uploading them to your new hosting account manually. If the uploading still goes slow, that would be an issue with the new hosting provider (or your connection to their file servers).