My site is accessible with www but not without www!

Although your site loads slower without the www, it does work both ways. If it works with a VPN, it may just be a manner of DNS. Try clearing your cache and checking your site after 24 hours have passes. Note that you also may be affected by the below issue.