Yes, the server location is important; however, other elements such as the data center's quality, the technical features of the chosen web hosting, the plugins you use on your website, and so on all have a role in the website's loading speed, which has an impact on your SEO.