A virtual private server is created through process of virtualization, by which a virtual replica of a physical server is created. A VPS is like your own server with allocated resources and pre-installed operating system.
If your site is going to enjoy high traffic, a VPS is a safer option than shared hosting options. VPS is also a great option if you have a number of websites to host and want to tweak their setup behind the scenes.
You can connect to your VPS through SSH and PuTTY or Remote Desktop. You can also access your server from front end control panel like plesk or cpanel if any.