A Virtual Private Network is a way of securely connecting a computer to a distant network, via a public network such as the internet. This may make more sense with an example: The most common use case an office worker "telecommuting" or working from home. They need to access all the computers at their work network just as if they were sitting at their desk, directly connected to their corporate network, however, they don't want these computers accessible to just anyone.
