Keeping all the Applications Updated
Using a Tough Password
3rd Party Code and Scripts
Plugins, widgets, and every other code (such as free templates and themes) that you are installing on your VPS are normally developed by some other “unknown” person or a group. So always do a little research and become certain that they are secure prior to installing them on your server.
And of course with all the other advice already listed here in other posts!!!