In this post, I mentioned that I was using Wordpress Database Backup to backup the databases from my WordPress installations. I was using this too email myself the dumps of the databases.
I have switched to using the Automatic WordPress Backup. This plugin will backup the themes, plugins, configuration files, uploaded files, and the dump of the database, to an Amazon S3 bucket. You can configure the plugin to keep a number days or weeks of backups.