In case someone else has this problem here is the solution I found with the help of “silva” on the wordpress irc channel:
Check you wp_config.php file. Open it with text editor. Down a way (about 61 lines) you will see:
define(‘DB_CHARSET’, ‘utf8’);
change it to:
define(‘DB_CHARSET’, ‘latin’);
upload and see if that works for you.