I asked the hosting company to look at it. It appears that in the .htaccess in the public_html directory was a line:
RedirectMatch 403 (?i)/(^$|(wp-)?config|mobiquo|phpinfo|shell|sqlpatch|thumb|thumb_editor|thumbopen|timthumb|webshell)\.php
After removing this line, it worked.