To clear things up, the image that I’m using for mobile devices was added via the responsive.css document.
Another work around would be to add the logo via theme options, but not show it on large displays (computer screens) only have it shown on mobile devices.