Scallas,
Were you ever able to come up with a solution to this issue? I tried it with and without adjusting the $to_address variable without success. This fork on github claims to have solved the problem but I’m still getting the billing address on the label instead of the ship to address.
This has been a real headache.