I found documentation at Lightsail for adding a custom domain. The one step I missed was assigning the name servers of the custom domain to Lightsail and creating a DNS to point it to the WP static instance. I am waiting for propagation. Hopefully that resolve it.