No worries I was able to figure this out on my own.
So I used WP All Import, then in the import options, under Custom Fields I used “wc_pay_per_post_product_ids” as the Name and set Field Options as Serialized. Doing this shows a button called “Click to Specify” under “Value” and it opens a pop up with two text boxes, Key & Value. In the Key box you start with the number 0 and in Value you put the Product ID of the Woocommerce product you want to protect the page or post with.
You can add multiple Woocommerce Products to a post by adding more Keys & Values, just make sure you increment the keys by 1. (Example, first key is 0, second key is 1, third key is 2, etc).
Thanks for the help! Hope my solution finds others well!