Hi @xue28,
I figured out that the sidebar can only be edited if you install the ‘Classic Widgets’ plugin, or by converting the theme to Full Site Editing.
I have gone with the latter, so I can assemble it with blocks now.
However, one question I have is, how do I override the woocommerce template files from within my theme?
I see the files are located here in the woo plugin: \packages\woocommerce-blocks\templates\templates\
Where do I put these in my theme so they will override those defaults?