enhance shortocde presentation in Visual mode

Hi,

I’m working on the WP them which will use some custom made shortcodes and I’m wondering how I can achieve same shortcode behavior as default [gallery] shortcode?

I would like to see the actual shortcode when editing in HTML mode and shortcode placeholder when editing in Visual mode.

I know how to add custom buttons to the tinymce with population form (to help user to generate the shortcode), but what should be next step?

Thank you in advance any info is much appreciated.
Michael