Custom tinymce buttons and modal windows

Hi everyone,
I am rather new to the topic of adding shortcodes to wordpress but I found a good tutorial on how to add them and it works. So my question is how to implement a modal window that pops up after triggering the custom tinymce button? Like the modal window when you click at the “linking” button. Can anyone help?

Thanx in advance!