Can this be done?

Ok, so is there any way to put wordpress on my site but with my own layout? Or do I have to choose one of their templates? Because I already have a design that I just want to kind of plug a blog into. If that makes any sense. I’m new to this, so I might be missing something.