OK, nevermind – finally found it. From the admin tools:
Appearance –> Customize –> Widgets –> Primary Sidebar –> Click the drop down button that says “text.” Then it opened up an HTML field where all the content is.
Gotta say I don’t like this system – it makes it really difficult to find things. Missing the old days of typing up my HTML and CSS in Notepad right now.