is_home not working after loop (on home.php)

is_home is working fine if I put it before a loop. I’m also using it in my footer but it is not working there. In the middle I have query_post displaying some posts from various categories.

Funny thing is my last loop displaying posts from category id 4 is causing my homepage to become a category page. I tested, is_category(4) returns trues.