Who can hear Stewie in Family Guy?

I just wanted peoples opinions on this. I know its only meant to Brian but some episodes its as is people are responding to what Stewie is saying, what do you think?