No, silly. But also you have to remember, guests don't know the layout of your home. Your bedroom door could be a closet or a bathroom if the door is closed.
It all goes back to what the host has made the guest aware of: restricted areas, rules, whatever. If that's not done, why would anyone expect guests you've invited into your home not to walk around inside the home?