It's generally a latency issue. Things don't load in fast enough.

Though, I've run into a mission or two that have genuine holes in their walls.