There isn’t a single rule, but a few habits help a lot:

• Change your timing. Early morning often gives better light and far fewer people and vehicles.
• Learn the location. Visit or scout so you know when the sun best lights the building, where shadows fall, and when streets are busiest.
• Change your viewpoint. Even a modestly higher angle can reduce clutter and help separate the building from people and cars. Some photographers raise the camera above head height with a tripod.
• Don’t let distractions get cut off by the frame edge. A person or car half-entering the frame is often more distracting than one fully included.
• If you can’t exclude them, include them deliberately. Instead of “building with unwanted people,” compose “building with tourists/street life” so those elements feel intentional.
• Step back or zoom wider when needed. Giving foreground elements room can make them feel part of the scene rather than visual accidents.
• Use perspective and lens choice thoughtfully. A higher viewpoint can help keep verticals straighter; architectural photographers also often use tilt-shift lenses for control.

In short: better timing, better viewpoint, and more intentional framing usually work better than trying to eliminate every distraction.