Yes—this mostly comes down to practice and camera ergonomics.

The main goal is to make common adjustments automatic so you’re thinking about the result you want, not how to operate the camera. A few practical ideas:

• Keep your eye in the viewfinder whenever possible.
• Learn the position of key buttons and dials by touch so you don’t need to look at them.
• Use the viewfinder display to confirm settings instead of checking the rear screen.
• Cameras with more dedicated external controls make this much easier than menu-driven bodies.

For fast-moving situations, simplify your decisions. If getting the shot matters more than perfect manual control, use Program mode. If one setting is critical, use Av/A mode for aperture control or Tv/T mode for shutter control. That can be faster and more reliable than trying to adjust everything manually under pressure.

So the short answer is: your process feels slow because these controls are not yet second nature. That’s normal. With repetition—and with a body that has better direct controls—you’ll get much faster.