My first SLR was an OM-10. Loved it. That's good you have the manual adapter.

Looking at your photo, I think you are using a telephoto lens. There is a rule, that you can hand hold a lens at 1 over the focal length. So, if you are using a 135mm lens, you should shoot shutter speeds faster than 1/135 sec. However, this is for static situations, like photographing a landscape or a bird sitting in a tree.

Looking at the blur, I think it looks like there is a top-left-to-bottom-right blur. Especially the "Tissot" sign, but also many places. This means that you were panning the camera, following the action. Under these conditions, 1/500th of a second is apparently not enough.

Sounds like you have a digital camera too. Set it up with the same focal length, shutter speed and ISO. Take a picture with the camera on a tripod. Then take several more while you pan the camera at different rates. Compare all these. I think you will be surprised at the amount of blur.

Lastly, next time you are at a sporting event, try using a tripod, or at least some support like the back of a chair or a wall. Focus on holding the camera still. Press the shutter at the instant where the speed of action is slowest, like during a jump shot, as osullic suggested above. And also, do try some fast B&W film. It's fun! Yes, it will be grainy but it will look great.