The problem is probably multifaceted.

You mentioned that the image was more grainy at the limit of the optical zoom. The LX5 has a variable aperture, from f/2.0 down to f/3.3, which would mean you either need a slower shutter speed or a higher ISO to compensate. If you use a lower shutter speed, its more likely that you'll introduce camera shake, and if you use a higher ISO you'll introduce more noise. If you shoot at a lower ISO and force a longer shutter, you could get camera shake, and also need to increase the brightness in post, which would again increase noise (probably making it worse than if you just used a higher ISO to start with.)

Finally, while the lens on that camera is good, all zooms have to make compromises. Its entirely possible that its a little soft at the extremes (or one or the other extreme), as its impossible to make a zoom lens cost effective and also maintain prime-level IQ.

I can't say specifically if you actually have any issue, or what it may be, without seeing some sample shots. If you added 100% crops as well as scaled down full photos, it would help us determine if what you are seeing is simply the result of pixel-peeping, and therefor something you could ignore...or a true problem.

EDIT:

Based on the sample images that were added, I can't say I see any serious quality issues. For one, there are some compression artifacts, and thats just something you can't get away from with JPEG. Second, the lower detail in the distance is a combination of atmospheric haze eating away detail before it even gets to the camera, and the simple fact that its off in the distance...only so much the lens in the LX5 can do to resolve detail that far away. The foreground detail looks pretty good, so I wouldn't worry about anything.