For very distant subjects, a chart near the camera usually won’t give truly accurate color for the subject itself, because the atmosphere between camera and subject changes the light reaching the camera. So unless you have a reliable model of atmospheric attenuation, precise calibration of a mile-away target is generally not practical.

In most real-world landscape or cityscape photography, this usually isn’t a problem. A ColorChecker is most useful in controlled lighting, such as studio work. Outdoors at long distance, the scene’s color cast is often part of the image: you usually don’t want to neutralize sunset light, haze, or other ambient color.

Practical approach:

• Shoot RAW.
• Use a reasonable white balance preset (sunny, cloudy, etc.) or adjust later.
• If needed, use something in the scene that appears neutral as a reference.

If your goal is scientific or measurement-grade color accuracy, then yes, it matters—but a nearby chart alone is not enough. If your goal is artistic or general photographic accuracy, simple white-balance control is usually sufficient.