The color of sunlight reaching the surface changes based on the thickness and quality (in terms of things like particulate matter and water vapor suspended in it) of the air it passes through. Whether the sun is at an angle 30º above the horizon because it is noon in winter at a high latitude or because it is 4 p.m. in the tropics doesn't make much difference if both locations are at the same altitude. When the sun is at a low angle in the sky, such as when setting or rising, the rays must travel through much more atmosphere than when at higher angles in the sky. The condition of the air those rays are passing through can have a dramatic effect on the quality of light that reaches the surface.

The seasons affect the light for a particular location because the amount of moisture and particulates in the air will vary from season to season in many locations. If a place is outside the tropics then the maximum angle of the sun in the sky is lower in the winter than in the summer. This difference increases dramatically as you approach the arctic circles.

In places that have snow covering the ground in the cooler months, the light reflected from the snow will look much different than the same light reflected off of lush green meadows which will look different than the same light reflected off of urban concrete, a sandy beach, or a dusty desert - even when the sun is at the same angle in the sky.

Which of the above factors is most influential varies with the situation as well. In the middle of the Sahara desert, the atmospheric conditions do not vary that much, so the angle of the sun is normally the largest variable - at least until a dust storm develops. In the Pacific Northwest of the United States, cloud cover is highly variable and can potentially be a greater influence than the angle of the sun. There's not much difference between overcast at noon and overcast two hours before sunset. Above the timber line on an exposed Rocky Mountain peak the light will be much different than descending just a few hundred feet into a lush forest of green.

You can always correct for the differences in the temperature and amount of light using colorimetric tools and varying the exposure value. But why would you want to make every place you go look exactly the same?

Does Earth's latitude affect the color of light?

Only indirectly, as the latitude determines the sun's angle in the sky for a given time on a given day, and also influences weather related environmental factors such as atmospheric contents and ground cover.