Yes. In this context, “infinite depth of field” means that, ideally, objects at all distances are rendered in focus at the same time. Unlike a lens, a pinhole does not focus by bringing one particular distance into sharp focus and letting others blur more as they move away from that plane. Instead, the tiny aperture limits the spread of light rays enough that there is no single narrow focus range in the usual lens-based sense.

So your interpretation is essentially correct: an ideal pinhole camera is said to have everything in focus, from near to far.