Don’t reuse the same control points. Control points are specific to the exact image content and pixel locations in one set of photos, so they won’t stay valid for different frames.

What you want to reuse is the solved camera geometry: lens parameters, relative positions, and other optimized settings derived from those control points. In Hugin, this is what a project template is for. Calibrate/optimize one representative image set, then apply that project as a template to later image sets, or reuse the .pto project with the new images.

With GoPro-class fisheye lenses, distortion is extreme, so trying to transfer raw control points between frames is especially unreliable. The template/project approach keeps the fixed rig geometry while letting each new set use the established calibration.

If you process many frame sets, Hugin’s command-line tools may be more practical once you have one good calibrated .pto file.

So the workflow is: make one good calibration project, optimize it, save it, then reuse that project/template for later frames—not the original control points.