IMU-based image stabilization in a HSM-driven camera positioning unit

Camera positioning units are widely used in surveillance and they are sometimes mounted on floating supports, e.g. on patrolling ships or buoys. The support motion, in turn, induces an apparent motion in the image plane, which can create troubles to the image processing, especially when a specific feature must be tracked (e.g. a distant ship, getting close to a forbidden area). Low cost devices are often characterized by low frame rate and low image resolution, for which traditional image stabilization techniques usually results to be rather ineffective. Additionally, low-end camera units are usually driven by hybrid stepper motors and, being conceived to work in an harsh environment, they do not mount any optical image stabilization (OIS) system, either in the camera lenses or in the image sensor. In this paper, the image acquired by a pan–tilt camera positing unit mounted on a moving support is stabilized by exploiting the camera attitude information provided by a MEMS-based IMU with an embedded magnetometer. In particular, two independent integral control loops are designed for the pan and tilt motors in order to compensate for the yaw and pitch motions of the support. As for the roll motion, since it relates to an unavailable degree of freedom in the positioning unit, it can be compensated only on the captured image. The proposed solution is experimentally tested on a real device mounted on a moving table actuated by a 6 degrees–of–freedom pneumatic hexapod. Realistic motions are recreated by using the data recordings taken aboard of a patrolling ship and a costal buoy. Experimental results show that the proposed solution is capable of keeping the camera pointing at a fixed target with a good accuracy, thus making higher-level image processing easier and more effective.