Early Detection of Flying Obstacles by Optical Flow to Assist the Pilot in Avoiding Mid-Air Collisions

The seemingly endless expanse of the sky might suggest that it could support a large volume of aerial traffic with minimal risk of collisions. However, mid-air collisions do occur and are a significant concern for aviation safety. Pilots are trained in scanning the sky for other aircraft and maneuvering to avoid such accidents, which is known as the basic see-and-avoid principle. While this method has proven effective, it is not infallible because human vision has limitations, and pilot performance can be affected by fatigue or distraction. Despite progress in electronic conspicuity (EC) systems, which effectively increases visibility of aircraft to other airspace users, their utility as collision avoidance systems remains limited. This is because they are recommended but not mandatory in uncontrolled airspace, where most mid-air accidents occur, so other aircraft may not mount a compatible device or have it inactive. Besides, their use carries some risks, such as over-focusing on them. In response to these concerns, this paper presents evidence on the utility of using an optical flow-based obstacle detection system that can complement the pilot and electronic visibility in collision avoidance, but that, contrary to them, neither gets tired as the pilot nor depends on what other aircraft mount, as with EC devices. The current investigation demonstrates that the proposed optical flow-based obstacle detection system meets or exceeds the critical minimum time required for pilots to detect and react to flying obstacles using a mid-air collision simulator in various test environments.