Mixed Reality-Based Simulator for Drone Pilot Training

Abstract

Background: Due to their ability to do a variety of tasks more quickly and effectively than traditional methods, drones have become more and more popular in recent years. Drones are used in many different industries, such as agriculture, surveying, photography, and search and rescue. However, piloting a drone requires specific knowledge and training due to the advanced nature of the technology. Materials and Methods: Drone pilot training can be challenging and costly because it calls for practical experience as well as knowledge of safety regulations. One possible solution to the challenges of drone pilot training is the use of simulators. Operators can refine their skills and gain experience in a safe, controlled environment without worrying about damaging their equipment or injuring others thanks to simulators. Creating an immersive drone flight training system that blends in smoothly with the actual environment and gives users a higher level of involvement without motion sickness is the current problem. Results and Discussion: For authenticity, the simulation must use physics that accurately replicate the dynamics of drone flying rather than using fictitious models. Implementing a user interface that provides precise telemetry readings is essential to achieving this goal since it gives pilots a thorough grasp of important realistic factors while in flight. In order to ensure expertise in drone operation through real-world scenarios, the system also requires an advanced training module that conveys practical skills and information. Drone pilot training is hampered by the limitations of simulators, such as their resemblance to virtual reality games rather than genuine training settings. Using programs like Unity3D and Blender, we meticulously model the virtual world to replicate the real environment in order to address these issues. Furthermore, using RPM data from the open-source flight planner ArduPilot, attempts have been made to replicate the drone's physics by adding static and dynamic propeller thrust. By allowing users to alternate between different viewpoints, such as first person, third person, and fixed views, this effort also seeks to provide users’ control. A hoop course system was used in the testing process. This required a proficient drone pilot to navigate through more demanding courses, which were made more difficult by elements like smaller hoops, more complex maneuvers, more hoops, and less lighting. Conclusion: The benchmark was the pilot's score and timing. The program was then tested by inexperienced pilots, and their times and scores were noted. The course became more challenging as they got closer to the standard.