Utilizing the Google Project Tango Tablet Development Kit and the Unity Engine for Image and Infrared Data-Based Obstacle Detection for the Visually Impaired

摘要

A novel image and infrared data-based application to assist visually impaired (VI) users in detecting and avoiding obstacles in their path while independently navigating indoors is proposed. The application will be developed for the recently introduced Google Project Tango Tablet Development Kit equipped with a powerful graphics processor and several sensors which allow it to track its motion and orientation in 3D space in real-time. It will exploit the inbuilt functionalities of the Unity engine in the Tango SDK to create a 3D reconstruction of the surrounding environment and to detect obstacles. The user will be provided with audio feedback consisting of obstacle warnings and navigation instructions for avoiding the detected obstacles. Our motivation is to increase the autonomy of VI users by providing them with a real-time mobile stand-alone application on a cutting-edge device, utilizing its inbuilt functions, which allows them to micro-navigate independently in possibly unfamiliar indoor surroundings.