Funded Projects

Computer Vision-Based Auditory Assistance for navigation in Indoor Semi Controlled Environments

Principal Investigator’s Organization (PIO):
University of Malakand
Principal Investigator (PI):
Dr. Sehat Ullah
Project Details:
Start Date 01-Oct-2016
Duration 30 months
Budget Rs. 7.09 million
Status On Going Project
Progress Report View Progress Report
Publications N/A
Thematic Area Health
Project Website
Executive Summary

The scope of this project is to develop a vision based software system that will enable visually impaired people to independently navigate in indoor semi-controlled environments. The user will be given audio information to provide assistance in navigation. The objective of this project is to develop a vision based software system that will enable visually impaired people to independently navigate in indoor semi-controlled environments. The system will also provide help/guidance to tourists or visitors in huge unfamiliar places such as museums and historical buildings. The guidance will not only include navigational assistance but also automatic information provision about various objects/things. The aim of these researches is to develop the new devices or technologies to assist visually impaired people. The audio information once developed, is aimed for enabling the user to: • To know about his/her current position/location in the environment • To know about his/her surrounding for example office X to his right, room Y to his left and Lab Z to his etc. • To locate his/her destination Output will include fiducial markers augmented with audio information that are placed in the environment. The user holds a mobile phone with webcam in his/her hand and navigates through the environment. The audio assistance is provided to the user whenever a particular marker is detected by the camera and thus enables him/her to independently navigate or get automatic and appropriate information about objects/things in environments.