AI Powered Glasses for Visually Impaired Person

International Journal of Telecommunications, 2024

Nowadays, Smart Glass emerges as a potential aid for individuals with visual impairments, offering the promise of enhanced quality of life. Designed for those seeking independent navigation with a sense of social ease and security, the concept revolves around the idea that visually impaired individuals prefer inconspicuous assistance tools. This paper delves into the significant advancements within wearable electronics, spotlighting additional features. This innovative glass offers a multifaceted solution for individuals with visual impairments, providing assistance in diverse scenarios. Beyond aiding in the reading of scripts, they excel at distinguishing between currencies, enabling users to navigate financial transactions with ease. The glasses also enhance color recognition, allowing wearers to perceive and appreciate the vibrant spectrum of the world around them. Additionally, the incorporation of obstacle detection technology ensures a heightened sense of safety by alerting users when they are in proximity to potential hazards. Furthermore, the glasses feature advanced facial recognition capabilities, contributing to a more inclusive and socially connected experience by detecting faces and fostering seamless interactions.

Smart glasses are designed for all kinds of applications and can be employed in industrial applications, medical and healthcare, consumer, logistics, security, and government, etc. In practice, blind people identify objects or find out walk able paths using a white cane. In spite of a variety of such canes (long cane, guide cane, support cane) available, it doesn't recognize what the actual object is. The guiding sticks give an idea about the objects that lie only in a limited area. Having a camera vision with the support of audio messages for the visually impaired ones gives them a better and more precise sense of their surroundings, especially in an outdoor environment. However, because of the high cost of such devices, the dependency of blind people on common people is consistent. This paper provides a new design of Smart glasses, that the user can wear as normal glasses. These devices are optical head-mounted devices that integrate camera and allow hands-free operations. The fundamental objective of smart glasses for people with normal vision is to blend human vision with the virtual world, producing a kind of ubiquitous computing. But, using this design, the camera placed on the device obtains the video equivalent to the point of view which will be processed for assisting the visually impaired user. There is no need for the user to hold the device in his hands or move it in the necessary position and the vision of the user is not occluded. It will provide a field of view up to 120 degrees.

TELKOMNIKA Telecommunication Computing Electronics and Control, 2022

Visually impaired people are facing many problems in their life. One of these problems is how they can find the objects in their indoor environment. This research was presented to assists visually impaired people in finding the objects in office. Object detection is a method used to detect the objects in images and videos. Many algorithms used for object detection such as convolutional neural network (CNN) and you only look once (YOLO). The proposed method was YOLO which outperforms the other algorithms such as CNN. In CNN the algorithm splits the image into regions. These regions sequentially enters the neural network for object detection and recognition so CNN does not deal with all the regions at the same time but YOLO looks the entire image then it produces the bounding boxes with convolutional network and the probabilities of these boxes, this makes YOLO faster than other algorithms. Open source computer vision (OpenCV) used to capture frames by using camera. Then YOLO used to detect and recognize the objects in each frame. Finally, the sound in Arabic language was generated to tell the visually impaired people about the objects. The proposed system can detect 6 objects and achieve an accuracy of 99%.

Blind people cannot do things like navigate on their own, recognize objects, or avoid obstacles because they cannot see where they are going or what is around them. In the future, there will be an article about a new visual aid for people who are completely deaf or blind. As a result, the Raspberry Pi 3 Model B+ was chosen because it is cheap, small, and easy to work with other systems. This model was made to show how the prototype would work and how it would look. The system's obstacle avoidance configuration includes a camera and other sensors and object detection and tracking algorithms to help it avoid things. People can use ultrasonic technology and a camera to figure out how far away they are from a specific object or person, so they can figure out how far away they are. As an extra layer of protection, the GPS system tracks people's movements who cannot see. The products will be lightweight and easy to move, making them easy to move. Regular eyeglasses can be used as a base for these glasses so that you do not have to spend extra money or make things more complicated. Using this idea to make eyeglasses would be easy, and it would not make them more expensive or more complicated. The price or complexity of eyeglasses would not change if we made one of these products, so it would be easy to put one in.

International Journal of Electrical and Computer Engineering (IJECE), 2022

The objective of this paper is to develop an innovative microprocessor-based sensible glass for those who are square measure visually impaired. Among all existing devices in the market, one can help blind people by giving a buzzer sound when detecting an object. There are no devices that can provide object, hole, and barrier information associated with distance, family member, and safety information in a single device. Our proposed guiding glass provides all that necessary information to the blind person's ears as audio instructions. The proposed system relies on Raspberry pi three model B, Pi camera, and NEO-6M global positioning system (GPS) module. We use TensorFlow and faster region-based convolutional neural network (R-CNN) approach for detection of objects and recognition of family members of the blind man. This system provides voice information through headphones to the ears of the blind person, and facile the blind individual to gain independence and freedom within the indoor and outdoor atmosphere.

International Journal of Engineering Applied Sciences and Technology

In this paper, we are presenting an electronic device for obstacle detection and face recognition to assist visually challenged users in social interactions. Blind people have low vision to recognize people in the society and this device helps the user to walk without colliding with any obstacles in the path. The device is in the form of smart glasses that has ultrasonic sensor, pi camera and raspberry pi installed on it. The ultrasonic sensors are connected to the raspberry pi that receives data signals from the sensors for further data processing and detects the obstacles around the user up to 1000cm.A pi camera is used to recognize the person in front of the visually challenged according to the database list .If the person is unknown , then it asks you to store in our data base or not then if we press the pushbutton then it starts taking the picture of person by using front_facial.xml file so that it can takes the perfect face images using open cv xml file and through python code. After taking the images it asks you to give the name of the person then mike get activated and then by using google speech to text module it converts the voice input to text and it is saved in a file with person name and id. This device supports to recognize people easily. It is of low cost and low power consumption device.

The Indonesian Journal of Electrical Engineering and Computer Science (IJEECS), 2023

The "Smart Glasses" are made to make it easier for blind persons to read and decipher written English-language content. A blind people find it exceedingly challenging to travel alone, and they run the danger of getting lost and regular sticks won't allow the person to go around independently in public without things growing worse. The objective of our work is to help blind people communicate more easily by developing a smart assistive glasses using artificial intelligence. The function of the glasses is to read out any text picture as audio text, which can then be heard through a headset attached to the spectacles. OpenCV, optical character recognition and efficient and accurate scene text (EAST) detector were used to identify the text in the image; ultrasonic sensor in the glasses is used to calculate the distance to snap a clear picture. The motion sensor directs the blind to the lecture halls, classrooms, and laboratory locations using an radio frequency identification reader. The results shows that combination of optical character recognizer and EAST detector produced a fairly accurate result, demonstrating the potential of the glasses to recognize the text. Currently, the language supported by the glasses is English, and the distance covered is 40 to 150 cm.

Journal of emerging technologies and innovative research, 2021

Human beings are blessed with five senses to experience the world, vision, auditory, olfactory, gustatory, and touch. These senses rendered humanity unpredictable. Of the five, sight is considered the most important. Not all of us have the blessing of vision. So, the aim was to develop goggles for these peoples. We have used machine learning and deep learning for the analysis and interpretation of texts and environments. Using real time object detection and text reading, the visually impaired person can get information about the surroundings. The world of science is growing minute by minute and, it is our responsibility to extend the benefits of science for the advancement of humanity, especially for those who need special care and support. While many inventions exist in this field, many are practically ineffective. So, it is high time to give more light to this area.

SSRG international journal of electrical and electronics engineering, 2023

The paper presents a low-cost intelligent smart glasses system that uses a Raspberry Pi 4 board, a camera module, and an ultrasonic sensor to capture images and audio from the environment and process them using computer vision and natural language processing techniques. A working prototype of intelligent eyewear will enable people with vision impairments to recognize others in their sight and learn about potential dangers. This will be made possible by face recognition technology and distance detection capabilities. A built-in sensor that emits ultrasonic waves in the direction the user is moving while scanning a maximum of 5 to 6 meters away at an angle of 30 degrees. This new system could resolve some of the most significant issues that blind people still face. Finally, a message is sent to blind people, informing them of the person in front of them using the sounds associated with each individual in the database. The proposed system consists of a depth camera to gather depth data from the environment, an ultrasonic rangefinder made up of an ultrasonic sensor, and an embedded CPU board serving as the central processing module. The embedded CPU handles tasks like depth image processing, data fusion, AR rendering, and guiding sound synthesis. AR glasses are used to show the visual enhancement information, and an earphone is used to play the guiding sound. This proposed system is designed to assist people with visual impairments by enabling them to recognize people in front of them and detect obstacles. The technology utilized in this system includes facial recognition and distance detection capabilities, which are made possible by using Raspberry Pi and Pi cameras. The system also incorporates an ultrasonic sensor and a Raspberry Pi powered by a 5V power supply to detect and avoid obstacles.

International Journal of Advanced Trends in Computer Science and Engineering , 2024

The IoT-based Smart Shoe System revolutionizes independent navigation for the visually impaired through embedded ultrasonic sensors, an Arduino Nano board, and buzzer modules, enabling autonomous road traversal by detecting and alerting users to obstacles. In parallel, Smart Glasses explore the fusion of object detection and face recognition technologies to aid the visually impaired. Its object detection application assists in identifying obstacles, ensuring safer navigation, while the face recognition system, complemented by auditory output, facilitates the recognition of objects and individuals.