ABSTRACT: –

Ending to the problems of individuals with vocal visualand hearing troubles through a solitary serving to framework may be adifficult task various researches concentrate on tending to the issues of one in all the higher than difficulties nonetheless not all thanks totechnology this paper focuses on achieving the most effective technique that helps the visually impaired by rental them listen whats represented as text furthermore as feel it in braille that is achieved using a device that may perceive the image and converts the content and gift it as sounds victimisation the speech to text conversion technique on-screen text provides a much better means for the people with hearing disorder to visually scan that is inaudio the vocally impaired individuals will move with traditional people victimisation our work that acknowledges sign languages and converts them into on-screen text furthermore as audio sounds this single distinctive system powered by which we will share our thoughts or convey the message but for an individual with incapacity deaf and dumb faces difficulty in communication with traditional person generally therell possible be a minimum of some level of social isolation for those with disabilities with deafness and muteness using a similar ways of communication because the alternative person eg linguistic communication or text-to-speech is certainly attending to be a main issue below consideration its elementary to disabled peoples lives that incapacity is recognized as an equality issue in this project we have a tendency to ar attending to propose a brand new system-prototype in an effort to form the method of interaction between the blind deaf and dumb individuals abundant easier this can build use of the moveable technology and arduino circuit boards to produce a method of communication to differently-abled individuals having one or all of the higher than mention disabilities this paper presents google speech api primarily based aid for deaf and blind individuals the live streaming speech on the mike is sent to google api server that converts the speech signal into text and displaying onto a alphanumeric display screen and amplifies the speech via speaker the help can use request procedure protocol to send the encoded mp3 audio to google api server wherever the speech signal is regenerate into appropriate text is intended to address issue with delicate hearing disorder and blind man this can change the deaf and blind persons to figure effectively reception office and any public places with ease the help works at low latency at sensible net property.

SYSTEM:-

Overview: The Flutter app for blind students is designed to help students with visual impairments to access educational content, take notes, and participate in classroom activities. The app uses text-to-speech and speech-to-text technology, as well as haptic feedback and other accessible design features, to create an inclusive learning environment.

Features:

• text-to-speech and speech-to-text: The app will allow blind students to access educational content through text-to-speech and speech-to-text technology. The app will read out loud the contents of the screen and allow the user to speak their responses to the app.
• Note Taking: The app will allow students to take notes using speech-to-text technology, and the app will convert the speech to text and store it. This will enable students to take notes during class without the need for a scribe.
• Accessible Design: The app will have an accessible design that incorporates features such as haptic feedback and audio cues to assist visually impaired students in navigating the app.
• Course Organization: The app will allow students to organize their courses and course materials in a way that makes sense to them. They can create folders, add notes and other materials to each course.

• integration with assistive technologies: The app will integrate with other assistive technologies, such as screen readers and Braille displays, to provide a comprehensive learning experience for students with visual impairments.

Workflow:

• The user will launch the app and select the course they want to access. The app will use text-to-speech technology to read out loud the contents of the screen to the user.
• The user can navigate through the app using haptic feedback and audio cues.
• When the user needs to take notes, they can use speech-to-text technology to speak their notes into the app.
• The app will convert the speech to text and store it, allowing the user to review their notes at a later time.
• The user can access course materials, such as lectures, handouts, and assignments, through the app.
• The app will integrate with other assistive technologies, such as screen readers and Braille displays, to provide a comprehensive learning experience for students with visual impairments.

Benefits:

• Accessibility: The app provides an inclusive learning environment for visually impaired students, enabling them to access educational content and participate in classroom activities.
• Convenience: The app allows students to take notes without the need for a scribe, enabling them to be more independent in their studies.
• Customization: The app allows students to organize their courses and course materials in a way that makes sense to them.
• Integration: The app integrates with other assistive technologies, providing a comprehensive learning experience for students with visual impairments.

Conclusion:

The Flutter app for blind students is an innovative and practical solution for enabling visually impaired students to access educational content and participate in classroom activities. By leveraging text-to-speech and speech-to-text technology, as well as haptic feedback and other accessible design features, the app creates an inclusive learning environment. The app is also customizable and integrates with other assistive technologies, providing a comprehensive learning experience for students with visual impairments.

PROPOSED SYSTEM:-

1. Our aim is to develop an application that will help the blind carry day-to-day duties in easier fashion.
2. The main motive of this app is to make it easier for the user to learn the objects around them using image recognition.
3. Help them navigate to the required place.
4. Read the news for them, making it easier for them to update with the day to day news.
5. Help them set the alarm and remainders.

MODULES:-

• Accessibility Module: This module will provide accessible design features such as haptic feedback, audio cues, and large font sizes. This module will enable visually impaired students to navigate the app and access educational content with ease.
• Text-to-Speech Module: This module will allow the app to read out loud the contents of the screen to the user. The module will convert the text on the screen into an audio format that can be understood by the user. Speech-to-Text Module: This module will enable the user to speak their responses into the app. The module will convert the user’s speech into text that can be stored as notes or responses to quizzes.

• note taking module: This module will allow the user to take notes using speech-to-text technology. The module will convert the user’s speech into text and store it in a designated folder.

• course organization module: This module will allow the user to organize their courses and course materials in a way that makes sense to them. They can create folders, add notes and other materials to each course.

• audio description module: This module will provide audio descriptions of images, charts, and other visual content that cannot be easily understood by visually impaired users.

• Quiz Module: This module will allow the user to take quizzes and tests. The module will read out the questions and answer choices and allow the user to respond using speech-to-text technology.
• Integration with Assistive Technologies Module: This module will integrate with other assistive technologies, such as screen readers and Braille displays, to provide a comprehensive learning experience for students with visual impairments.

• user settings module: This module will allow the user to customize the app to their preferences. For example, they can adjust the speed of the text-to-speech or the volume of the haptic feedback.

• progress tracking module: This module will track the user’s progress in each course and provide feedback on their performance.

APPLICATION:-

The app is called “Blind Learn” and it’s designed to provide a comprehensive learning experience for students with visual impairments. When the app is launched, the user is greeted with a login screen. They can enter their username and password to access the app’s main menu.

the main menu consists of several options:

• Courses: This option allows the user to browse and select courses. Each course is represented by a large button with the course name and a brief description. When the user taps on a course, they are taken to a new screen with the course materials.
• Notes: This option allows the user to access their notes. The notes are organized by course and can be edited or deleted.
• Settings: This option allows the user to customize the app to their preferences. They can adjust the speed of the text-to-speech, the volume of the haptic feedback, and other settings.
• Help: This option provides instructions on how to use the app and contact support if needed.

When the user selects a course, they are taken to a screen with the course materials. The screen consists of a series of buttons that represent each lesson in the course. When the user taps on a lesson, they are taken to a new screen with the lesson materials.

The lesson screen consists of several sections:

• Audio Description: This section provides a description of any visual content, such as images or charts, that cannot be easily understood by visually impaired users.
• Text: This section displays the lesson text in a large font that is easy to read. The text is also read out loud by the app’s text-to-speech technology. Quiz: This section allows the user to take a quiz on the lesson materials. The app reads out the questions and answer choices and the user can respond using speech-to-text technology.
• Notes: This section allows the user to take notes on the lesson materials. They can use speech-to-text technology to enter their notes and the notes are stored in the app’s notes section.

At the bottom of the lesson screen, there are several buttons:

• Previous: This button takes the user back to the previous lesson.
• Next: This button takes the user to the next lesson.

• return to courses: This button takes the user back to the courses screen. Overall, the “Blind Learn” app provides a comprehensive learning experience for students with visual impairments. The app is designed to be easy to navigate and customizable to the user’s preferences. With text-to-speech and speech-to-text technology, as well as haptic feedback and other accessible design features, the app creates an inclusive learning environment for all students.

HARDWARE AND SOFTWARE REQUIREMENTS:-

HARDWARE:-

·        Processor: Intel Core i3 or more.

·        RAM: 4GB or more.

·        Hard disk: 250 GB or more

SOFTWARE:-

• Operating System: Windows 10, 7, 8.
• python 
• anaconda
• Spyder, Jupyter notebook, Flask.
• MYSQL
• flutter
• Dart