PRE2019 3 Group4

Group 4

Group member	Student number	E-mail	Study
Tom Janssen	1233021	t.j.a.janssen@student.tue.nl	Chemical Engineering and Chemistry
Ivo Kersten	1233717	i.p.c.kersten@student.tue.nl	Electrical Engineering
Sander van Bommel
Tim Driessen	1006903	t.driessen@student.tue.nl	Software Science
Rob Vissers	1244863	r.t.w.a.vissers@student.tue.nl	Electrical Engineering

Introduction

In Europe only, there are already an estimated 30 million people that are either blind or visually impaired. Furthermore it is found that on average 1 in 30 Europeans experience sight loss. This imposes a huge challenge on the society in general, since these people cannot function as properly as intended in the complex society of today. Of all the blind or visually impaired people, 75% is rendered unemployed, while these people could possibly participate in certain jobs if they would receive the necessary education. Now a huge issue arises, since there is a lack of proper Braille reading and study material available, which is holding the blind and visually impaired people back.

Also loss of sight can be linked to people getting older, whereas the retinitis pigmentosa deteriorates with increasing age. By looking at the European statistics, one in three seniors with an age over 65 years old struggles with visual impairment or even blindness. Due to these large numbers, it can be seen that the problem of visual impairment and blindness has to be tackled, such that these people can stay active in the society.

Objectives

The main objective of this project is to:

• Realize a written text-to-Braille converter, which can drastically broaden the amount of written knowledge available to visually impaired people.

From this main objective, a number of sub-objectives follow that need to be accomplished, namely being:

• Find out more details about the problems visually impaired people face in daily life;
• Recognize and digitalize written words in synchronous order;
• Transform a single digitized word into a physical braille display;
• Give the user the option to scroll through the words of a sentence, changing the braille display on command;
• Make the system easy to use, so that a blind person should be able to almost completely independently set up the system and use it.

Users

When designing a product, it is important to keep the users (actively or passively) involved in the design process as soon as possible. Therefore it is important to take into account the values and needs of all involved users. With proper participation and empirical research, the design process can be centered around the user for the best final result. The users involved within the subject of text-to-Braille conversion can be categorized in primary and secondary users as described below.

Primary Users

The primary users are the people that will actively use the product, namely being the visually impaired and blind people that have a major disadvantage in learning study material, reading books, or using smartphones. This is caused due to the lack of Braille material that is generally available for consumers and organizations. Since these visually impaired and blind people cannot get the necessary education they need from reading literature or browsing the internet, they will get a learning disadvantage and cannot function to their full extent. This is holding these people back in striving for their life goals and they will not be able to develop their cognitive skills as intended. Next to that, blind and visually impaired people strive for a certain amount of independence, which is lost due to their disability. By introducing the text-to-Braille converter, they can actively read lots of material without constantly being dependent on other people.

Secondary Users

Regarding the secondary users, there are multiple organizations that would want to use the text-to-Braille converter.

• At first, educational institutes, such as kindergartens, schools, and universities, would want to use the text-to-Braille converter to make learning for blind and visually impaired people more attractive at their institution. By showing that their needs are taken into account, the blind or visually impaired people will be triggered more to go to a certain institution that respects their disabilities. This will generally lead to an increased number of students at certain institutions.

• Secondly, libraries would want to adapt to the needs of blind or visually impaired people. In general, libraries strive for proper literary development for all people. By investing in a text-to-Braille converter, it is possible to make written literature available to a much broader public, increasing overall education and happiness.

• Finally, book stores could implement a text-to-Braille converter to increase overall sales numbers under the blind and visually impaired. With a text-to-Braille converter on-site, blind and visually impaired people are able to read for example the sides, cover, back cover, or summary of a book, due to which they are able to choose between a huge variety of available books.

Requirements

Now that the users and their needs for the text-to-braille system are described, we can move on to describing the impact these needs have on the system and what the system must be capable of to meet these needs.

Basic needs

The described user needs are of course under the assumption that a working text-to-braille system is present. In order to achieve this working system certain basic requirements must be met, assuring that the system is actually able to help the intended group of primary users. The basic requirements are that the text-to-braille system must:

• Recognize written text by means of computer vision, with a probability of error that is less than one percent.

• Have a physical component capable of displaying at least 20 braille symbols.

• Let the physical braille display be reset and rewritten in less than one second.

• Be affordable to as many people as possible.

Additional needs

Furthermore, the users described above have additional needs and requirements for the system. First of all, the visually impaired people who will use the system to be able to read a printed document will want to be able to control the speed the processed text is displayed on the braille display. Furthermore it should not be too much work to use the system for a visually impaired person. So additional requirements are that:

• There is a way to indicate to the system that the next set of braille symbols can be displayed.
• The system is easy to set up and use by a visually impaired person.

Approach, Milestones & Deliverables

Approach

The different aspects of the approach can be subdivided into milestones. Consequently, these can be distributed over a planning that fits the time span of this project.

In order to obtain the optimal and most adequate results on the topic, several different methods can be used to obtain information:

• Literature research into the different aspects related to this topic:

  - Current state-of-the-art devices for this purpose
  - Scanning technology for written/typed text
  - Conversion technology of scanned text to braille
  - Dynamic braille surfaces
  - Design considerations for optimal user experience and versatility for different formats of clustered text

• Collaboration with visually impaired people to incorporate the advice of the primary users.
• Development of a small prototype and applying a series of tests to check whether the device meets the previously set requirements.
• Comparative tests with current state-of-the-art devices to discover points of improvement, as well as points of superiority of our product.

Planning & Milestones

Below the global planning of this project is displayed. The milestones are coloured red.

Week	Tasks & Milestones
1	Choose the subject Write the start of the sections for the problem statement, objectives, users, requirements, approach, planning & milestones, deliverables, logbook Investigate and describe current state-of-the-art techniques and devices on this topic
2	Report: Continue writing on the different sections of the report Write the start of the sections for current state-of-the-art and our own research Prototype:
3	Report: Continue writing on the different sections of the report Prototype:
4	Report: Continue writing on the different sections of the report Prototype:
5	Report: Continue writing on the different sections of the report Set up a list of questions and test for the collaboration with visually impaired people in week 6 Prototype: Finish a preliminary working prototype
6	Report: Continue writing on the different sections of the report Write the start of the sections for the discussion and conclusion Prototype: Schedule tests & information sessions with visually impaired people
7	Report: Continue writing on the different sections of the report Incorporate the results from the questionaires of week 6 into the report Prototype:' Incorporate the results from the tests of week 6 into the prototype
8	Finish the report on wiki Make and practice the final presentation Finalize the prototype Peer review

Deliverables

• A small prototype of a device that scans and converts written/typed text into braille (if this is feasible).
• A report of all our literature research, analysis and results on this topic. This will be documented on this wiki page.
• A presentation at the end of this course to share our findings.

State of the art

Summary: In this paper a low-cost, low-power portable system is described that serves as a braille reading and writing system. It can use a braille keyboard to display the written text in braille, such that visually impaired people can practice their braille reading and writing skill. It also has the capability of converting a text document to braille.

Summary: The outcomes of a national survey in Greece are presented in this article. In the survey the preferences and choices of students with vision impairments on literacy medium for studying are examined. The study shows that braille and large print are the preferred mediums for studying. However, the majority uses the medium of listening as the best performance medium for studying.

Summary: This paper describes a system that aims to help the visually impaired by recognizing written text around them and converting it to spoken text, which is played to the user. This system responds to all written text around the user and also notifies the user of the distance to the nearest object. It achieves an accuracy of 84%.

Summary: This paper describes a way to create braille dots that can be used on a braille display by using an electrothermal design where the dots can be displaced out of the plane by 250 microns and a temperature difference of 58°C with the environment can be achieved. This way, the dots can be small and cheap, requiring only an input voltage of 1.36 V.

Summary: Electronically refreshable braille displays have been around for some time, but they have been very expensive. This paper presents a low cost refreshable braille display that uses very little power. It also describes open source text to braille scanner using Google’s open source optical character recognition (OCR) engine.

Summary: In general with the production of text entries or smartphones little attention is paid to people with no or impaired vision. Finding the keys for voice control is also an issue for blind people. The newly introduced BrailleEnter will support non-visual interaction with a touchscreen device, since users can tap the screen to raise Braille dots based on Braille coding. When the screen is gently touched, the Braille dots will not rise.

Summary: From the visually impaired or blind people, being namely 161 million people, only 3% are able to read, write, or count. This is due to the fact that there is lack of Braille reading material in schools. A solution is proposed, where 3D printed visual representations of books are manufactured to improve the learning potential of the target users.

Summary: Visually impaired individuals are limited in terms of communication, interaction, and personal autonomy due to the lack of Braille literature linked to economic reasons. A portable device is introduced as a reading system for visually impaired individuals, which is based on segmentation, feature extraction, and machine learning for improved accuracy.

Summary: With the introduction of touchscreens, the accessibility for blind people decreased significantly. Due to the high demands for mobile phones, it is important to also take into account the accessibility for blind people. Research is done to obtain a new way of implementing Braille text in smartphones. From the data of 5 databases, the research is performed.

Summary: A novel approach to converting Chinese text to Chinese Braille is proposed. A Braille word segmentation model, based on statistical machine leaning, is trained on a Braille corpus, and also on Chinese word segmentation. This will avoid the establishment of syntactic and semantic information rules. Furthermore a statistical model will learn these rules automatically in the background.

Summary: Design, Prototype and implementation of a Sign Language (ASL) to Braille Converter as well as an English Language to Braille Converter. The article proposes a simple and affordable device which was experimentally verified to give accurate outputs.

Summary: A comparison between visually impaired (visually impaired print reader: PR, braille reader: BR) and normally sighted (normal vision: NV) school children was performed based on reading rate and comprehension. BR had the lowest reading rate compared to other groups. The findings suggest that visually impaired students required a longer time to read and understand a text.

Summary: Although several text to braille converters are available, the cost is a factor which prevents this technology to reach all people of society. Therefore a low cost gesture controlled text to braille converter was developed.

Summary: A system for converting written text into braille was developed. It uses optical character recognition to translate written text into digitized texts, which are then transferred electronically in a braille haptic device. The overall system reliability is 95.68% and the system can process 1 word in 2 seconds.

Summary: To aid the blind and visually impaired (BVI), a portable text reading system, called Finger-eye was developed. This system uses a small camera placed on the blind person’s finger to continuously process images using the optical character recognition (OCR) method, which are then translated into a refreshable mechanical braille display.

Logbook

Week 1

Name	Student number	Time spent	Break-down
Rob Vissers	1244863	10 hours	Group discussion (1.5 hours), finding proper state-of-the-art literature [8]-[12] (2 hours), reading and summarizing the state-of-the-art literature [8]-[12] (4 hours), writing the introduction and users section with relevant literature (2.5 hours).
Ivo Kersten	1233717	9.5 hours	Group discussion (1.5 hours), formatted the wiki page (1.5 hours), found papers [3]-[7] (2 hours), read and summarized papers [1]-[5] (3 hours), wrote requirements (1.5 hours)
Tim Driessen	1006903	5 hours	Group discussion (1.5 hours), found papers [13]-[17] (2 hours), summarized papers [13]-[17] (0.75 hours), finding objectives (0.75 hours)
Tom Janssen	1233021		Group discussion (1.5 hours),