PRE2018 4 Group5
<link rel=http://cstwiki.wtb.tue.nl/index.php?title=PRE2018_4_Group5&action=edit"stylesheet" type="text/css" href="theme.css"> <link href='https://fonts.googleapis.com/css?family=Roboto' rel='stylesheet'>
Group members
| Group Members | Student nr. |
| Erik Wubbels | 0917805 |
| Peter Visser | 0877628 |
| Jeroen Bakermans | 1007330 |
| Bas van Kampen | 1236216 |
Planning
Abstract
All robot ideas
Our brainstorm ideas:
- (Using datasets from Eindhoven for) IoT actuation throughout the city.
- Mobile Cloud Robotics as a service with OCCIware
- Robots to help elderly and physically impaired people with daily tasks
- Learning with augmented reality glasses / AI mentor
- Consumer dental x-ray scanner device (+service), from home
- wearable for elderly people to quickly arrange quick responders in case of falling
Problem description
This subject of this project is supporting elderly people living their live independently by assisting them with a wearable AI device. The great strides in the rise in longevity of people, have resulted in an ageing populations in most developed economies. This developed creates new challenges, for the individual as well as society. Many individuals want to live as independently as possible, but their physical and/or mental impairments make that more difficult. It is also difficult for their loved ones, since dangerous situations arise. For both individuals, their families as society as a whole, the associated increase in healthcare costs is a challenge. One of the big problems for all involved is falling. Elderly people are more likely to fall for biological reasons, and their falls can cause bigger damage as well. Additionally, for elderly people it is more risky to undergo surgery, and recovery (such as learning to walk again) is more difficult - for more feeble individuals surgery is not even possible, resulting in a big permanent disability and pain. With more elderly people living on their own, instead of in retirement homes, there is a bigger risk of people lying helplessly on the floor for hours or longer. This is a horrible experience, and it can increase injuries, and even result in death in extreme cases.
This project started with the objective to support these elderly individuals, as well as their families and hence society as a whole, by developing a wearable device to detect falling, and notify people about it. This is a solution in the core of robotics: it combines a device with various mechanical aspects, interaction with the environment, and autonomous behavior.
Subsequently, a wider range of problems our elderly users face has been identified and incorporated into the objectives for the proposed device:
- automatic fall detection, and (after checking) arrange for help
- heart-attack detection
- GPS-tracking to prevent wandering, guide the person back, or arrange help if needed
- voice-control and interaction, specifically for elderly people (training, habituation, etc.)
- medicine planning/reminders, possibly combined with a smart-dispenser
- PPG measuring of bloodflow and oxygen-levels > use to detect and monitor diseases
-
State of the art
AI supported living for elderly
The Elderly’s Independent Living in Smart Homes: A Characterization of Activities and Sensing Infrastructure Survey to Facilitate Services Development
Source: https://www.mdpi.com/1424-8220/15/5/11312
Summary: an systematic review on ai-support for elderly people, it is about smarthomes, but we can adapt this to our wearable device. The analysis-unit / building block is ‘activity’, to which particular measurements and assistance-forms can be applied. The right kind of sensors, preprocessing and evaluation need to be chosen. This article has a classification of main activities of elderly people living independently, and suitable sensors and data processing for these.
Related: ai-system that uses constraint‐based scheduling technology to actively monitor a pattern of activities executed by the person. Detects temporal constraint violations which are used to trigger meaningful and contextualized proactive interactions:
https://onlinelibrary-wiley-com.dianus.libr.tue.nl/doi/full/10.1111/j.1467-8640.2010.00372.x?sid=worldcat.org
Integrated e-Healthcare System for Elderly Support
Source: https://link-springer-com.dianus.libr.tue.nl/article/10.1007%2Fs12559-015-9367-3
Summary: An unobtrusive integrated e-healthcare system for elderly support (gerontech) for monitoring biomedical parameters of a person in real time, anywhere and in any situation. The data is send to a smartphone or tablet, and can be shared with care-takers. Continunous monitoring gives a wealth of health-data-history for better diagnosing and preventive care, as well as quicker response in emergencies. It also discusses the easy use of contacting medical assistance / consultation from home, which is useful for elderly people with walking disabilities.
Current progress of photoplethysmography and SPO2 for health monitoring
Source: https://link-springer-com.dianus.libr.tue.nl/article/10.1007%2Fs13534-019-00097-w
Summary: A photoplethysmograph (PPG) is a simple medical device for monitoring blood flow and transportation of substances in the blood. It consists of a light source and a photodetector for measuring transmitted and reflected light signals. Clinically, PPGs are used to monitor the pulse rate, oxygen saturation, blood pressure, and blood vessel stiffness. Wearable unobtrusive PPG monitors are commercially available.
This article reviews the issues and applications for monitoring oxygen saturation, such as detection and monitoring of cardiovascular disease(s), sleeping disorders, respiratory diseases. Some can be avoided by these (daily) measurements. The measurements are not very robust, so patients need to be explained very well how to do them correctly.
An autonomous robotic exercise tutor for elderly people
Source: https://link-springer-com.dianus.libr.tue.nl/article/10.1007%2Fs10514-016-9598-5
Summary: Interesting application of using ai – here of a physical robot, not just a wearable device – to help elderly people learn new physical exercises, and to help them train more. ‘ambient assisted living’ is the notion to sustain the mental and physical health of elderly people in the comfort of their own homes. Perhaps we could replace the robot with an instructional videos on tv or laptop or tablet, and the placement of a camera to observe the motions of the elderly trainee, while using our device to measure the activities and use the ai-aspect to interact by providing feedback.
Related: review article about the benefits of training for elderly people, and specifically what kind of exercises are useful:
https://link-springer-com.dianus.libr.tue.nl/article/10.1007%2Fs40520-017-0863-z
AI empowered context-aware smart system for medication adherence Source: https://www.emeraldinsight.com/doi/pdfplus/10.1108/IJCS-07-2017-0006 Summary: This article discussing the downside of many (proposed) electronic pillboxes, which use often use time-based reminders. However, these reminders can come at inopportune moments for the pill taker, resulting in suboptimal medication adherence. This article proposes a method of AI-empowered, context-aware reminders. From measurements of the user and the/his environment. This can integrated into our device very well, it seems, only the/a electronic pillbox is optional, although most elderly people have prescription medication, so it is not that strange of an option to pay attention to in our development.
Recognition of Activities of Daily Living with Egocentric Vision: A Review
source: https://www.mdpi.com/1424-8220/16/1/72/htm
Relevance:
Sensor using camera. Helping to support the egocentric view. It uses a model based on different stages.
Can be intrusive due to camera's monitoring users behavior. So think about possible privacy complaints. Not the best option'
Wearable and Portable eHealth Systems
Source: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/4312668/references#references
Relevance: Different studies on personal health measuring systems(PHMS) (picture)
The validity and reliability of consumer-grade activity trackers in older, community-dwelling adults: A systematic review
Source: https://www-sciencedirect-com.dianus.libr.tue.nl/science/article/pii/S0378512218301828
Short summary & relevance:
How good do these trackers work. Errors are measured when elderly people walk slow, however overall the results where highly accurate. Food to think about regards which tracker system is best for different kind of users. Users with certain chronic disorders have multiple dips in their activity, so not always true. However using these kind of step-wise trackers to self monitor the physical activity of the user is a good idea. It is important to keep these users active, especially elderly, because it is one of the biggest strategies to reduce age-related morbidity.
Table 2. Consumer-grade activity trackers device characteristics.
Tracker
Selected Measurement
Placement
Size (cm)
Weight (g)
Cost AUD ($)
Fitbit One
Steps, distance, calories, active minutes, sleep, altimeter
Waist, pocket, bra
4.8(h) × 1.9(w) × 1.0(d)
9
129.95
Fitbit Charge HR
Steps, distance, calories, active minutes, sleep
Wrist
Large: 16.1–19.4(c) × 2.1(w) Extra Large: 19.4–23.0(c) × 2.1(w)
23
249.95
Fitbit Flex
Steps, distance, calories, active minutes, sleep, altimeter, heart rate
Wrist
Small: 14.0–17.6(c) × 1.4(w) Large: 16.1–20.9(c) × 1.4(w)
13 15
94.00
Fibit Zip
Steps, distance, calories, active minutes
Waist, pocket, bra
3.6(h) × 2.9(w) × 1.0(d)
8
79.95
Jawbone UP
Steps, distance (app), calories, sleep
Wrist
Small: 14.0–15.5 Medium: 15.5–18.0 Large: 18.0–20.0
19, 21, 23
Discontinued December 2011.
Misfit Shine
Steps, distance, calories, active minutes, sleep
Wrist, waist, necklace, bra
2.8(h) × 2.8(w) × 0.3(d)
9
89.95
Omron HJ-112
Steps, distance, calories, active minutes
Waist
1.5(h) × 5.3(w) × 3.6(d)
82
110.72
Multimodal Wearable Sensing for Fine-Grained Activity Recognition in Healthcare
Source: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/7155432
Relevance:
A multimodal system. Using different sensors, think about accelerator and gyroscope, to sense the user its position. GPS and Bluetooth beacons to detect someones position. Important to distinguish between different scenarios. Although the sensors can detect if a person is sitting or standing it has to distinguish the difference between for example sitting on the ground, which could be a sign of a bad situation(falling), or sitting on a sofa. So at this moment only basic ADLs can be distinguished. A way to get rid of this problem is to use a camera. However, a lot of users do not prefer this solution due to the privacy that is been violated, constant recording of what you are doing. Picture Here))
Fall detection
Emergency Fall Incidents Detection in Assisted Living Environments Utilizing Motion, Sound, and Visual Perceptual Components
Source: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/5623343
Summary: This article discusses an advanced system with various sensors and processing to measure and verify falling, accessing the severity of the situation and arranging suitable help. The method uses semantic representation of the patient's status, context and rules-based evaluation, and advanced classification. The article also discusses various advanced classification techniques that have been and their accuracy and efficiency in detecting an emergency situation.
Inertial Sensing-Based Pre-Impact Detection of Falls Involving Near-Fall Scenarios
Source: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/6905812
Summary: This article discussed two improvements of ‘general’ accelerometer fall-detection. First, it includes ‘near-fall’ scenarios in its analysis. Second, it uses a different way to measure near-fall and fall scenarios, a vertical velocity-based pre-impact fall detection method using a wearable inertial sensor. The conclusion is that this detection method was more accurate in their own experiment, compared to an accelerometer, in detecting fall scenarios from near-fall scenarios. In other words, this method is claimed to solve the issue of ‘false positives’ that ‘mere’ accelerometers have.
Related: This article has a good introduction about fall detection, with many useful references: https://link-springer-com.dianus.libr.tue.nl/article/10.1007%2Fs10015-017-0409-7
Related: increase accuracy with barometric measurements: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/5559476
Related: increase accuracy with surface electromyography: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/6399498
Analysis of Public Datasets for Wearable Fall Detection Systems
Source : https://www.mdpi.com/1424-8220/17/7/1513/html
Relevance: In the study they looked at different datasets and compared them regarding the fall data. At the end the conclusion was that it is very difficult to determine an abstract and invariant threshold to detect falling. It is important to establish the different Activity of daily lives (ADLs) in the evaluation of the fall detecting systems FDS. So to sum up, movements should be put into groups of the same mobility to properly detect it with a sensor like an accelarotor in combination with a gyroscoop.
Non-academic but useful sources about the problem of elderly people falling
Elderly people fall quicker (biology) https://www.healthdirect.gov.au/what-causes-falls
Falling is more dangerous for an elderly person, also because they often cannot undergo surgery. (medicine) https://www.msdmanuals.com/home/older-people%E2%80%99s-health-issues/falls/falls-in-older-people
Falling elderly people is a real problem, in the US 1 in 4 falls every year! More facts about the size of the problem: (healthcare and social costs) https://www.cdc.gov/homeandrecreationalsafety/falls/adultfalls.html
Cloud Computing
Mobile Cloud Robotics as a Service with OCCIware
Philippe Merle-Christophe Gourdin-Nathalie Mitton - 2017 IEEE International Congress on Internet of Things (ICIOT) - 2017. https://ieeexplore.ieee.org/document/8039054
Summary: This study proposes combining of cloud computing and robotics into a system called Open Mobile Cloud Robotics Interface (OMCRI). Using an extension of Open Cloud Computing Interface (OCCI), a standard and gateway for hosting mobile robot resources. Then it illustrates the use of these technologies in three off-the-shelf robots: Lego Mindstorm NXT, Turtlebot, and Parrot AR. Drone.
Cloud robotics: Current status and open issues
Jiafu Wan-Shenglong Tang-Hehua Yan-Di Li-Shiyong Wang-Athanasios Vasilakos - IEEE Access - 2016. https://ieeexplore.ieee.org/abstract/document/7482658
Summary: Taking a deeper look into the combining of cloud computing and robotics this study analyzes the subject while looking at combining multi-robot systems with improved energy efficiency, high real-time performance and low cost. And finally showing potential value of these systems through different practical applications. Big data, cloud computing, open source resources, cooperative robot learning, and network connectivity are the major technologies being analyzed.
A High Reliability Wearable Device for Elderly Fall Detection
Paola Pierleoni-Alberto Belli-Lorenzo Palma-Marco Pellegrini-Luca Pernini-Simone Valenti - IEEE Sensors Journal - 2015. https://ieeexplore.ieee.org/abstract/document/7087338
Summary: The study proposes a fall detection system consisting of an inertial unit that includes triaxial accelerometer, gyroscope, and magnetometer with efficient data fusion and fall detection algorithms.They discuss different solutions and their pros and cons. Then they explain the measuring solutions they used, for detecting a fall through the measuring of the human body as well as the measuring the acceleration and orientation of the person using it. The device they describe is worn at the belt to provide undisturbed movement to the person using it.
It then goes on to discuss the different algorithms they tested and compare their reliability and performance to each other.
An overview of wearable applications for healthcare: requirements and challenges Vivian Motti-Kelly Caine - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers - UbiComp '15 - 2015. https://dl.acm.org/citation.cfm?id=2809436
Summary: This article goes into the combination of mobile applications within wearable devices. Discussing seven examples of the applications that have been put to practice as well as the challenges they still bring within healthcare. Particularly focused on promoting healthcare and behavior change. Going into the intuitiveness of interfaces, privacy control, customizability, data collection, data analysis and encouragement.
A Study On Cloud Robotics Architecture, Challenges and Applications
G. Arunajyothi- - International Journal Of Engineering And Computer Science - 2016. https://ieeexplore.ieee.org/abstract/document/6201212
Summary: The study looks at the capabilities of shared information and computation through a cloud robotic architecture. Proposing machine-to-machine (M2M) communication combined with a machine-to-cloud (M2C) communication, making it possible to increase efficiency among the machines as well as sharing different appliances through the cloud.They propose the protocols for these technologies and something they call Elastic Cloud Computing Architecture with three different models: Peer-Based, Proxy-Based and Clone-Based. They go on to discuss the communications challenges and minimizing loss of a message through delay as well as potential security risks due to it being in the cloud, proposing different protocols.
Reliable MAC design for ambient assisted living: moving the coordination to the cloud
Source: https://ieeexplore-ieee-org.dianus.libr.tue.nl/document/7010519 Relevance: Talks about ways to use cloud computing to enhance ambient assisted living(AAL). Ways to transform information from wearable(s).
USE aspects
Users
When looking at which users are to be considered it could be established that, users who seek support with independent living, for example elderly or users with physical or mental impairments, are the primary users.
Society
Independent living is important on this day. The world's older people population is growing at a high speed. So the costs to take care of these elderly people increases also. The nursery homes cannot cope with the speed of the increasing population. resulting in letting elderly people who cannot live independent anymore, live independent.
Enterprise
Living safely independent reduces costs for hospitals and healthcare institutions. Accidents will happen less and when an accident occurs it can be addressed quicker resulting in faster care for the user and probably reduced costs because damage can be fixed faster and in an earlier stage.
Approach
Deliverables
Wiki page Needs to be updated weekly, and in the end give a clear and good overview of the project.
Model Physical and/or digital?
Presentation In week 8
RPCs
Requirements
Requirements
- accurate fall detection: take care of false positives
- good battery life and easy replacement
- Efficient energy consumption
- Easy to wear
- User interface that suits elderly users
Preferences
- option to turn off during sleep
- lockers with medicine and timed-release and check
-
Constraints
- wearable for feeble people
- limited time (7 weeks)
- 600 hours of work
- severe budgets constraints
-
Aspect 1
Aspect 2
Aspect 3
Aspect 4
Final Concept
Model
Results and analysis
Detailing
General drone design
Electric circuit
Drone propulsion
Wireless transmission system
Electronic and Propulsion components
Propulsion compartment and drone frame
Specifications
= Files
= Planning
= Reflection