PRE2017 4 Groep5

Group Members

Name	Study	Student ID
Ahmed Ahres	Software Science	0978238
Quinten Maes	Psychology & Technology	0955972
Hugo Melchers	Mathematics & Software Science	0994280
Christel van den Nieuwenhuizen	Psychology & Technology	0940672
Frank de Veld	Physics & Mathematics	1010914

Introduction

Automation is one of the biggest changes taking place in industry today. Nowadays, systems are being automated to the extent that they require almost no human intervention. Such a technology has been successful not only in manufacturing, but also in the automotive industries. Self-driving cars or even drones are examples of where automation has seen research and development in flight.

Suitcases are also an example that can benefit from automation. By making suitcases autonomously following their owner we can facilitate the traveling process by making it less tiring, especially for the elderly, disabled people and pregnant women. Moreover, this would allow a more efficient transportation of clothes and objects, which could be useful for business travelers or regular flyers. Research has shown that people were enthusiastic and trustworthy towards a prototype of a robotic suitcase after using it . However, one must keep in mind aspects such as security, object detection and components to be able to fit in a plane according to airport security standards.

We are developing a smart self-following suitcase in order to make traveling and transporting objects more efficient and less tiring. This system requires different technologies: Bluetooth connection to be able to follow a device owned by a person, GPS tracking to avoid getting lost by the owner, security procedures to avoid getting stolen and computer vision for obstacle avoidance. In this project we detail a framework to build such a system, present an object detection algorithm that can be used by the suitcase for obstacle avoidance as well as a user interface for a mobile application that can be used by the owner of our system.

Problem Statement

How can we securely make traveling and transporting objects more efficient through autonomous suitcases?

The smart system created should follow its owner within a certain of range of distance, be protected from theft and avoid getting lost.

Project Planning

Approach

We aim to design a motorised suitcase that can be configured to follow its owner. First, we will develop a vision for a nominal use case of such a motorised suitcase. From this vision, we will extract user requirements. Then, we will give a high-level architecture showing the different components that will be used (e.g. computer vision, electric drive, etc.). We will do research regarding all these components, gathering the knowledge required to combine them into one device. Finally, we will present a design for a motorised suitcase based on our vision, the user requirements, and the technicalities of the used components used. To deliver an actual working prototype is not the aim, as it turns out that even the companies working on such suitcases (see State of the Art) are having major problems with that, and making such a prototype would require a budget of several hundred euro's. Furthermore, the time available for this project seems too little to build a complete prototype and we probably lack the expertise to combine all the needed systems together. Thus, we only aim at designing the prototype and the hardware/software systems for such a prototype as well as the consequences of such a technology. As the total technology architecture of a self-following suitcase is complex at itself, we expect that the time needed for this project and the time available for this project will match well enough.

Weekly Planning

Milestones

The following milestones are set for this course. They are shown in the planning aswell.

• In the first week every group member finds and summarizes the articles for their part for the state of the art. The entire introduction and accompanying parts are written.
• In the second week the literature study is done.
• In the third week the requirements and UI design are finished.
• In the fourth week the USE analysis is finished.
• In the fifth week all components for the prototype are available
• In the sixth week the system specifications are finished
• in the seventh week the implementation is done and the prototype is tested
• The last milestone are the deliverables.

Deliverables

For our end deliverables we have to do the following:

• A presentation, which will be held in the last week. In this presentation we will discuss our findings, present a solution to the problem and if possible give a demonstration.
• Several prototypes to show some of the basic functionalities that we want to implement in our suitcase.
• This wiki page containing the technology mentioned earlier, taking into account the advantages, disadvantages, costs, and impact of such an implementation.

Users

In general the users for this kind of technology will be people who regularly have to cover distances with baggage and either have trouble with that or would like to have their load relieved. This mostly covers business travelers, pregnant women, elderly and disabled people. The general area of use would thus be airports, train stations, bus stations, naval docks and urban areas. It is pretty important that these technologies are used in relatively smooth and flat terrain. In the case of personal suitcases, the self following suitcases would be bought particularly by the users.

Requirements

ID	Category	Requirement
R1	Airline regulations	The battery for the suitcase shall be removable.
R2		The weight of the suitcase shall meet the relevant airline regulations, which means it shall be less than the maximum allowed weight.
R3		The battery for the suitcase shall meet airline regulations regarding material and maximum electric power.
R4	Speed	The suitcase shall have the speed of the walking speed of the user.
R5	Battery Life	The battery of the suitcase shall have a battery life such that it will work for a full trip without charging.
R6	Detection of objects	The suitcase shall detect the objects in its surrounding with an accuracy of 5 cm maximally.
R7		The suitcase shall be able to detect the location of the user in a radius up to 50 meters.
R8	Alarms	The suitcase shall transmit an alarm to the user's phone when outside a radius of 50 meters of the user.
R9		The suitcase shall transmit an alarm when the battery life of the suitcase becomes lower than 10%.
R10		The smartphone app belonging to the suitcase system shall transmit an alarm when the battery life of the phone becomes lower than 10%.
R11	Security and Theft	The suitcase shall transmit an alarm to the user's phone when it is being pulled in a direction it should not go.
R12		The wheels of the suitcase shall lock themselves when the suitcase is being pulled in a direction it should not go.
R13	Portability	The suitcase shall have both an autonomous mode and a manual mode in which the user pulls the suitcase himself.
R14	Location	The smartphone app belonging to the suitcase system shall always show the location of the suitcase on the user's phone screen.
R15	Costs	The cost of the final product shall not exceed 1000 euros.
R16	Control	The suitcase shall be able to move autonomously when in autonomous mode.
R17	Balance	The suitcase shall be able to balance itself when in autonomous mode
R18	Materials	The suitcase shall be made out of sturdy and shock-damping materials

State of the Art

So far, a few companies have already tackled the case of self following suitcases. At several events such devices have been shown or demonstrated, but so far none have been sold to particulars yet. The companies currently working on a self following suitcase are:

• Olive robotics owned by IKAP Robotics from Iran (http://oliverobotics.com/)
• Travelmate robotics from the United States (https://travelmaterobotics.com/)
• ForwardX from China (https://www.forwardx.com/)
• Cowarobot owned by LeMoreLab from China (http://en.cowarobot.com/en/r1/robotics.htm)
• 90FUN owned by Shanghai Runmi Technology Co., Ltd. from China (https://www.90fun.us/puppy1)
• NUA Robotics from Israel (http://unbouncepages.com/nuarobotics/)

It is important to note that all of these companies, the parent companies included, have been founded in the previous 3 years. Two of these companies, Travelmate and Cowarobot, needed crowdfunding from the crowdfunding website indiegogo.com in order to be able to produce their suitcases, Travelmate even needed two (https://www.indiegogo.com/projects/travelmate-a-fully-autonomous-suitcase-and-robot, https://www.indiegogo.com/projects/travelmate-a-fully-autonomous-suitcase-and-robot--2#/comments and https://www.indiegogo.com/projects/cowarobot-r1-the-first-and-only-robotic-suitcase). Both companies had delivery dates around end 2016 / begin 2017, but both experienced production delays and have not yet delivered the suitcases to their customers. Furthermore, Travelmate has doubled to tripled their prices compared to their original plan (€400 to €600), which was comparable to the price of the one from Cowarobot. Nevertheless, both companies received an overwhelming amount of support from their backers; 400% of the necessary funds was received by Cowarobot and 1600% of the necessary funds were received by Travelmate. The other four companies do not give specifications on either the release date or the price, only NUA Robotics and ForwardX hope to release it at the end of this year.

It is also interesting to look at the specifications of all these self-following suitcases. Due to airline regulations, most of the companies have a removable battery for the suitcase or aim at having that implemented. Not all companies give specifications on the battery, but most seem to have a Lithum-Ion battery. ForwardX also gives specifications on the capacity: 96 Wh, which meets IATA standards for carry-on luggage. For finding the owner of the suitcase, all companies either have a Bluetooth connection between the suitcase and the smartphone of the user or a Bluetooth connection between the suitcase and an additional smart wristband the user needs to wear. Some companies also use GPS or 3G/4G systems for location detection. The speed of the suitcases varies; for example NUA robotics is only capable of letting the suitcase go 5 km/h while 90FUN promotes a maximum speed of 18 km/h. All suitcases can ride at walking speed however. At last, the sensors for scanning the surroundings differ per company. NUA Robotics and Olive Robotics use a (stereoscopic) camera, ForwardX uses an ultrasonic sensor, Cowarobot a combination of boh, while 90FUN and Travelmate don't appear to use an environment measuring sensor.

Also interesting is that five of these six companies claim to have made the first self following suitcase; ForwardX is not claiming this. Additionally, NUA Robotics is a very small company and the company does not look very professional. To summarize; there are several companies currently working on the idea of an self following suitcase and they are at varying stages of releasing the technology in form of a product, but it seems most of the companies are too optimistic or have run into some issues and none are delivering yet. However, since the companies are already promoting their idea a lot, there are also numerous responses from potential buyers, both negative and positive. This is a really important source of feedback, since this technology is largely based on the users and their preferences. The most important positive remarks are:

• It is an innovative idea
• It is efficient
• It can help disabled people, elderly and pregnant women to transport their suitcases without health risks

The most important negative remarks or fears are:

• It could be stolen easily
• It could be vulnerable to hacking
• The weight could become too high, since the allowed weight for hand luggage is limited
• The size of the batteries might be too high, since the guidelines for batteries on aircraft are strict
• Terrorism could become easier
• It might not useful enough for the target group. This can of course be avoided by searching for other applications, such as aiding elderly or disabled people and improving efficiency in work environments.

It is important that these subjects are adequately thought of in the design of such a suitcase.

However, the case of self following trolleys does not seem to have been explored yet. One device which resembles this idea is the Stewart Golf X9 Follow (https://www.stewartgolf.co.uk/trolleys/x9-follow/), a self following golf cart and another device is a prototype of a self following shopping cart (http://www.technion.ac.il/en/2014/11/a-shopping-cart-that-follows-you/). The golf cart seems to be the only one of the products listed in this section which is actually for sale. Thus, no self following trolleys have been made for airports, retail stores, train stations or other places where a lot of products need to be moved. Since the golf cart is the only actual product resembling the technologies aimed for in this product, it is interesting to investigate how this company has approached the problem of self-following trolleys. The golf cart uses Bluetooth and a separate remote which the user should keep with him and the range is 50 meters. The cart rides a few meters behind the user when on ‘Follow-mode’, but apparently it sometimes ‘chases rabbits’. The battery life is 25 to 30 holes, which means a few hours. Furthermore, it has downhill braking and an integrated stabilizer, which are important to have on golf courses. Of course, this machine is only useful for transporting golf clubs and golf accessories.

For the intended devices, several important (software) components and concepts are needed, of which there generally is a lot of research about. The important software concepts are autonomous image recognition, obstacle avoidance, remote tracking, control systems, autonomous driving and Bluetooth/GPS connections. Hardware subjects that are relevant are battery efficiency, the most optimal motors and wheels, Arduino connections and battery life. Furthermore, there are general subjects like privacy, security, user preferences and (airport) regulations.

A list of relevant sources (scientific papers and patents) follows underneath:

• Patent for self-following vehicle. This patents is actually pretty short and concise. It refers to other patents as well; it combines several systems into the concept of a target following devices. These systems are: a frame with a front and rear side, wheels, a driving system for wheels, a control system, a remote target unit and a stereoscopic detection system.
• Patent for a small DC motor. DC motors have of course existed for a long time, but this patent is specifically about a mini-sized DC motor. The important components of the DC motor are: a motor frame with a cylindrical portion with constant thickness, field magnets and a minimum sized air gap between the magnets and the frame to be able to rotate the armature assembly.
• Research paper on the design and implementation of a mapping robot with omni-wheels and a Raspberry-Pi. While the aim of this robot is different than in this case, the general architecture of this robot is still useful. Some requirements that are overlapping are: lightweight, movement at walking speed, enough space for sensors and electronics and relatively cheap materials. It was decided that four omni-wheels would be used for their mapping robot with one electric motor on top of each, as well as two double sided L298 motor drivers, an Arduino based controller, a Raspberry Pi as on-board computer and a Li-Pol 7.4 V battery as power source. The sensor which have been used is an ultrasonic HC-SR04 distance sensor. The reason why this article might be useful for this project is their conclusion that it is perfectly possible to create a robot with very general components which aim resembles the aim pursued in this project. The major difference is the weight it should handle and the autonomy of the robot, which can be tackled by using bigger motors, batteries and a stronger on-board computer.
• Research paper on the power and propulsion system for an autonomous robot. This paper is written about a robot participating in the RoboCup competition, a major robotics competition which has the goal of creating a robot soccer team which should win from the human team in 2050. The competition is attended by hundreds of teams each year and the robots get better each year. In this paper, the optimal energy storage system and propulsion system are researched. It is concluded that a Li-polymer battery of 25.9 V assisted by two Li-polymer batteries of 7.4 V each are the optimal power sources, since the power density is high. For the motor system, two cascaded cell modules for controlling motor speed and power flow control are used with DC-DC converters and a kicker circuit. The motor itself is a permanent magnet DC motor. An important remark made in the paper is that deep discharge needs to be avoided for safety and protection of the system. Thus, a basic voltage needs to be present so that the battery life is extended. Furthermore, for this project it is important that the batteries follow airport security guidelines.
• Research paper on a person-following autonomous trolley. This paper was written about the design of a robot that follows his user using both ultrasonic sensors and Bluetooth connection. The robot also reacts on human speech. The paper is mostly focused on the control style variants for robots. In many ways, this paper resembles this project, since it is about self-following robots used in mainly supermarkets, but use for disabled people, sports and military is also suggested in the paper. The approach of the researchers is different than the approach in this project however, since they consider 3D sensors and image processing not cost efficient. Ultrasonic sensors are used instead. While this can certainly work in supermarkets, it might be more difficult to make that work in busy areas as airports. Furthermore, an important remark is made, namely that GPS might be too unreliable at these distances. The robot made for this research paper mainly has components which are also present in similar robots found in other papers, namely two DC motor, a L289N motor controller, a Bluetooth module, an Arduino Mega on board computer, a 12V battery and regular mini wheels.
• Research paper on a novel object avoidance which is easy to tune and takes into consideration the field of view and the nonholonomic constraints of the robot. Moreover the method does not have a local minimum problem and results in safer trajectories because of its inherent properties in the definition of the algorithm. The algorithm is tested in simulations and after the observation of successful results, experimental tests are performed using static and dynamic obstacle scenarios.
• Patent for an object detection system
• Research paper on the linear time-invariant control system
• Research paper on object detection using convolutional neural networks for classification
• Research paper discussing the use of so-called pseudolites (pseudo-satellites) for close-range navigation. Using pseudolites, stationary devices that transmit GPS-like signales, and synchrolites, which rebroadcast GPS signals it receives from real GPS satellites, high-accuracy localisation methods become much faster and cost-effective, most notably Carrier-phase Differential GPS or CDGPS, which reduces the baseline error to just 1 centimeter. Localisation can even be done when fewer than 3-4 independent GPS signals are received, which is not the case when no other signals are received.
• Paper discussing how to achieve high accuracy using indoor pseudolites. Here, a constellation of GPS pseudolites is mounted on the ceiling of a large hangar, a car is fitted with antennae, and both run custom algorithms to determine the vehicle's location. The resulting error is less than 1 centimeter.
• Research paper on locating devices indoor using Bluetooth. This paper investigates the possibility of locating a device in a constrained environment using only Bluetooth. While this is possible, it requires many measurements to be taken of the Bluetooth signal strength from the `lost' device, while holding the receiving device (in this case, a smartphone) at specific angles and then move in the estimated direction of the lost device. This way, the location of the device can be reduced by a factor 4 with each measurement.
• Paper discussing Bluetooth beacons and a concept called stigmergy to locate devices indoor. Here, Bluetooth beacons are placed at known locations, and receiving devices can determine their own location using the received signal strengths from these beacons. In addition, it uses a stigmergic approach in which location estimates are treated like chemical markers (pheromones) in ant colonies, that diffuse over time and affect later location estimates.
• Research paper on localising devices indoors using Radio Frequency and Acoustic Ranging. In this paper, an algorithm is presented that uses Wi-Fi and acoustic signals to locate devices in an office environment. This requires that devices are equipped with Wi-Fi, a speaker, and a microphone. In turn, a localisation algorithm called EchoBeep can locate devices even in an environment with walls and other obstacles that obstruct and reflect signals.