PRE2017 4 Groep5
Group Members
Name | Study | Student ID |
---|---|---|
Ahmed Ahres | Software Science | 0978238 |
Quinten Maes | Psychology & Technology | 0955972 |
Hugo Melchers | Mathematics & Software Science | 0994280 |
Christel van den Nieuwenhuizen | Psychology & Technology | 0940672 |
Frank de Veld | Physics & Mathematics | 1010914 |
Introduction
Automation is one of the biggest changes taking place in industry today. Nowadays, systems are being automated to the extent that they require almost no human intervention. Such a technology has been successful not only in manufacturing, but also in the automotive industries. Self-driving cars or even drones are examples of where automation has seen research and development in flight.
Suitcases are also an example that can benefit from automation. By making suitcases autonomously follow their owner, we can facilitate the traveling process by making it less tiring, especially for the elderly, disabled people and pregnant women. Moreover, this would allow a more efficient transportation of clothes and objects, which could be useful for business travelers or regular flyers. Research has shown that people were enthusiastic and trustworthy towards a prototype of a robotic suitcase after using it [1]. However, one must keep in mind aspects such as security, object detection and components to be able to fit in a plane according to airport security standards.
We planned to develop a smart self-following suitcase in order to make traveling and transporting objects more efficient and less tiring. This system required different technologies: Bluetooth connection to be able to follow a device owned by a person, GPS tracking to avoid getting lost by the owner, security procedures to avoid getting stolen and computer vision for obstacle avoidance. The plan was to make framework to build such a system, present an object detection algorithm that can be used by the suitcase for obstacle avoidance as well as a user interface for a mobile application that can be used by the owner of our system. However, after deliberation it came clear that this was a very complex project and that an easier solution exists for the same problem, namely an engine assisting suitcase which relieves the load of the suitcase by detecting the direction of movement from the pull of the user and using a small motor to ride in that direction itself too. There is thus a shared-control system present. With a separate smartphone app it is possible to tune the amount of work done by the suitcase. The advantages of this idea is that there are no trust-issues from users since the users maintain control over the suitcase as well as physical contact. The risk of theft is also reduced,and furthermore the environmental detection system is removed which annuls privacy issues and complex hardware and software architecture and also reduces the computational power required and increases battery life.
Problem Statement
The first proposed problem statement was: How can we securely make traveling and transporting objects more efficient through autonomous suitcases?
The smart system created should follow its owner within a certain of range of distance, be protected from theft and avoid getting lost.
However, the idea was switched to an engine-assisting suitcase and the problem statement needed to be updated to the following:
How can we make traveling and transporting objects more efficient through engine-assisting suitcases, keeping user's preferences in mind? Since this proposed idea and technology is easier to produce and analyze, it should also be applicable and useful in different environments than airports.
Project Planning
Approach
The original approach for the self-following suitcase was the following:
We aim to design a motorised suitcase that can be configured to follow its owner. First, we will develop a vision for a nominal use case of such a motorised suitcase. From this vision, we will extract user requirements. Then, we will give a high-level architecture showing the different components that will be used (e.g. computer vision, electric drive, etc.). We will do research regarding all these components, gathering the knowledge required to combine them into one device. Finally, we will present a design for a motorised suitcase based on our vision, the user requirements, and the technicalities of the used components used. To deliver an actual working prototype is not the aim, as it turns out that even the companies working on such suitcases (see State of the Art) are having major problems with that, and making such a prototype would require a budget of several hundred euro's. Furthermore, the time available for this project seems too little to build a complete prototype and we probably lack the expertise to combine all the needed systems together. Thus, we only aim at designing the prototype and the hardware/software systems for such a prototype as well as the consequences of such a technology. As the total technology architecture of a self-following suitcase is complex at itself, we expect that the time needed for this project and the time available for this project will match well enough.
However, since the idea was adapted to a engine-assisting suitcase, some things had to be changed. Most notably the vision system disappears completely from the suitcase and the control system becomes much easier. However, additional, different sensors were needed for measuring the work done by the user for pulling the suitcase and the computer in the suitcase should autonomously process this input and convert it to the necessary output. Since the new idea is in theory easier than the self-following suitcase, more attention should be given to the accompanying smartphone app as well as a more careful study for the hardware and the movement system. The planning was adapted properly.
Weekly Planning
Milestones
The following milestones are set for this course. They are shown in the planning aswell.
- In the first week every group member finds and summarizes the articles for their part for the state of the art. The entire introduction and accompanying parts are written.
- In the second week the literature study is done.
- In the third week the requirements and UI design are finished.
- In the fourth week the USE analysis is finished.
- In the fifth week all components for the prototype are available
- In the sixth week the system specifications are finished
- in the seventh week the implementation is done and the prototype is tested
- The last milestone is the completion of all deliverables.
Deliverables
For our end deliverables we have to do the following:
- A presentation, which will be held in the last week. In this presentation, we will discuss our findings, present a solution to the problem, and, if possible, give a demonstration.
- Several prototypes to show some of the basic functionalities that we want to implement in our suitcase.
- This wiki page containing the technology mentioned earlier, taking into account the advantages, disadvantages, costs, and impact of such an implementation.
Users
In general the users for this kind of technology will be people who regularly have to cover distances with baggage and either have trouble with that or would like to have their load relieved. This mostly covers business travelers, pregnant women, elderly and disabled people. The general area of use would thus be airports, train stations, bus stations, naval docks and urban areas. It is pretty important that these technologies are used in relatively smooth and flat terrain. In the case of personal suitcases, the self following suitcases would be bought particularly by the users.
Requirements
ID | Category | Requirement |
---|---|---|
R1 | Airline regulations | The battery for the suitcase shall be removable. |
R2 | The weight of the suitcase shall meet the relevant airline regulations, which means it shall be significantly less than the maximum allowed weight. | |
R3 | The battery for the suitcase shall meet airline regulations regarding material and maximum electric power. | |
R4 | The size of the suitcase shall meet airline regulations regarding handluggage and hold baggage. | |
R5 | Work reduction | The suitcase shall be able to reduce the amount of work done by the user by 50% at the minimum |
R6 | Battery Life | The battery of the suitcase shall have a battery life of up to 10 kilometers of walking distance. |
R7 | Sensor | The suitcase shall be able to detect the amount of work done by the user with an uncertainty of 5% at maximum. |
R8 | The suitcase shall be able to detect the location of the user in a radius up to 50 meters via Bluetooth connection. | |
R9 | Alarms | The suitcase shall transmit an urgent alarm to the user's phone when outside a radius of 50 meters of the user. |
R10 | The suitcase shall transmit an alarm when the battery life of the suitcase becomes lower than 10%. | |
R11 | The smartphone app belonging to the suitcase system shall transmit an alarm when the battery life of the phone becomes lower than 10%. | |
R12 | Portability | The suitcase shall have both an on mode and a manual mode in which the user pulls the suitcase himself without assisting. |
R13 | Location | The smartphone app belonging to the suitcase system shall always show the location of the suitcase on the user's phone screen. |
R14 | Costs | The cost of the final product shall not exceed 1000 euros. |
R19 | Materials | The suitcase shall be made out of sturdy and shock-damping materials |
State of the Art
Self-following suitcase
So far, a few companies have already tackled the case of self following suitcases. At several events, such devices have been shown or demonstrated, but so far none have been sold to private individuals. The companies currently working on a self following suitcase are:
- Olive robotics owned by IKAP Robotics from Iran (http://oliverobotics.com/)
- Travelmate robotics from the United States (https://travelmaterobotics.com/)
- ForwardX from China (https://www.forwardx.com/)
- Cowarobot owned by LeMoreLab from China (http://en.cowarobot.com/en/r1/robotics.htm)
- 90FUN owned by Shanghai Runmi Technology Co., Ltd. from China (https://www.90fun.us/puppy1)
- NUA Robotics from Israel (http://unbouncepages.com/nuarobotics/)
It is important to note that all of these companies, the parent companies included, have been founded in the previous 3 years. Two of these companies, Travelmate and Cowarobot, needed crowdfunding from the crowdfunding website indiegogo.com in order to be able to produce their suitcases, Travelmate even needed two (https://www.indiegogo.com/projects/travelmate-a-fully-autonomous-suitcase-and-robot, https://www.indiegogo.com/projects/travelmate-a-fully-autonomous-suitcase-and-robot--2#/comments and https://www.indiegogo.com/projects/cowarobot-r1-the-first-and-only-robotic-suitcase). Both companies had delivery dates around end 2016 / begin 2017, but both experienced production delays and have not yet delivered the suitcases to their customers. Furthermore, Travelmate has doubled to tripled their prices compared to their original plan (€400 to €600), which was comparable to the price of the one from Cowarobot. Nevertheless, both companies received an overwhelming amount of support from their backers; 400% of the necessary funds was received by Cowarobot and 1600% of the necessary funds were received by Travelmate. The other four companies do not give specifications on either the release date or the price, only NUA Robotics and ForwardX hope to release it at the end of 2018.
It is also interesting to look at the specifications of all these self-following suitcases. Due to airline regulations, most of the companies have a removable battery for the suitcase or aim at having that implemented. Not all companies give specifications on the battery, but most seem to have a Lithum-Ion battery. ForwardX also gives specifications on the capacity: 96 Wh, which meets IATA standards for carry-on luggage. For finding the owner of the suitcase, all companies either have a Bluetooth connection between the suitcase and the smartphone of the user or a Bluetooth connection between the suitcase and an additional smart wristband the user needs to wear. Some companies also use GPS or 3G/4G systems for location detection. The speed of the suitcases varies; for example NUA robotics is only capable of letting the suitcase go 5 km/h while 90FUN promotes a maximum speed of 18 km/h. All suitcases can ride at walking speed however. At last, the sensors for scanning the surroundings differ per company. NUA Robotics and Olive Robotics use a (stereoscopic) camera, ForwardX uses an ultrasonic sensor, Cowarobot a combination of both, while 90FUN and Travelmate don't appear to use an environment measuring sensor.
Also interesting is that five of these six companies claim to have made the first self following suitcase; only ForwardX is not claiming this. Additionally, NUA Robotics is a very small company and the company does not look very professional. To summarize; there are several companies currently working on the idea of an self following suitcase and they are at varying stages of releasing the technology in form of a product, but it seems most of the companies are too optimistic or have run into some issues and none are delivering yet. However, since the companies are already promoting their idea a lot, there are also numerous responses from potential buyers, both negative and positive. This is a very important source of feedback, since this technology is largely based on the users and their preferences. The most important positive remarks are:
- It is an innovative idea, meaning that certain groups of people will be interested in it in any case
- It is efficient
- It can help disabled people, elderly and pregnant women to transport their suitcases without health risks
The most important negative remarks or fears are:
- It could be stolen easily
- It could be vulnerable to hacking
- The weight could become too high, since the allowed weight for hand luggage is limited
- The size of the batteries might be too high, since the guidelines for batteries on aircraft are strict
- Terrorism could become easier
- It might not useful enough for the target group. This can of course be avoided by searching for other applications, such as aiding elderly or disabled people and improving efficiency in work environments.
It is important that these subjects are adequately thought of in the design of such a suitcase.
However, the case of self following trolleys does not seem to have been explored yet. One device which resembles this idea is the Stewart Golf X9 Follow (https://www.stewartgolf.co.uk/trolleys/x9-follow/), a self following golf cart and another device is a prototype of a self following shopping cart (http://www.technion.ac.il/en/2014/11/a-shopping-cart-that-follows-you/). The golf cart seems to be the only one of the products listed in this section which is actually for sale. Thus, no self following trolleys have been made for airports, retail stores, train stations or other places where a lot of products need to be moved. Since the golf cart is the only actual product resembling the technologies aimed for in this product, it is interesting to investigate how this company has approached the problem of self-following trolleys. The golf cart uses Bluetooth and a separate remote which the user should keep with him and the range is 50 meters. The cart rides a few meters behind the user when on ‘Follow-mode’, but apparently it sometimes ‘chases rabbits’. The battery life is 25 to 30 holes, which means a few hours. Furthermore, it has downhill braking and an integrated stabilizer, which are important to have on golf courses. Of course, this machine is only useful for transporting golf clubs and golf accessories.
For the intended devices, several important (software) components and concepts are needed, of which there generally is a lot of research about. The important software concepts are autonomous image recognition, obstacle avoidance, remote tracking, control systems, autonomous driving and Bluetooth/GPS connections. Hardware subjects that are relevant are battery efficiency, the most optimal motors and wheels, Arduino connections and battery life. Furthermore, there are general subjects like privacy, security, user preferences and (airport) regulations.
Engine-assisting suitcase
Some of the information on the self-following suitcase is actually still useful when researching an engine-assisting suitcase. Most notably this included most of the hardware and specifications, most of the applications (including the applications for self-following trolleys), the issues the companies working on the self-following suitcase encountered, and very importantly the feedback given by users on the idea of the self-following suitcase. As it turns out, most people are still afraid of either a malfunctioning robot or theft, both resulting in the loss of the luggage. Another frequent remark was that the self-following suitcase formed either a too complex solution to a problem or a solution for a problem that did not exist. Of course, disabled, pregnant or unfit people are then disregarded, but it is an important remark. The idea of an engine-assisting suitcase largely solves these important issues, as well as the increased chance of terrorism and it helps a little with the problem of weight, as less hardware is needed. Additional important things to research next for this new idea are the concept of electrical bicycles which resemble this, other applications of engine-assisting robots, user's preferences through a questionnaire and how to incorporate a smartphone application with Bluetooth connection in such a system.
Electrical Bicycles
An interesting application that uses similar technology is the electrical bicycle and it is useful to get more information about this technology. The basic idea is that the rider input from the pedals influences the motor and via this the drive wheel of the bicycle. If the user is still able to have manual control over the bicycle, this system is a parallel hybrid system. In the case of a suitcase, the rider input from pedals is changed to input from the smartphone application and the pull of the user to the suitcase. In bicycles, both brushed DC motors as well as brushless DC motors can be used and the main other components are just gears, hubs, rotors and rods. There are generally two types of electrical bikes; one in throttle mode in which you can set the amount of power the battery supplies with a throttle on the bicycle handles (like a scooter) and one in pedal-assisting mode, in which the battery helps you with pedaling. This last 'pedelec'-system comes in two varieties: one with a torque sensor pedal assist which measures the amount of power you deliver and emulate a certain percentage of that, and one with a cadence sensor pedal assist which supplies a constant amount of power which the user can select beforehand. [2]
A fairly large difference in electrical bicycles and the intended suitcase is the battery used, since most electrical bicycles use either Lead acid or NiMH batteries. Both are mostly suitable for big devices which should deliver a lot of power and these are also banned by most airlines due to safety regulations. Luckily Li-ion batteries will probably be perfectly able to provide the energy needed for such systems.
Airport Regulations
There are several airport regulations when it comes to luggage weight, size and type of battery. Airlines are already putting a ban on several of the already existing "smart" bags, because they do not meet the requirements of the airlines. [3] Which indicates the importance of these regulations when making a new smart luggage robot.
Handluggage
- 1 item of hand baggage, max. 55 x 35 x 25 cm (21,5 x 13,5 x 10 inch)
- 1 accessory, e.g. a handbag, briefcase or laptop, max. 40 x 30 x 15 cm (16 x 12 x 6 inch)
- Total weight max. 12 kg (26 lbs).
Check-in bagage
- 1 item of check-in baggage*: L + W + H max. 158 cm (62 inch)
- Total max. 23 kg (50 lbs).
Battery regulations
- Lithium Ion ≤100Wh
- Lithium Metal ≤ 2g
Research articles, patents or other relevant sources
A list of relevant sources (scientific papers and patents) follows underneath:
- Patent for self-following vehicle. This patents is actually pretty short and concise. It refers to other patents as well; it combines several systems into the concept of a target following devices. These systems are: a frame with a front and rear side, wheels, a driving system for wheels, a control system, a remote target unit and a stereoscopic detection system. [4]
- Patent for a small DC motor. DC motors have of course existed for a long time, but this patent is specifically about a mini-sized DC motor. The important components of the DC motor are: a motor frame with a cylindrical portion with constant thickness, field magnets and a minimum sized air gap between the magnets and the frame to be able to rotate the armature assembly. [5]
- Research paper on the design and implementation of a mapping robot with omni-wheels and a Raspberry-Pi. While the aim of this robot is different than in this case, the general architecture of this robot is still useful. Some requirements that are overlapping are: lightweight, movement at walking speed, enough space for sensors and electronics and relatively cheap materials. It was decided that four omni-wheels would be used for their mapping robot with one electric motor on top of each, as well as two double sided L298 motor drivers, an Arduino based controller, a Raspberry Pi as on-board computer and a Li-Pol 7.4 V battery as power source. The sensor that has been used is an ultrasonic HC-SR04 distance sensor. The reason why this article might be useful for this project is their conclusion that it is perfectly possible to create a robot with very general components which aim resembles the aim pursued in this project. The major difference is the weight it should handle and the autonomy of the robot, which can be tackled by using bigger motors, batteries and a stronger on-board computer. [6]
- Research paper on the power and propulsion system for an autonomous robot. This paper is written about a robot participating in the RoboCup competition, a major robotics competition which has the goal of creating a robot soccer team which should win from the human team in 2050. The competition is attended by hundreds of teams each year and the robots get better each year. In this paper, the optimal energy storage system and propulsion system are researched. It is concluded that a Li-polymer battery of 25.9 V assisted by two Li-polymer batteries of 7.4 V each are the optimal power sources, since the power density is high. For the motor system, two cascaded cell modules for controlling motor speed and power flow control are used with DC-DC converters and a kicker circuit. The motor itself is a permanent magnet DC motor. An important remark made in the paper is that deep discharge needs to be avoided for safety and protection of the system. Thus, a basic voltage needs to be present so that the battery life is extended. Furthermore, for this project it is important that the batteries follow airport security guidelines. [7]
- Research paper on a person-following autonomous trolley. This paper was written about the design of a robot that follows his user using both ultrasonic sensors and Bluetooth connection. The robot also reacts on human speech. The paper is mostly focused on the control style variants for robots. In many ways, this paper resembles this project, since it is about self-following robots used in mainly supermarkets, but use for disabled people, sports and military is also suggested in the paper. The approach of the researchers is different than the approach in this project however, since they consider 3D sensors and image processing not cost efficient. Ultrasonic sensors are used instead. While this can certainly work in supermarkets, it might be more difficult to make it work in busy areas as airports. Furthermore, an important remark is made, namely that GPS might be too unreliable at these distances. The robot made for this research paper mainly has components which are also present in similar robots found in other papers, namely two DC motors, a L289N motor controller, a Bluetooth module, an Arduino Mega on board computer, a 12V battery and regular mini wheels. [8]
- Research paper on a novel object avoidance which is easy to tune and takes into consideration the field of view and the nonholonomic constraints of the robot. Moreover the method does not have a local minimum problem and results in safer trajectories because of its inherent properties in the definition of the algorithm. The algorithm is tested in simulations and after the observation of successful results, experimental tests are performed using static and dynamic obstacle scenarios. [9]
- Patent for an object detection system. The method extracts a first feature vector from a first region of an image using a first subnetwork and determines a second region of the image by processing the first feature vector with a second subnetwork. The method also extracts a second feature vector from the second region of the image using the first subnetwork and detects the object using a third subnetwork on a basis of the first feature vector and the second feature. The three subnetworks form a neural network. [10]
- Research paper on the linear time-invariant control system. The paper considers achievable delay margin of a real rational and strictly proper plant, with unstable complex poles, by a linear time-invariant (LTI) controller. The delay margin is defined as the largest time delay such that, for any delay less than this value, the closed-loop stability is maintained. Drawing upon a frequency domain method, particularly a bilinear transform technique, the paper provides an upper bound of the delay margin, which requires computing the maximum of a one-variable function. [11]
- Research paper on object detection using convolutional neural networks for classification. This paper demonstrates that carefully designing deep networks for object classification is just as important as feature extraction. The paper also experiments with region-wise classifier networks that use shared, region-independent convolutional features. [12]
- Research paper discussing the use of so-called pseudolites (pseudo-satellites) for close-range navigation. Using pseudolites, stationary devices that transmit GPS-like signales, and synchrolites, which rebroadcast GPS signals it receives from real GPS satellites, high-accuracy localisation methods become much faster and cost-effective, most notably Carrier-phase Differential GPS or CDGPS, which reduces the baseline error to just 1 centimeter. Localisation can even be done when fewer than 3-4 independent GPS signals are received, which is not the case when no other signals are received. [13]
- Paper discussing how to achieve high accuracy using indoor pseudolites. Here, a constellation of GPS pseudolites is mounted on the ceiling of a large hangar, a car is fitted with antennae, and both run custom algorithms to determine the vehicle's location. The resulting error is less than 1 centimeter. [14]
- Research paper on locating devices indoor using Bluetooth. This paper investigates the possibility of locating a device in a constrained environment using only Bluetooth. While this is possible, it requires many measurements to be taken of the Bluetooth signal strength from the `lost' device, while holding the receiving device (in this case, a smartphone) at specific angles and then move in the estimated direction of the lost device. This way, the location of the device can be reduced by a factor 4 with each measurement. [15]
- Paper discussing Bluetooth beacons and a concept called stigmergy to locate devices indoor. Here, Bluetooth beacons are placed at known locations, and receiving devices can determine their own location using the received signal strengths from these beacons. In addition, it uses a stigmergic approach in which location estimates are treated like chemical markers (pheromones) in ant colonies, that diffuse over time and affect later location estimates. [16]
- Research paper on localising devices indoors using Radio Frequency and Acoustic Ranging. In this paper, an algorithm is presented that uses Wi-Fi and acoustic signals to locate devices in an office environment. This requires that devices are equipped with Wi-Fi, a speaker, and a microphone. In turn, a localisation algorithm called EchoBeep can locate devices even in an environment with walls and other obstacles that obstruct and reflect signals. [17]
- Research paper on distances between a robot and moving obstacles, such as humans based on the concept of depth space. To avoid obstacles the distance between the robot and obstacle is measured, based on the depth space and using an estimation of the obstacle velocity. [18]
Hardware & Design
One of the challenges of this project is to measure the amount of work done by the user in pulling the suitcase and converting this into motor output voltage. Two relatively easy systems exist for that, with one system measuring pulling force in the handle of the suitcase and another system in the wheel axis measuring the torque of the wheels when pulling the suitcase. The system is the handle is easier to implement while the system in the wheel axis is more accurate. The handle system is less accurate since it has to convert the pulling force to forward speed when the user wants the motor to produce a constant speed. However, in order to do this, the angle between the handle and the ground needs to be known, which varies per moment and per person. Also, when the user wants a certain relative amount of work to be done by the motor on the other hand, the system needs to convert the pulling force to a certain amount of motor power. This can be rather inaccurate, so another system in the wheels for measuring torque. This is a lot more accurate since it measures the actual forward speed of the suitcase directly but it involves also some additional instruments. However, since the handle system only really involves a basic electrical circuit (it can function as a weight measuring system as well, more about that later on) it is no problem to implement that as well.
Torque sensors
The most reliable way to let the motor produce a certain relative amount of power is to measure the torque in the wheels when the motor is still off. With the smartphone application, you select the amount of work you want to have relieved and the torque sensors measure the torque on the wheels. The sensors send a signal to the computer system in the suitcase and depending on this the motor generates an amount of torque itself. Then, the sensors again measure the torque and compare it to the necessary amount of torque, so it checks whether the relative amount of work done by the motor is the right amount set by the user.
When talking about torque it is important to understand the difference between dynamic and static torque. Dynamic torque is torque which changes over time, so there is an acceleration present, while static torque is constant over time. In this case it is easier to talk about static torque; the sensors measure the torque on specific times and adjust the motor speed to that. Most of the times the speed of the user plus suitcase is constant anyway, so while it would be more realistic to treat the torque in this case as dynamic, it doesn’t add a lot to the system and dynamic torque sensors are a lot more complicated. Thus, a static torque sensor would be most useful. [19]
There is another important distinction to be made in the field of torque sensors and that is the difference between reaction torque sensors and rotary torque sensors. Reaction torque sensors are not quite useful to this project since the rotation here is limited to 360°. Rotary torque sensors are mounted underneath the device under test and have no rotation limitation. The actual measurement of the torque is done by either strain gages in a Wheatstone bridge circuit, optical speed sensors or a combination of both. Sensor input is recorded in Volt and transmitted to the onboard computer. [20]
Weight sensors
It is quite convenient and not very complicated to implement a weight-measuring device into the smart suitcase. A simple way of measuring weight is by using a spring like in a normal kitchen scale. This method uses Hooke’s law to give a good approximation of the force on the weight scale and thus of the weight of the object on the weight scale. It doesn’t have to be a digital weight scale in this way, as the output can be given on an analogous scale and no electricity is needed for that. The downside is that there are some inaccuracies; the calibration may not have been done properly, Hooke’s law is only a linear approximation, the spring used may wear over time and it is not easy to read the output accurately. Furthermore, when using electrical components like in the suitcase, it is easier to just switch to the digital variant, which does not use spring but rather an electrical circuit named the ‘Wheatstone bridge’ which is known for its extreme accuracy and is used in a variety of applications. [21] . A Wheatstone bridge consists of a number of resistors, usually four, of which two are known are known and constant, one is adjustable, and one is unknown. This unknown resistance varies when force is applied in the right way to the circuit. By adjusting the adjustable resistance and using a galvanometer, it is possible to find the value of resistance in the adjustable resistor in order to let the galvanometer show a zero reading, meaning equilibrium. Using calibration this value of resistance can be used to calculate the force applied and thus the weight. This calculation as well as some needed noise-filtering is done by a small computer that fits into the weight sensor. Digital weight sensors like kitchen weight scales use such methods and it can easily fit into the handle of a suitcase.
Batteries
Before looking into the subject of batteries more deeply, first the findings on airline regulations need to be recapped, since this has the highest priority for the actual product. Batteries that are forbidden here are completely out of the question. Firstly, any batteries in any device need to be removable from the device and there are very strict battery regulations for checked luggage. The types of batteries that were allowed were:
- Dry cell alkaline batteries (AA, AAA, C, D, 9-Volt, button cell batteries)
- Dry cell rechargeable batteries (NiMH, NiCad)
- Lithium ion batteries (Up to 100 Wh, 101-160 Wh with approval)
- Lithium metal batteries (Up to 2 grams of lithium per battery)
- Nonspillable wet batteries (Up to 12 V, 100 Wh per battery)
In most of these cases the amount of batteries which can be transported is limited, sometimes to two, sometimes to more than twenty. The most important battery type in the list is the type of Lithium-ion batteries, since they are used most in medium-sized robots. Most laptop-batteries are allowed for example and they can roughly deliver the same amount of power as is needed in a smart suitcase.
Some types of batteries that are not allowed or for which sharp restrictions exist are:
- Lead acid batteries
- Car batteries
- Industrial batteries like absolyte, NiFe-batteries or steel case batteries
- Nuclear batteries
Most of these batteries are either too large or too heavy for the intended purpose anyway. Most of the times, such batteries are shipped or transported overland rather than via airplanes.
Then there is the option between one or multiple batteries. The main reason for the difference is that difference parts of a robot need different voltages: sensors at approximately 5V, motors at 9V-12V but servos at 3V-6V and other electronics at 9V-12V. When using a simple design, it might be better to jus use different batteries at different voltages for the different components. However, all these batteries need to be removable and need to be removed at border control, as well as all the batteries need to be recharged separately. Furthermore, using microcontrollers the voltage can be adjusted. Thus, in this application it is more useful to use one main battery.
Software & Technology
It goes without saying that our system needs multiple technologies in order to be useful for the users and for society. Such technologies include GPS tracking in order for the user to be able to locate his/her suitcase when stolen or lost and bluetooth connection in order to access information about the luggage such as battery life. Moreover, security is of great importance where a fingerprint lock can be added as a two-factor authentication in order to ensure that no one can stole the content of the suitcase.
GPS Tracking
In order for the user to track the position of the luggage at all times and locate it if the system gets stolen or lost, a Global Positioning System (GPS) tracker is used. This technology uses a receiver that communicates with satellites to determine global position that is accurate to up to 5 meters, which is enough for a user to see the suitcase. A GPS tracking system uses the Global Navigation Satellite System (GNSS) network. This network incorporates a range of satellites that use microwave signals that are transmitted to GPS devices to give information on location, vehicle speed, time and direction. So, a GPS tracking system can potentially give both real-time (active tracking system) and historic navigation (passive tracking system) data on any kind of journey. The control of the Positioning System consists of different tracking stations that are located across the globe. These monitoring stations help in tracking signals from the GPS satellites that are continuously orbiting the earth. Space vehicles transmit microwave carrier signals. The users of Global Positioning Systems have GPS receivers that convert these satellite signals so that one can estimate the actual position, velocity and time. For our purpose, we are more interested in real-time data and thus the active system as the user wishes to locate the suitcase in the current time.
This data can then be sent to the mobile application on the user's phone.
Bluetooth Connection
During normal use, the user must be able to interact with the suitcase. An example of such an interaction is the user monitoring the amount of charge that remains in the batteries. Many of the features described under the section 'security' will also require that the suitcase and its user can communicate with each other. For this, we will use a Bluetooth connection between the suitcase and the user's smartphone. The connection will be initialized using a smartphone app, that will be described in further detail under the section 'Mobile Application'.
Our choice to use Bluetooth was largely based on [22], which compares four popular wireless data transfer protocols: Bluetooth, ultra-wideband (UWB), ZigBee, and Wi-Fi. These protocols are compared by transmission time and throughput, data coding efficiency, protocol complexity, and power consumption (both overall and relative to throughput). Wi-Fi and UWB have very high throughputs and equally high power usage, meaning that in our scenario, where the required throughput will not be very high, these protocols are not very suitable. Comparing ZigBee and Bluetooth, the paper notes that the ZigBee protocol is much less complicated, being defined by the IEEE using just 48 primitives compared to Bluetooth's 188 primitives. This would make ZigBee more suitable for devices with little processing power such as our suitcase. However, the power usages of both systems are similar, and Bluetooth consumes significantly less power per Mb of data sent or received. Since both protocols have low throughput (less than 1 Mb/s), this means that Bluetooth may consume less power than ZigBee in our use case. However, as mentioned before, the differences between both protocols in the areas that are relevant to us, are quite small. We elected to use Bluetooth for our suitcase, since this protocol is widely available on smartphones and is already familiar to many users.
A more detailed analysis of Bluetooth's power consumption is given in [23]. This paper gives a detailed method to measure the power consumption of Bluetooth Low Energy (BLE) devices. It also uses this method on an example device, namely a keyfob with some buttons, representing a generic device with little processing power that will occasionally transmit and receive little bits of data. It makes the following measurements: a connection event, which consists of a data packet being received, and a response being transmitted, takes between 2.6 and 2.7 milliseconds. This time includes the time it takes for the Bluetooth chip to wake from its sleeping state, receive the message, transmit a response, process the message, and go back to sleep. The average power consumption for one such event is measured to be between 8.25 and 8.53 mA, with 0.001 mA being used when the chip is in sleep mode. The average power consumption with 1 packet being received per second is then equal to 0.0230 to 0.0247 mA, meaning that the device could receive 1 message per second constantly for approximately 400 days when powered by a standard coin-cell battery with a 230mAh capacity. Note that in these tests, the packets sent are empty (e.g. have a full header but empty payload). In practice, meaningful messages with an actual payload would mean that the time to receive, transmit, and process will be higher, and power consumption will therefore also be higher. In our case, the messages should still be small (single numbers representing e.g. battery percentage), so we expect this paper's results to be a good indication of our real-world power usage. Furthermore, the measured power consumption of the Bluetooth chip will then be insignificant compared to that of the electric motors, meaning that 'stand-by' power usage will not be a concern for us.
Security Systems
Two-factor authentication: In order to ensure more safety, a two factor authentication can be added to the system. Also known as 2FA, this method is an extra layer of security that is known as "multi factor authentication" that requires not only a password and username but also something that only, and only, that user has on them, i.e. a piece of information only they should know or have immediately to hand - such as a physical token. It is already commonly used in mobile applications such as WhatsApp.
Position Tracking: Using the GPS tracking system discussed earlier, one can always track the position of the system using the mobile application. If for instance a suitcase is stolen in an airport, then the owner can use the mobile application to find the suitcase and ensure that the content is not stolen.
Mobile Application
Should be free on Android and App Store, tracking GPS, access data with bluetooth, display weight data.
USE Aspects
User Impact
Society Impact
Enterprise Impact
Future Developments
References
- ↑ Alves-Oliveira, P., & Paiva, A. (2016, October). A study on trust in a robotic suitcase. In Social Robotics: 8th International Conference, ICSR 2016, Kansas City, MO, USA, November 1-3, 2016 Proceedings (Vol. 9979, p. 179). Springer.
- ↑ Muetze, A., Tan, Y.C., (2007) "Electric Bicycles - A performance evaluation", IEEE Industry Applications Magazine, 12-21
- ↑ Kenton, M. (2018, January 11)"Smart luggage" bans - what they mean for airline travelers, Retrieved from https://www.travelersunited.org/getting-there/smart-luggage-bans/
- ↑ Hendrik, W. (2014). U.S. Patent No. EP 2 590 041 A3. Washington, DC: U.S. Patent and Trademark Office.
- ↑ Kuroda, M. (2009). U.S. Patent No. US 7598706 B2. Washington, DC: U.S. Patent and Trademark Office.
- ↑ Krinkin, K., Stotskaya, E., & Stotskiy, Y. (2015). Design and implementation Raspberry Pi-based omni-wheel mobile robot. 2015 Artificial Intelligence and Natural Language and Information Extraction, Social Media and Web Search FRUCT Conference (AINL-ISMW FRUCT). doi:10.1109/ainl-ismw-fruct.2015.7382967
- ↑ Ghaderi, A., Sanada, A., Nassiraei, A. A., Ishii, K., & Godler, I. (2008). Power and propulsion systems design for an autonomous omni-directional mobile robot. 2008 Twenty-Third Annual IEEE Applied Power Electronics Conference and Exposition.
- ↑ Krishnamohan, T., Mahendran, A., Paramananthasivam, V., Selvakumar, A. (2016). Human following Trolley-Auto Walker, SLIIT conference 2016
- ↑ Sezer, V., & Gokasan, M. (2012). A novel obstacle avoidance algorithm:“Follow the Gap Method”. Robotics and Autonomous Systems, 60(9), 1123-1134.
- ↑ Liu, M. Y., Tuzel, O., massoud Farahmand, A., & Hara, K. (2018). U.S. Patent Application No. 15/218,182.
- ↑ Ju, P., & Zhang, H. (2018). Achievable delay margin using LTI control for plants with unstable complex poles. Science China Information Sciences, 61(9), 092203.
- ↑ Ren, S., He, K., Girshick, R., Zhang, X., & Sun, J. (2017). Object detection networks on convolutional feature maps. IEEE transactions on pattern analysis and machine intelligence, 39(7), 1476-1481.
- ↑ Cobb, H. S. (1997). GPS pseudolites: Theory, design, and applications (pp. 87-101). Stanford, CA, USA: Stanford University.
- ↑ Edge, L., & Jobs, G. (2001). Centimeter-accuracy indoor navigation using GPS-like pseudolites.
- ↑ Gu, Y., & Ren, F. (2015). Energy-efficient indoor localization of smart hand-held devices using Bluetooth. IEEE Access, 3, 1450-1461.
- ↑ Palumbo, F., Barsocchi, P., Chessa, S., & Augusto, J. C. (2015, August). A stigmergic approach to indoor localization using bluetooth low energy beacons. In Advanced Video and Signal Based Surveillance (AVSS), 2015 12th IEEE International Conference on (pp. 1-6). IEEE.
- ↑ Nandakumar, R., Chintalapudi, K. K., & Padmanabhan, V. N. (2012, August). Centaur: locating devices in an office environment. In Proceedings of the 18th annual international conference on Mobile computing and networking (pp. 281-292). ACM.
- ↑ Flacco, F., Kröger, T., De Luca, A., & Khatib, O. (2012, May). A depth space approach to human-robot collision avoidance. In Robotics and Automation (ICRA), 2012 IEEE International Conference on (pp. 338-345). IEEE.
- ↑ Winczner, K. (2006), The Basics of Torque Measurement, Sensor Developments Inc., url: https://www.eetimes.com/document.asp?doc_id=1273988&page_number=1
- ↑ PCB Piezotronics, Inc. (2006), Manual on Torque Sensors., Depew, NY, USA
- ↑ Sadasivam, K., Gupta, S., (2011), Weighing Scale Design – Measure Signals Accurately, Cypress Semiconductor Inc.
- ↑ Lee, J. S., Su, Y. W., & Shen, C. C. (2007, November). A comparative study of wireless protocols: Bluetooth, UWB, ZigBee, and Wi-Fi. In Industrial Electronics Society, 2007. IECON 2007. 33rd Annual Conference of the IEEE (pp. 46-51). Ieee.
- ↑ Kamath, S., & Lindh, J. (2010). Measuring bluetooth low energy power consumption. Texas instruments application note AN092, Dallas.