PRE2020 1 Group3
Group members
Name | Student ID | Department | Email address |
---|---|---|---|
Roel den Hoet | 1248170 | Computer Science and Engineering | r.d.hoet@student.tue.nl |
Rick Peeters | 1021754 | Mechanical Engineering | r.peeters@student.tue.nl |
Mayra van der Pol | 1010569 | Psychology & Technology | m.h.e.m.v.d.pol@student.tue.nl |
Emmy van der Ree | 1244223 | Biomedical Engineering | e.m.v.d.ree@student.tue.nl |
Problem statement and objectives
From being used by consumers solely for entertainment, as a more environmentally friendly alternative to fireworks, by videographers to capture spectacular footage otherwise impossible to achieve, to autonomous drones being used for military purposes, drones are becoming increasingly common in all parts of society. It stands to reason that in the future they will be deployed to aid with the currently already extremely high demand for package- and food delivery services, a market which is only growing. [1] This type of application of drones in transport is the most developed, compared to freight and passenger transport. [2] By avoiding traffic, delivery drones offer opportunities for faster and more customized delivery. Estimated is that by 2035, 70 000 drones around Europe will deliver 200 million lightweight parcels. By 2050, this number will be around 90 000. [3]
Due to the high number of different companies which offer delivery services it is likely that in areas like cities there will be a very high number of drones and that these will have differing operating systems. In order to prevent collisions, drones will have to communicate with each other in some way, while also keeping track of no-fly zones. When many different operating systems have to communicate the chance of errors due to incompatibility increases. Furthermore, in high traffic areas the high number of drones will result in a lot of communication traffic happening between drones and this could lead to insufficient bandwidth to sustain a safe communication speed. All of these drones will also create a large amount of position- and routing data that every drone will need to keep track of and store, on top of the data of all the restricted zones the drone could fly through. In order to alleviate these issues it is necessary to create a single overarching communication and control system which can track and command all autonomous drones in a designated airspace. While research has shown that structuring the airspace has a significant role in air traffic management [4] [5], we believe this structure solely is not enough, and a central system has a couple of advantages. First and foremost, such a central system enables adjustments of routes while travelling from one place to the other. While we believe that anti-collision systems also always need to be in place for unexpected events or encounters, these systems and a precomputed route over laid out infrastructure is not going to be enough. If a drone encounters something that he had not anticipated on and has to dodge it and thereby deviates from the ‘road’, no adjustments can be made to get him back on track. With such a central system, you can. It is also shown that cooperative sensors, such as the dissemination of flight information to nearby drones, allow for a fast enough reaction to a moving object (such as another drone), while non-cooperative sensors do not.[6] On top of that, when wanting to really optimize such system by including weather predictions into the flight calculations or communicating with other stakeholders, a central system is more suitable for that. [7] Therefore, we aim to design a system that will receive position and route information from all drones in a certain area, can compare these with each other and any no-fly zones to find any conflicts, calculate any necessary course corrections and communicate about these with (only) the affected drones.
Our objectives for the end of this project are to deliver:
- Central communication and routing system
- Corresponding drone to system communication code
- Literature study on the USE impact of delivery drones
- Literature study on the legal aspects of commercial autonomous drones
User, Society and Enterprise
Users
Clearly, the main users of this air traffic control system would be the delivery companies, irrespective of what they are delivering; parcels, food or other goods. On the other hand, the people who order and receive these good can also be considered as users. They will need to have enough trust in this system otherwise it will never be a success. It is obvious that these two groups of users have different interest, concerns and demands.
Delivery companies
As mentioned there is no real distinction between delivery companies on behalf of what they deliver. The delivery process will be entirely the same regardless of what is delivered. For convenience we neglect the fact that food can get cold along the way. So for a package delivery to be successful the autonomous drone will have to be equipped with the package, take off from either a truck or a distribution center, fly to the destination without colliding with something and then safely deliver the package. In this project we focus on the part where a drone needs to fly to the destination without colliding. There are multiple things that are important for delivery companies, such as safety, accuracy and deliver time
Consumers
The group of consumers basically consists of everyone who will make use of this service, whether they specifically ask for this type of delivery or they do not specify this. Since most people in the Netherlands will have packages delivered at home sometimes, this group will consist of the majority of the entire population. Their biggest interest is of course to receive the package undamaged, as soon as possible. Because we will not take a look at the transfer of the package, the safety of the receiver will not be discussed here as it does not come into dispute.
Society
For society, there are different stakeholders to be recognized. Firstly the government, who is in charge of the legislation of the delivery drones. Inhabitants of high-density delivery areas are another group of interest here. Animal rights and environmental organizations will also play a role, as they seek to protect sensitive areas from this type of technology damaging it. Lastly, connected to the last group of stakeholders, are the other users of the airspace - mainly birds and other flying wildlife.
The most important concern for all these stakeholders is safety.(bron) Most importantly the possibility that a drone will drop from the sky and hits someone or something. Also the risk of a drone being hacked and letting it deliberately crash cannot be underestimated. In order to avoid this the drones itself will have to be very reliable, especially when they are being deployed at big cities. Besides this the system should work flawlessly to make sure that they do not only avoid other delivery drones but also static objects like electricity lines or high buildings. But also moving objects like birds or recreational drones that are not connected to the system should be avoided.
Besides safety there is also the problem of nuisance, for example noise disturbance or invasion of privacy. [8]
When drone delivery becomes more and more common, less humans are needed for the same amount of packages delivered. It could be that some people will lose their job because of this. On the other hand, nowadays the delivery companies have great trouble in handling all deliveries and making sure they arrive on time. This system therefore has the potential the relieve the pressure of the deliverers without a loss of job opportunity. How this will evolve mainly depends on what kind of deliveries will be autonomous and at what frequency they will be executed.
When the sky will be used more often, there unavoidably arises a threat to wildlife [9] Where two drones connected to the same system are relatively easy to guide passed each other, it becomes a lot harder to avoid a bird which could fly at a speed of 70 km/h [10] A good start to tackle this problem would be to prohibit drones from flying over forests, but this does not eliminate the risk. A very sophisticated anti-collision system with radar would be required to exclude this risk.
However even when all the above problems are dealt with in an appropriate way, it seems impossible that nothing will go wrong. Because these are autonomous systems, it is a difficult task to point out who is guilty and who is innocent. This could give rise to ethical discussions which nowadays are already being held about self-driving cars [11] When, for example, a drone suddenly falls out of the sky and hits a pedestrian without having the certainty that it is a technical failure or a minor collision with a bird what caused it, who is responsible? If this happens more regularly, it is likely that people will change their minds about this technology and do not make use of it at all.
Enterprise
This group is formed by the companies developing the air traffic control system and its stakeholders.
Before this system will be available, it will still need to overcome technical challenges as well as some legal requirements. To find out more about these challenges we contacted Avular, a startup company in Eindhoven which, among other things, is doing research about this topic. They mentioned that the three biggest challenges of today were perception, weight and certification. As mentioned before for this project we will mainly focus on the problem of perception, i.e. the ability of these drones to maneuver past static obstacles and avoid moving obstacles. However in order for a company to develop this system all challenges need to be dealt with in an appropriate way. For the problem of weight this means that the capacity of a battery per kilogram will need to increase. Because more and more devices are being equipped with batteries, constant progress is made on this side so in the future this will become less of a problem. In terms of legal requirements there is also some progress (see section ‘Legal Requirements’) made for commercial drones to be deployed.
Another reason why weight and battery capacity might not be a big problem, is because the so called ‘last mile delivery’ is the concept that companies seem most interested in [12]. This means that a truck will drive through a neighbourhood and lots of delivery drones will depart from the truck and only have to fly a relatively small distance to reach their destination. This could make the system potentially more efficient than delivery seen nowadays [13].
Like mentioned earlier is seems very unlikely that there will never occur an accident. For companies who are going to sell this delivery drone system it is important to have clear laws about when they are responsible, and when they are not. Avular mentioned for example that if it is a certain technical error they are willing to take the blame. However if a delivery company decides to use the drones when weather conditions are not good enough, they will certainly not. This seems fair, but it becomes a lot harder when there is no clear cause and there is a bit of a grey area. To prevent issues like this clear government regulations are needed.
Use Cases
The system that will be designed basically consist of two different ways to avoid collision. Besides the ground control system there is an active anti-collision system on each drone. Because of this there could be some situations where it is not entirely clear what the drone should do, therefore we described a few use cases below. As a general rule it can be stated that the active anti-collision system on each drone will always overrule the instructions of the ground control system.
Use Case 1
A delivery drone needs to take an avoiding action to prevent a collision with a private drone or a bird, i. e. a moving object which does not communicate with the ground control system. Therefore it is no longer in the desired position and it comes in the path of another delivery drone which is approaching.
In this case it depends if the ground control system is able to calculate a new trajectory for this delivery drone before it comes into a distance of 10 meters from the other one. If the system is on time with this, the problem is solved and the drone that was out of direction will receive a new trajectory. If this will not happen on time, so not before the drones come within 10 meters of each other, an avoiding action will need to be taken by either only the drone that is out of position, or by both drones. Which of the two it is going to be depends on the speed and orientation of the two drones. The best solution is the one where both drones will lose as little time and energy as possible to avoid collision, and it depends on the situation if the trajectories of both drones will have to be adjusted for that.
Use Case 2
The ground control system fails and cannot send commands to the drones anymore. Some drones will no longer be on their predefined path because of avoiding actions they had to take.
In the rare event that the system does not work due to some error, all drones that are in rural areas should land somewhere in a safe place, for example a grassland, and wait until the system will be able to give them commands again. In urban areas this would be more difficult and specific landing areas on top of roofs would have to be created. Once a drone is landed on such place, the minimum distance of 10 meters towards a drone in the air will be cancelled in order to make sure they can land next to each other.
Use Case 3
A private drone which is connected to the system, but operated by a civilian is making weird and unpredicted movements, which makes it very hard to calculate a safe trajectory to pass it.
Flying a private drone manually in urban areas will be prohibited, and outside urban areas they will need to be connected to the system. When someone is flying such a private drone in rural areas and a delivery drone comes nearby, the user of the private drone will receive a warning that the delivery drone is coming, and will be asked to hold the drone stationary until it has passed. If the person will not obey this command, the drone can temporarily be taken over by the system and held stationary, until the delivery drone has passed. When someone will actually break the law and fly a drone that is not connected to the system, the anti-collison system of the delivery drone will prevent an encounter when the drones coming too close.
Legal Requirements
The Netherlands
Drones used for recreational goals are already becoming more and more common. Because some of these drones are equipped with cameras, the privacy of people is in danger. Also, the noise can be disturbing when they fly too low over residential areas, and the biggest danger: collisions. When (delivery) drones will be deployed more often in the future, these problems will become even bigger. For this reason, the Dutch government already made laws for the use of drones, divided into recreational and commercial. Firstly, recreational drones are not allowed to fly higher than 120 meters above land or water. They can't weigh more than 25 kilograms (including cargo) and always need to be visible. This has two implications: you are only allowed to fly a drone during the day and it needs to be in your line of sight. And, maybe even most importantly, there are a lot of areas specified where recreational drones cannot come closer than 50 meters, measured from the ground. Places like this are[14]:
• big crowds
• contiguous buildings
• harbours
• industrial area’s
• railways
• highways
• ships
• airports
To make this more clear, a map of the Netherlands with all so-called 'no-fly zones' is available:
Red: no-fly zone
Blue: only when granted permission
Purple: low-fly area
For now, the commercial use of drones is not allowed in the Netherlands, except when you have the right permit and papers. There are two types of permits in the Netherlands: ROC and ROC-Light. The implications for ROC-light are as follows: the maximum height you can fly with your drone is 50 meters and the maximum distance you can fly (horizontally) is 100 meters and is not allowed in controlled airspace. It always needs to be visible (being both daytime and in line of sight), it needs to weigh less than 4 kilograms and needs to keep a distance of 50 meters from buildings, crowds and obstacles. To be in charge of such a drone you need to be at least 18 years old and in possession of a drone theory certificate. For a ROC permit, the rules are almost the same, with a few exceptions: the maximum height is 120 meters, the horizontal distance is maximum 500 meters and the weight needs to be less than 150 kilograms. For the drone operator, there are also some additional requirements: a medical test is mandatory, as is liability insurance and technical examination of the drone. [15]
Apart from the non-permitted use of commercial drones, delivery by drones is almost impossible, as almost all of the big cities in the Netherlands are covered by no-fly zones and delivery options are scarce when drones are only allowed in the line of sight of an operator. This shows that the law is not completely ready for this technology. Luckily, the rules will change as per December 31rd, 2020, when the European Union will get the same regulations for unmanned aircraft systems. This date was originally July 1st, 2020, but that deemed impossible due to the corona crisis.
European Union
According to the regulations laid out by the European Union Aviation Safety Agency (EASA), drones will be divided into three categories: Open, Specific and Certified. This distinction will be based on safety and privacy risks. The first category, the Open category, makes no distinction anymore between recreational or professional usage: it only matters if the flights of the drone impose low risks. There are three subcategories in this Open category, with the criterium being weight. The main difference between these subcategories will be the distance needed to be held from people on the ground. We will not elaborate on this further, as delivery drones won't be classified in the Open category. Another important new requirement is that every drone-operator (being a person or a company) needs to register at an online system (read more at linkje naar air traffic management (ATM) systems -- U-Space), the only exception being drones weighing less than 250 grams without cameras - these are regarded as toys. For the operator: the minimum age is 16 years old and an online training and knowledge test need to be passed. Also, liability insurance is required. The distance requirements about traffic areas, buildings and other objects expire and are replaced by the requirement that these drones are not allowed to fly above crowds, people not involved with the drone operation or near airports and controlled airspace (within 3 kilometres). The height constraint of 120 meters remains, as does the visual line of sight. Lastly, CE marks become mandatory for drones.
The second category is the Specified category. Drone operations fall into this category when there is more risk involved, for instance when wanting to fly higher than 120 meters, flying with a drone of more than 25 kilograms or operations near people. Permission for a flight in this category will be granted after risk analysis is approved. Considering risk management, there are three options: Specific Operations Risk Assessment (SORA), Pre-Defined Risk Assessment (PDRA) and Standard Scenario (STS). A company can get a Light UAS Operator Certificate (LUC), which enables it to assess its own risk analysis. Again, we will not elaborate on these matters, as this is most probably not the category delivery drones will belong to.[16].
Then, lastly, the category most probable to contain delivery drones: the Certified category, for operations with high risk. High risk can be heavy drones flying above crowds, delivery drones in urban areas or even passenger transport. Now, the operational requirements are not yet worked out by EASA, but are expected in the course of 2021. This is also because regulations will most likely look like that for manned aviation, and are therefore also partly dependent on the development of U-space (lees hier meer). [17]
Air Traffic Management Systems
U-Space
Unlike the name suggests, U-space is not another airspace classification, such as Classes A-E for controlled airspace. Rather, it is a collective of services and procedures to secure safe access to the airspace for a large number of drones. A collaboration between the public and the private sectors, it addresses solutions to two fronts: regulatory requirements and practices, and technological solutions. According to their blueprint [19], these are the key principles of U-space:
- safety of all airspace users
- provide a scalable, flexible and adaptable system
- enable high-density operations with multiple automated drones
- guarantee equitable and fair access to airspace
- enable competitive and cost-effective service provision
- minimise deployment and operating costs by leveraging existing aeronautical services and infrastructure
- accelerate deployment by adopting technologies and standards from other sectors
- follow a risk-based and performance-driven approach when setting up appropriate requirements while minimizing environmental impact and respecting the privacy of citizens
The services of U-space will be rolled out over time in different 'phases', meaning that both automation and connectivity of the drone will increase.
U1: fundamental services
The foundation services are electronic registration, electronic identification and geofencing. In line with the aforementioned legislation, drones above 250 grams need to register digitally. These registers will also be interoperable and accessible in real time. Of course, electronic registration lays the foundation for electronic identification. Regarding geofencing, for the first phase, it will just be pre-tactical; availability of information prior to take-off.
U2: initial services
The second phase has its focus on the management of drone operations, as it will include flight planning, flight approval, tracking, dynamic airspace information and interfaces with air traffic control. Therefore, in contrast to the fundamental services of U1, it will aim at tactical geofencing; providing updated information during the flight.
U3: advanced services
As apparent, by the time phase U3 comes around, the airspace will be a lot more controlled. U3 takes it a few steps further: it will support more complex operations in dense areas and therefore implements detect and avoid functionalities. It will also provide more reliable means of communication.
U4: full services
The last phase will provide complete integration with manned air traffic and all services provided in the airspace. It will thus support the full operational capability of U-space and will rely on a very high level of automation, connectivity and digitalisation. However vague this sounds, it is for a good reason, as it is not clear - not even in the slightest way actually - how the full integration of drones into the aviation network will look like [20].
Approach & Milestones
A provisionally planning for the project can be found below.
Deliverables
A video with the final presentation
Our final model, together with a simulation created by running our model
As mentioned earlier, the main focus of this project is to create a model of a system that will communicate with all delivery drones to prevent them from colliding and calculate the fastest possible trajectory. Besides that every drone will also have to be equipped with active anti-collision, to prevent any encounters with birds or private drones. To give an overview of what the model should do exactly, a list of RPC's is created:
Requirements
- All delivery drones will need to communicate at all times with the main system that controls the drones
- The system should be able to calculate trajectories of multiple drones without letting them collide
- The drone itself should make an avoiding action when it perceives another obstacle like a bird or a private drone that is within 10 meters
- When an avoiding action like described above happens, the main system should recalculate the trajectory for the drone after a distance of 10 meters to other moving objects is regained.
Preferences
- The system will need to give each drone such a trajectory that the total energy consumption of all delivery drones is lowest
- When an area is made into a no-fly zone, drones that were planned to fly over this area should be given a new trajectory as soon as possible
Constraints
- The drones should always follow the regulations imposed by the government, which are currently still under construction
- Delivery drones should always keep a distance of at least 10 meters towards each other
- Drones should keep a distance of at least 5 meters from buildings or electricity lines
Design considerations
Although only small part of the whole delivery drone system will be modelled and simulation, research has been done on other areas that can be helpful with modelling and future studies.
Communication
Here the MAVLink protocol will be proposed and elaborated. It stands for Micro Air Vehicle Communication Protocol and is a very lightweight protocol used for bidirectional communication between a drone and a ground station. There are two types, Mavlink 1 and MAVLink 2. MAVLink 1 has just 8 bytes of overhead per packet and MAVLink 2 has 14 bytes of overhead but is more secure and extensible. It provides methods for detecting packet drops, corruption, and for packet authentication [21]. The message structure of MAVLink is as follows: [22]
Latency
Another important factor to consider in the communication is latency. The total latency of a communication system has multiple contributions, like travel time, processing speed and queuing time. Radio waves travel with the speed of light in air, which over the communication distances these drones use comes down to tenths of a millisecond on a round-trip. Processing speed looks to be a bigger contribution, so the algorithms used by the ground-control system need to be as efficient as possible. The last important factor is queueing delay, because when more drones are trying to communicate with the GCS than it is capable of processing, the latency will go up as the data traffic will be placed in a queue, waiting to be processed.
In this paper [23] , a test has been performed to determine the so called Round-Trip Latency, which is equal to sum of the travelling time from the ground control system to the drone, the processing time at the drone, and the time back to the ground. With this test a multi-radio communication protocol called Hyracom was used. Hyracom uses three different data links, 868 MHz, 2.4 GHz and 4G LTE, which operate in parallel and carry the same data, which are MAVLink packages. Only the signal that reaches the drone first will be processed, the other two packages with the same timestamp will be ignored. This will make the system more redundant to the environment, because the test shows a clear difference in results when testing either at a rural or an urban environment. In rural environments, LTE connection (3G or 4G) can be poor, and when this happens the other two will take over. [24]. Because in this project we mainly focuss on urban areas, only the results of this test setting will be shown here. The Round Trip Latency of the three separate signals are visualised, and what immediately stands out is that distance plays a negligible role.
What becomes clear of these results is that the 868 MHz signal does not have a big contribution in urban areas. Nonetheless it is important not only for the situation where LTE connection is not strong enough, but also for security reasons (see section Security below). The model of the ground control system that will be created for this project will not incorporate all the necessary hardware to simulate this data communication, only the sending and receiving of MAVLink packages will be simulated. Because of this latency does not occur in the simulation by itself, but to get a better understanding of how the ground control system would perform in the real world it will be manually added in order to analyze the effects of it.
Security
With all the new smart devices that are made, cybersecurity is becoming more and more important in our society and of course that also holds for these delivery drones. If even one of these drones will be hacked, the consequences could be immense, let alone if they are all hacked at the same time. If they fall into the hands of terrorists, innocent civilians could be attacked. This paper [25] shows multiple examples of drones being hijacked, which even led to fatal casualties. There are different ways at which terrorists or criminals can manipulate the drone. Sometimes they only steal the data that is sent between the drone and the ground-control system. In this specific case this information can be used to for example steal a package from someone’s home, once it is delivered. In the table below there is an overview given of the possible threads, that are specifically related to data traffic between a drone and a ground-control system using MAVLink packages.
Confidential threads are when unauthorized people acquire the data that is sent, like in the example mentioned above. When the integrity is violated, the messages are being changed, or parts are added or removed. This could have severe consequences with lots of potential danger. Availability refers to the possibility of sending and receiving data. Deliberately jamming a signal for example falls under this category. For further explanation of the attack methods mentioned in the table one is referred to the paper [26].
The Hyracom communication protocol that was already discussed at the section Latency, comes with an encryption named AES, which stands for Advanced Encryption Standard. This encryption makes it impossible for hackers to retrieve or modify the data that is sent [27].
Unfortunately the availability of the communication is bit harder to guarantee. In this research [28] lots of investigation is shown on this topic, but even today it is very difficult to prevent someone from jamming a certain frequency. Luckily Hyracom uses three signal all with different bandwidths, which makes it more robust to this problem, but this does not solves the problem, because if people are trying to disable this communication, they will probably jam all three signals. To fully tackle this problem more sophisticated procedures are necessary, and research on this is ongoing [29]
Spacing
In order to make sure that drones will keep enough distance towards each other, each drone will have to be able to calculate its own GPS location and height. Only then it can stay within the trajectory that was provided by the ground-control system. These measurements have certain accuracy which must be taken into account. Besides that the weather will also have an influence on this distance.
Today’s most common GPS receivers have an accuracy of 3-5 meters, however there are newer GPS chips that use dual-frequency receivers, which are supposed to be accurate to 30 centimeters [30]. In this paper [31] they even mention accuracies of 3 centimeters, but for this project, we will stick with an accuracy of 30 centimeters. These sensors also do not require a lot of power, so they can be used in drones.
For the height measurement, drones measure the altitude at which they are flying only relative to the altitude at which they took off. They do this by measuring the air pressure and temperature at take-off and comparing this to samples taken in-flight [32]. Barometric sensors nowadays have an accuracy of about 50 centimeters [33]. As the drones will have different take-off altitudes this means that every drone calculates their height differently. A weakness of this method is that when the atmospheric pressure suddenly changes, for example when a cold front arrives, the calculated altitude can be very inaccurate. A solution to this is to constantly measure the air pressure at a central location and have every drone calculate its altitude relative to the changes measured at that point.
So the measurements error are relatively small, but a sufficient amount of space between drones is also needed because they will have to take avoiding actions to avoid birds or private drones sometimes. In order to accomplish this without the need for the ground-control system to calculate a new trajectory, the drone needs to stay within an imaginary sphere. The center of this sphere is a point moving through space, representing the predefined trajectory. As long as the drone stays within a certain distance to this point, so inside this imaginary sphere, it will not collide with other delivery drones because the ground-control system will calculate trajectories in which the edges of these bubbles are always at least 2 meters apart. The idea is visualized in a simple sketch:
Not enough research has been done yet to determine the perfect diameter for this sphere. When this system will be tested in real time, a more detailed estimation can be given. For now, it is assumed that both the delivery drone and the obstacle have a size of 1.5 meters in all directions. Adding an additional safety factor the diameter is set to 20 meters, so that the drone has about 10 meters in each direction to make a maneuver. As mentioned, this parameter can be further perfected by conducting more research.
Model
As mentioned above, a model will be delivered at the end of the project and a simulation to show that this model does what it is supposed to do. For this project we will model the so called ground control system in Java. This system will receive coordinates of a current location and coordinates of the destination from multiple drones. It will then calculate 3 dimensional trajectories in a certain space simultaneously, without letting the drones collide of course. It will receive constant updates of the location by GPS and the height measurement system (see section Design Considerations). It also keeps track of certain properties of the drone (see ...). The drones will only receive information from the system if there is a temporarily no-fly zone somewhere, or if the drone had to leave the trajectory to avoid a bird or a private drone which is (illegally) flying and not connected to the system. If the latter occurs, the system will calculate a new trajectory and send this to the drone. The anti-collision and data-traffic themselves are not modelled, as this would require to model all the hardware. This will not fit in the scope of this project.
The simulation will look like a big 2D space in which objects (that represent the drones) are moving towards a location without colliding. They all have a number which represents their height. Besides these this there are also static obstacles visible, which represent for example buildings or electricity lines, and moving objects which represent private drones or birds.
Traffic Management System functions
- Weather and geospatial information provision
- Managing (unexpected) no-fly zones
- Checking/optimising flight plans, prioritising
- Flight status tracking
- Tracking unexpected obstacles through drones (rogue drones/birds)
Functions
Model
- Collision detector – detects if any two drones have collided
- Initialise – sets timestep, initialises locations, destinations, drones, rogue UAVs
- Environment – sets atmospheric pressures, temperature
- Location – contains coordinate, elevation of ground
- Communication – simulates communication latency
- Detection – simulates detection latency
- Assignment – assigns new destinations to drones
- Simulation – calls environment, communication, movement drones, traffic management system
- Simulation results – keeps track of amount of collisions, average delivery time etc.
System
- Flight status – drone locations and status
- Airspace info – weather conditions, baryonic pressure and temperature at calibration point, unexpected no-fly zones and rogue UAVs
- Flight plan – checks flight plans of all drones
- Traffic management – communicates adjustments, baryonic pressure to drones etc.
Drone
- Status – priority, manoeuvrability category, current speed, destination, location, flight plan, baryonic pressure + temperature --> altitude, direction
- Object detection and evasion
- Communicate to TMS – Status(priority, category, current speed, destination, location, altitude) and unexpected objects
Anti-collision system
Although the anti-collision system will not be modelled and simulated in this project, it is still useful to do research on what kind of system would be the best for delivery drones. Therefore an investigation has been done on different kinds of tools for a drone to perceive its surroundings. Since the ground control system will calculate a trajectory for all the delivery drones in a way that they will not collide with each other and static objects, the anti-collision system will only come into action when there are moving obstacles like birds or private drones which are not connected to the system. For the drone to be able to detect these obstacles in time, there are multiple techniques which can be used.
RADAR
Radar is a relatively old technique, which is used in many applications to detect ships, planes, spaceships and other types of vehicles. But it is also used to predict weather. The basic idea is to send out radio waves and then perceive the reflection of this signal. It operates on a very broad frequency range, and has a range of up to several hundred meters in which it can provide a reasonable accuracy [34] A disadvantage is its relatively high weight, but constant improvements are made on this . [35]. It also operates well in all weather conditions.
LIDAR
Lidar is method for determining the distance to an object by emitting a pulsed laser beam and measuring the time it takes for an object to reflect it and send it back. It is used in multiple areas such as autonomous cars, agriculture, archaeology and geology [36]. When multiple laser and sensors are used in all directions it can create a complete image of its surroundings. It has a higher accuracy than Radar and a lower weight [37]. A disadvantage is that it is affected by rain and fog, but progress is being made on this.
SONAR
With sonar there are sound waves emitted, instead of electromagnetic radiation. It also relies on the principle of the reflection of another object. It is mainly used underwater by submarines, but recently research has also been done for applications for obstacle avoidance systems of drones. [38] [39]. However in these cases it was used for drones flying inside a building. This is because the accuracy decreases for objects that are further away [40]. The update speed of sonar is relatively low Design and analysis of a novel sonar-based obstacle-avoidance system for the visually impaired and unmanned systems.
Comparison
Based on all different aspects of the techniques mentioned above and taking the most important design characteristics into consideration, the best choice is an obstacle avoidance systems based on Lidar. It provides the most accurate estimation of the distance to an obstacle, and can therefore calculate the relative speed of that obstacle with respect to the drone the most accurate [41] This system is also the least heavy, which is a very important aspect for drones. A disadvantage compared to Radar is that its performance drops with rain or fog. But luckily, as already mentioned above lots of progress has been made concerning the robustness in almost all types of weather conditions [42]. Another advantage of lidar is its superior frame rate, which is about 10 Hz [43] [44] Because of this high frame rate obstacles will be noted by the drone in time and an avoiding action can be taken if necessary.
State of the Art
How reliable does a delivery drone have to be? [45] When a delivery drone fails, it can severely impact the people near it. However, setting a concrete reliability goal for delivery drones is not easy. Multiple sensors on the drone can fail at any moment, leading to dangerous situations. Companies need to take costs, public safety and technological options into consideration when setting a reliability goal.
Logistic deliveries with Drones. State of the art of practice and research. [46] In this paper, the current status of delivery drones is discussed. The authors look at previous tests with drones within the medical and logistic sections. The current state of the research regarding drones is also evaluated. The authors conclude that drones are only able to replace traditional transport methods in very special situations, as there are still too many negatives for drone delivery to work perfectly.
Analysis of Amazon Prime Air UAV Delivery Service. [47] This paper analyses the status of the Amazon Prime Air drones. Different aspects of the drone are discussed, such as its specifications, the delivery costs using the drones and the current regulations concerning drones.
Drones as a Threat to Wildlife: YouTube Complements Science in Providing Evidence about Their Effect [48] This paper discusses the effect of drone usage on the behavior of wildlife in the area by analyzing YouTube videos made by drones.
International Commercial Drone Regulation and Drone Delivery Services [49] This paper discusses the laws concerning drones in different countries with regards to required licenses and line-of-sight regulations.
Amazon’s Drone Patents [50] This paper discusses the drone patents granted to Amazon regarding concepts for delivery drones. This includes patents for aircraft design, safety systems and methods for transferring goods from the air to the ground.
Energy use and life cycle greenhouse gas emissions of drones for commercial package delivery [51] In this paper the energy consumption and the greenhouse emissions of a delivery drone system are discussed.
Strategic Design for Delivery with Trucks and Drones [52] This paper elaborates an investigation where multiple drones are deployed from trucks to deliver packages, and compare this to the case where only trucks are used to deliver packages.
Drone Delivery Models for Healthcare [53] This paper investigates the use of delivery drones specifically for healthcare applications. Especially for developing countries this could be interesting since only a third of all Africans live within 2 kilometres of a road that is functional all year. Deploying drones for delivery could thus potentially save lives.
Framework for Autonomous Movement of Drones [54] In this paper a test is elaborated how good the delivery by drone is. Practical considerations such as electromagnetic interference, weather conditions, range, capacity and construction are all elaborated.
Vehicle Routing Problem with Drones for Last Mile Delivery [55] This paper does research on the efficiency of the 'last mile delivery', which means that a truck drives within a mile of the delivery address and then a drone departs from that truck and delivers the package.
An adapted TPB approach to consumers’ acceptance of service-delivery drones [56] This paper discusses consumers' acceptance of drones for service-delivery technology by applying the theory of planned behaviour (TPB). It names consumers' perceived risks of drones' usage as well as potential functional benefits, and the relational attribute to the drone.
The multiple flying sidekicks traveling salesman problem: Parcel delivery with multiple drones [57] The multiple flying sidekicks traveling salesman problem(mFSTSP) is a scenario in which a delivery truck and a heterogeneous fleet of unmanned aerial vehicles (drones) coordinate to deliver small parcels to geographically distributed customers, wherein the objective of the problem is to leverage the delivery truck and the fleet of UAVs to complete the delivery process and return to the depot in the minimum amount of time. This paper proposes a three-phased heuristic solution approach for this problem with an analysis to highlight the benefits and limitations, as well as the impacts of the region size, potential automation improvements, and implications of different endurance models.
Air traffic control for delivery drones [58] This short article introduces us to the company PrecisionHawk, which is working on the challenge to coordinate drones beyond the light of sight. They mimic the strategy that is increasingly being used to manage full-size aircraft, whereby those aircraft determine their positions using GPS or some other form of satellite navigation and broadcast that information by radio to everyone else. This form of air traffic management is called ADS-B (for Automatic Dependent SurveillanceBroadcast). While it seems sensible to integrate drones in this system, with the growing number of UAVs this system can get easily overwhelmed, and thus an independent system for drone-traffic management seems inevitable.
Flying drones beyond the line of sight using 4G LTE: issues and concerns[59] This paper discusses the extent in which 4G LTE (4th Generation, Long Term Evolution) can be used for air traffic management of small Unmanned Air Vehicles (sUAVs) and the limitations and enhancements that may be necessary.
Drones in Smart Cities: Overcoming Barriers through Air Traffic Control Research [60] This paper focuses on small, low-altitude UAV flights in densely populated cities, which would be the most valuable type of robotic aircraft flight. For this, it presents a cloud-based system for city-wide unmanned air traffic management, prototype sensor systems required by city police to keep the city safe, and an analysis of control systems for collision avoidance.
Pakketbezorging in 2019: meer volume, maar tarieven blijven dalen [61] This article describes the growth of the package delivery market in the Netherlands in 2019 and makes predictions on the growth in 2020.
Geen misstanden geconstateerd bij pakketbezorgers, maar zorgen blijven [62] This article illustrates the increased pressure on the package delivery market and describes problems with package deliverers’ working conditions and law violations.
Klachten pakketbezorging [63] This article analyses the complaints received by the dutch consumer’s bond about package delivery services. The main relevant problems are packages which are delivered late or never, the deliverer falsely marks the recipient as ‘not home’ and inaccurate tracking.
Security, Privacy, and Safety Aspects of Civilian Drones: A Survey [64] This survey is about the security, privacy, and safety aspects associated with the deployment of civilian drones into the national airspace. It identifies both cyber and physical threats to drones.
Security, Privacy and Safety Evaluation of Dynamic and Static Fleets of Drones [65] This paper investigates the challenges faced by fleets of unmanned aerial vehicles (UAVs) and the ways that these can be managed. It proposes a method of fleet control based on swarm intelligence.
Blockchain-base structures for a secure and operate network of semi-autonomous Unmanned Aerial Vehicles [66] This paper analyses the probable security threats to an interoperable UAV communication network and proposes to use and describes a blockchain based structure to secure such a network.
Understanding the drone epidemic [67] This paper describes the attributes of drones that challenge existing regulatory arrangements. It documents the nature and characteristics of drones, the dimensions across which they vary, the purposes to which they are put, and the impacts that they appear likely to have.
Who is doing what?
Week 1
Name | Total hours | Tasks |
---|---|---|
Emmy | 5.5 | Watched videos and lectures [1h], brainstorm session [1.5h], worked on problem statement and objectives [1h], read articles and wrote summeries [2h] |
Mayra | 5 | Watched introductory videos and introductory lecture [1h], brainstorm session [1.5h], studied papers 13-18 and wrote summaries [1.5h], worked on users and user needs [1h] |
Rick | 5 | Watched lectures [1 h], Brainstrom session [1.5h], Reading papers [2 h] and making the planning [0.5 h] |
Roel | 5.5 | Watched introductory videos [0.5h], Introductory lecture [0.5h], Brainstorm session [1.5h], Researched papers, wrote summaries and wrote deliverables [3h] |
Week 2
Name | Total hours | Tasks |
---|---|---|
Emmy | 3 | tutor meeting [0.5h], group meetings [1h], researching architecture control systems [1.5h] |
Mayra | 3.5 | tutor meeting [0.5h], group meetings [1h], researching stakeholders and user groups [1h], making a draft for the user (customers) questionnaire [1h] |
Rick | 5 | Tutor meeting [0.5h], Group meetings [1h], Doing research on laws about drones [3.5h] |
Roel | 5 | Tutor meeting [0.5h], Group meetings [1h], Writing email and finding company contact information [4h] |
Week 3
Name | Total hours | Tasks |
---|---|---|
Emmy | 3 | tutor meeting [0.5h], group meetings [1.5h], writing out the questionnaire [1h] |
Mayra | 3 | tutor meeting [0.5h], group meetings [1.5h], making the questionnaire in Google forms [1h] |
Rick | 2.5 | Tutor meeting [0.5h], Group meeting [1.5h], Create questions and send email to companies [0.5h] |
Roel | 2 | Tutor meeting [0.5h], Group meeting [1.5h] |
Week 4
Name | Total hours | Tasks |
---|---|---|
Emmy | 0 | / |
Mayra | 5.5 | Tutor meeting [0.5h], group meeting [1h], doing research for RPCs [4h] |
Rick | 5 | Group meeting [1h], Doing research and writing about user, society and enterprise needs [4h] |
Roel | 1.5 | Tutor meeting [0.5h], Group meeting [1h] |
Week 5
Name | Total hours | Tasks |
---|---|---|
Emmy | 0 | / |
Mayra | 12.5 | tutor meeting [0.5h], group meetings [2h], look for arguments for problem statement [3h], adjusting problem statement [2h], adjust planning [0.5h], elaborate on legislation [3h], investigate and write about U-space [1.5h] |
Rick | 15 | tutor meeting [0.5h], group meetings [2h],Doing research on different types of systems [10h], typing out use cases and RPC's [2.5h] |
Roel | 0 | / |
Week 6
Name | Total hours | Tasks |
---|---|---|
Emmy | 0 | / |
Mayra | 0 | / |
Rick | 0 | / |
Roel | 0 | / |
Week 7
Name | Total hours | Tasks |
---|---|---|
Emmy | 0 | / |
Mayra | 0 | / |
Rick | 0 | / |
Roel | 0 | / |
Week 8
Name | Total hours | Tasks |
---|---|---|
Emmy | 0 | / |
Mayra | 0 | / |
Rick | 0 | / |
Roel | 0 | / |
References
- ↑ van Gurp, T. (2020, July 8). Pakketbezorging in 2019: meer volume, maar tarieven blijven dalen. Nieuwsblad Transport.
- ↑ M. Lange de, H. Gordijn, H. Derriks, and G. Gelauff. Drones in het personen- en goederenvervoer. Technical Report KiM-17-A08, Kennisinstituut voor Mobiliteitsbeleid (KiM), Den Haag, Sept. 2017.
- ↑ SESAR (2016). European Drones Outlook Study – Unlocking the value for Europe. Brussel: SESAR Joint Undertaking
- ↑ Sunil E., Hoekstra J., Ellerbroek J., Bussink F., Nieuwenhuisen D., Vidosavljevic A., Kern S. Metropolis: Relating airspace structure and capacity for extreme traffic densities; Proceedings of the ATM Seminar 2015, 11th USA/EUROPE Air Traffic Management R&D Seminar; Lisbon, Portugal. 23–26 June 2015.
- ↑ Sunil E., Hoekstra J., Ellerbroek J., Bussink F., Vidosavljevic A., Delahaye D., Aalmoes R. The influence of traffic structure on airspace capacity; Proceedings of the ICRAT2016—7th International Conference on Research in Air Transportation; Philadelphia, PA, USA. 20–24 June 2016.
- ↑ Fabra, F., Zamora, W., Sangüesa, J., Calafate, C. T., Cano, J. C., & Manzoni, P. (2019). A distributed approach for collision avoidance between multirotor UAVs following planned missions. Sensors, 19(10), 2404.
- ↑ Samir Labib, N., Danoy, G., Musial, J., Brust, M. R., & Bouvry, P. (2019). Internet of Unmanned Aerial Vehicles—A Multilayer Low-Altitude Airspace Model for Distributed UAV Traffic Management. Sensors, 19(21), 4779.
- ↑ Delivery drones: coming to the sky near you? Heerkens, J. (2015)
- ↑ Drones as a Threat to Wildlife: YouTube Complements Science in Providing Evidence about Their Effect. Rebolo, N. Grilli, M. Lambertucci, S. (2019)
- ↑ The Speed of Birds. The Auk, 23(4), 479-479. Lucas, F. (1906).
- ↑ Responsibility and the Moral Phenomenology of Using Self-Driving Cars. Coeckelbergh, M (2016).
- ↑ Coordinated logistics with a truck and a drone. Carlsson, J. and Song, S. (2017)
- ↑ Xu, Jia, Design Perspectives on Delivery Drones. Santa Monica, CA: RAND Corporation, 2017.
- ↑ 'Laws concerning drones
- ↑ [1]
- ↑ [https://www.dronewatch.nl/2019/04/12/dit-is-wat-de-invoering-van-de-europese-drone-regelgeving-medio-2020-voor-nederland-gaat-betekenen/ / 'EU laws drones]
- ↑ [2]
- ↑ [3]
- ↑ Undertaking, S. J. (2017). U-space Blueprint. SESAR Joint Undertaking. Accessed September, 18.
- ↑ Huttunen, M. (2019). The u-space concept. Reprinted from Air & Space Law, 44(1), 69-89.
- ↑ [3https://mavlink.io/en/ / MAVLink Developer Guide ]
- ↑ Empirical Analysis of MAVLink Protocol Vulnerability for Attacking Unmanned Aerial Vehicles. Kwon, Y. Yu, J. (2018)
- ↑ Flight Tests of Ranges and Latencies of a Threefold Redundant C2 Multi-Link Solution for Small Drones in VLL Airspace Volkert, A. Hackbarth, H. (2019)
- ↑ Flight Tests of Ranges and Latencies of a Threefold Redundant C2 Multi-Link Solution for Small Drones in VLL Airspace Volkert, A. Hackbarth, H. (2019)
- ↑ A Review on Cybersecurity Vulnerabilities for Unmanned Aerial Vehicles. Krishna, L.C.G. Murphy, R. R. (2017)
- ↑ Empirical Analysis of MAVLink Protocol Vulnerability for Attacking Unmanned Aerial Vehicles. Kwon, Y. Yu, J. (2018)
- ↑ MAVSec: Securing the MAVLink Protocol for Ardupilot/PX4 Unmanned Aerial Systems. Allouch, A. Cheikhrouhou, O. (2019)
- ↑ Vulnerability Analysis of the MAVLink Protocol for Command and Control of Unmanned Aircraft. Marty, J. A. (2014)
- ↑ Game-theoretic analysis of an aerial jamming attack on a UAV communication network. Bhattacharya, S. (2010)
- ↑ [4]
- ↑ Accurate absolute GPS positioning through satellite clock error estimation. Han, S.C. Kwon, J.H. (2001)
- ↑ [5]
- ↑ [6]
- ↑ UAV based collision avoidance radar sensor. Kwag, Y. K. Chung, C. H. (2007)
- ↑ A Survey on Unmanned Aerial Vehicle Collision Avoidance Systems. Pham, H. Smolka, S. H. (2015)
- ↑ Beyond 3-D: The new spectrum of lidar applications for earth and ecological sciences. Eitel, J.U.H. Höfle, B. (2016)
- ↑ LIDAR obstacle warning and avoidance system for unmanned aerial vehicle sense-and-avoid. Ramasamy, S. Sabatini, R. (2016)
- ↑ Collaborative Obstacle Avoidance Method of Surface and Aerial Drones based on Acoustic Information and Optical Image Dong-Woo, M. (2015)
- ↑ Efficient Optical Flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone. McGuire, K. de Croon, G. (2017)
- ↑ Collaborative Obstacle Avoidance Method of Surface and Aerial Drones based on Acoustic Information and Optical Image Dong-Woo, M. (2015)
- ↑ Collision Avoidance of Hexacopter UAV Based on LiDAR Data in Dynamic Environment. Park, J. Cho, N. (2020)
- ↑ LIDAR obstacle warning and avoidance system for unmanned aerial vehicle sense-and-avoid. Ramasamy, S. Sabatini, R. (2016)
- ↑ Visual Teach and Repeat using appearance-based lidar. McManus, C. Furgale, P. (2011)
- ↑ RangeNet++: Fast and Accurate LiDAR Semantic Segmentation/ Milioto, A. Vizzo, I. (2019).
- ↑ How reliable does a delivery drone have to be? Schenkelberg, F. (2016)
- ↑ Logistic deliveries with Drones. State of the art of practice and research. Roca-Riu, M., Menendez, M. (2019)
- ↑ Analysis of Amazon Prime Air UAV Delivery Service. Sunghun, J., Hyunsu, K. (2017)
- ↑ Drones as a Threat to Wildlife: YouTube Complements Science in Providing Evidence about Their Effect. Rebolo, N., Grilli, M.G., Lambertucci, S.A. (2019)
- ↑ International Commercial Drone Regulation and Drone Delivery Services. Jones, T. (2017)
- ↑ Amazon’s Drone Patents. Michel, A.H. (2017)
- ↑ Stolaroff, J.K., Samaras, C., O’Neill, E.R. Energy use and life cycle greenhouse gas emissions of drones for commercial package delivery. (2018)
- ↑ Strategic Design for Delivery with Trucks and Drones. Campbell, J.F., Sweeney, D. C., Zhang, J. (2017)
- ↑ Drone Delivery Models for Healthcare. Scott, J. Scott, C. H. (2017)
- ↑ Framework for Autonomous Movement of Drones. Milhouse, M. O. (2015)
- ↑ / Vehicle Routing Problem with Drones for Last Mile Delivery. Kitjacharoenchai, P., Seokcheon, L. (2019)
- ↑ Zahy B. Ramadan, Maya F. Farah & Mona Mrad (2017) An adapted TPB approach to consumers’ acceptance of service-delivery drones, Technology Analysis & Strategic Management, 29:7, 817-828
- ↑ Murray, C.C., Raj, R., 2020. The multiple flying sidekicks traveling salesman problem: Parcel delivery with multiple drones. Transport. Res. Part C: Emerg. Technol.110 (February 2019), 368–398
- ↑ D. Schneider, "Air traffic control for delivery drones" in IEEE Spectrum, vol. 54, no. 1, pp. 32-33, January 2017
- ↑ Ivancic, W. D., Kerczewski, R. J., Murawski, R. W., Matheou, K., Downey, A. N., & 2019 Integrated Communications, Navigation and Surveillance Conference (ICNS) Herndon, VA, USA 2019 April 9 - 2019 April 11. (2019). 2019 integrated communications, navigation and surveillance conference (icns). In Flying drones beyond visual line of sight using 4g lte: issues and concerns (pp. 1–13). essay, IEEE
- ↑ A. G. Foina, R. Sengupta, P. Lerchi, Z. Liu and C. Krainer, "Drones in smart cities: Overcoming barriers through air traffic control research," 2015 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED-UAS), Cancun, 2015, pp. 351-359
- ↑ van Gurp, T. (2020, July 8). Pakketbezorging in 2019: meer volume, maar tarieven blijven dalen. Nieuwsblad Transport.
- ↑ [7]
- ↑ [8]
- ↑ [9]
- ↑ [10]
- ↑ [11]
- ↑ [12]