Revision as of 14:25, 24 March 2021

Project: O.W.L.

Team Members

Name	Student number	Department
Tristan Deenen	1445782	Computer Science
Jos Garstman	145722	Mechanical Engineering
Oana Radu	1325973	Computer Science
Ruben Stoffijn	1326910	Biomedical Engineering
Daniël van Roozendaal	1467611	Medical Science & Technology

Questions

Is the simulation part explained well or does it need a more detailed explanation? (we will include some pictures when the simulation is done)

Considering there is one week left, where do we stand with the project? Can we get a passing grade with what we have done so far?

Planning

Week 4:

Start on research model (Oana and Tristan)
Forest fire and detection (Daniel)
Introduction (Ruben)
Physical requirements of the drone(Jos)
Adding interview and planning(Jos)

Week 5:

Continue on model
Finish research week 4
User requirements (Ruben)

Week 6:

Continue on model
Legal suggestions and exemptions/privacy (Licence)

Week 7:

Finish up model
Final conclusion/protocol
Final presentation

Week 8:

Finishing up Wiki page

Introduction

With dry summers becoming more and more frequent in the Netherlands, the risk of wildfires is becoming substantial. Last summer, the biggest ever national wildfire destroyed 800 hectare of Deurnese Peel. ^[1] Eventually, the fire department got the fire under control. The Dutch fire brigade is currently experimenting with drones to fight fires. With a number of drone teams already operational, the fire department is making big strides in innovation. Currently, drones are used to support teams while fighting fires or evacuating buildings. The fire department has indicated that flying drones for fire prevention would save the most resources. They are not currently doing this, mainly because of a responsibility gap involving staatsbosbeheer and the fire department.[citation needed -> interview] Since looking after national parks is the responsibility of staatsbosbeheer and the fire department are experimenting with drones, we propose a plan for cooperation: Overhead Wildfire Locator. Where drones can be deployed to survey national parks during extreme drought and fire hazard. We will go over ways to automatically detect starting fires. A simulation will be performed to estimate drone response time and coverage. The drone specifications and hardware limitations will be explored. The level of feedback and control that the user will have is suggested. The legal and ethical questions regarding semi-automatic drone flight above nature reserves are addressed. All these points of attention come together to form a propositional protocol, that staatsbosbeheer can realistically use during extreme weather.

Forest fires and detection

It is believed that over 95% of all wildfires are not caused naturally but caused by humans, intentional and by accident. The main reasons found in a research in Santa Monica and San Diego are arson, power lines and sparks by cars or equipment. The area burned by a fire that was caused by arson was found to be the largest. https://www.publish.csiro.au/wf/wf14024

The average windspeed in the Loonse en Drunense Duinen over the year is around 4.0-4.5 meters per second (14-16 km/h). Loonse and Drunense Duinen is a combination of forests, grasslands and sandbanks so the speed of spreading of the fire will vary per location. https://www.knmi.nl/klimaat-viewer/kaarten/wind/gemiddelde-windsnelheid/jaar/Periode_1981-2010

Only information found on Dutch wildfires speeds: rule of thumb states that the speeds of the fire is the speed of the wind (in meters per second) times 100. The result is the speed of the fire in meters per hour. In open terrain (heide, grass) the speed is doubled. https://www.brandweer.nl/media/4058/bronnenboek_lvn_natuurbrandbestrijding_versie_24_juli_2014_definitief.pdf Also mentioned in this source: fire spreads with an angle of about 48 degrees in the direction of the wind. The "fire front" can spread in all directions and makes its own wind direction.

Using this rule of thumb, we would get a speed of up to 450 meters per hour in the forest and 900 meters per hour in the grasslands.

Area	Wind speed	Fire speed
Forest	4.5 m/s	0.45 km/h
Grass/heather	4.5 m/s	0.9 km/h
Sand	4.5 m/s	0 km/h

The temperature when a material will burst into flames (also called the flash point) of wood is 572 degrees Fahrenheit (300 degrees Celsius). https://science.howstuffworks.com/nature/natural-disasters/wildfire.htm#:~:text=Everything%20has%20a%20temperature%20at,air%2C%20combust%20and%20create%20fire.

Given the difference between this temperature and the average maximum surrounding temperature in the Loonse and Drunense Duinen being 23.5-24.0 degrees Celsius, any fire will easily be detected by an infrared sensor. Even in extreme temperatures of 30 degrees Celsius or higher, the difference with flaming wood will be around 270 degrees Celsius. This difference being so high means that even small, starting fires can be detected. https://www.knmi.nl/klimaat-viewer/kaarten/temperatuur/maximum-temperatuur/juli/Periode_1991-2020

Forest fire detection is typically performed by some combination of watchtowers, aerial detection patrols and satellite imagery. Watchtowers have to be carefully placed to be have enough visibility to be useful, they are often expensive to build and it is not very flexible as the view is permanently decided once a watchtower stands. Satellite images play an important role if fire management and strategic fire intelligence as it covers a lot of territory and can detect medium to large fires using (semi) automated algorithms. Some exceptional satellites can even be used to detect small fires but overall satellite visits are often too infrequent and the image resolution makes detection of smell, developing fires difficult. The time lag of a user receiving data from satellites can take hours and weather can limit availability of satellite data, making it inconsistent and unusable for fire detection.

Heat detection is an obvious method of detecting fires in natural areas. Normal temperatures are on the thermal infrared (TIR) region. Higher temperatures like that of typical fires, are on the mid-wave infrared (MWIR) of shorter wavelengths. Many sensors detect near infrared (NIR) and shortwave infrared (SWIR) and can be used for detecting fires. Large clouds of smoke, caused by forest fires, can be detected on standard cameras when there is enough light but these still have to be identified by humans. In the dark, fires can also be detected using night vision goggles (NVG).

more info here, very useful source… https://www.mdpi.com/1424-8220/16/8/1310

Detection speed importance

If we divide the response time up in periods of 10 minutes, we can calculate how much effect each 10 minute periods have on the size of a wildfire. For this calculation, we are going to approximate a fire as an expanding circle. Every time 10 minutes pass, the amount the fire grows is bigger because the same increase in diameter of a circle is bigger if the original circle already was bigger. If we use the speed of fire spreading being 14 mph, we will get around 23 km/h which gives us around 4 km for every 10 minutes. The first time period starts as ignition and after this period we have a circle with radius 4. The radius increases with the same amount every time period. The results are shown in the table below.

Time period	Radius (km)	Area (km^2)	Area difference (km^2)
1	4	50	50
2	8	201	151
3	12	452	251
4	16	804	352
5	20	1257	453
6	24	1810	553
7	28	2463	653
8	32	3217	754
9	36	4072	855
10	40	5027	955

Every 10 minutes that pass are more destructive than the past 10 minutes. The difference in growth is around 100 squared kilometers every time period. This exponential growth shows the importance of a speedy notification to the fire department.

Taskforce Natuurbranden

As a result of the escalated fires at the Kalmthoutse en Strabrechtse Heide, a taskforce was formed called “Taskforce Natuurbranden” (Taskforce Wildfires). This taskforce was initiated by Bas Dikmans in North-Brabant. It is specialized in analysing what has happened before and how it can be prevented in the future. The local municipality, fire department and the area administrator have to perform what is necessary in the area themselves, the taskforce is only their collaboration when they are involved in planning. Once a year, mayors have to pledge accountability to the King’s Commissioner.

In 2020 multiple wildfires collectively burned over 1000 acres of wild areas in Brabant. The taskforce used these fires to conclude that the long drought, heat and strong winds form a risk in the Netherlands and that wildfire prevention is a form of climate adaption. Important points of wildfire prevention include local fire brigade knowing their way in the area, emergency services easily being able to go in and having enough water for extinguishing close by. Not only easy access for controlling fire is important. The kind of trees in the area can be a factor for example. Conifers (naaldbomen) are more flamable than deciduous trees. Since human ignition is the main cause of wildfires, more human visits means a bigger risk of fires but at the same time this means faster notifications to the fire department. Mobile service is very important in these risky areas to get the notification through.

Keeping nature wet and placing so called water buffering areas is very important for prevention. According to Robby Brekelmans the high sandbanks in North-Brabant are very susceptible to drought, that’s why it’s so important to shape the water system in a way that the water can be held in place to avoid this drought.

https://www.klimaatadaptatiebrabant.nl/k/n442/news/view/3110/2025/preventie-van-bosbrand-is-een-vorm-van-klimaatadaptatie.html

Type of drones

Currently there are around four main types of drones. Namely single-rotor, multi-rotor, fixed-wing and fixed-wing hybrid drones. All these types have different their own strengths and weaknesses and depending on the usage one might prefer one over the other. In this section a run-down of these four main types will be given, mentioning both their pros and cons.

Multi-rotor drones
Multi-rotor drones are surely the most popular drones on the market. They are good starter drones because they are cheap and easy to use. They have multiple rotors keeping them up, can take-off vertically and have great control in the sky with the option to hover in place, this way the surrounding area can be observed for a longer time.

There are, however, also quite some downsides to this type of drone. A multi-rotor drone is constantly fighting gravity to stay up in the air. This requires a large amount of energy and is generally not very efficient. A multi-rotor drone with a light payload can only stay in the air for around 20 to 30 minutes. On top of this the design of this type of drone also limits their speed. Currently they are also restricted to the use of electric motors.

All in all a multi-rotor drone is a cheap way to get an aerial view of the nearby area for a short amount of time, but they are not suited for long duration flights over long distances

Single-rotor drones
Single-rotor drones are of course quite popular in manned aviation, but are not that widely available in the drone world. It has a single rotor with a tail rotor to control direction. A single-rotor drone is much more efficient than a multi-rotor drone because it has one much larger rotor instead of several smaller ones. Next to this they can also be powered by a gas motor for even longer flight times. Also they can carry much heavier payloads than multi-rotor drones.

The downsides of single-rotor drones are that they are much more complex and harder to handle. The cost and maintenance are also quite high because of the mechanical complexity of the copter. Finally the longer, sharper blades of the single-rotor are much more dangerous and can deal some serious damage.

Fixed-wing drones
The main difference between rotor-drones and fixed-wing drones is that a fixed-wing drone uses wings to generate lift instead of rotors. This way a drone only needs to create forward momentum and takes advantage of physics to stay up in the air and increase efficiency and speed. because of this big increase in efficiency and speed fixed-wing drones can stay in the air for longer and thus cover much larger distances than rotor drones. Additionally a gas engine can be used as power source for even better endurance. This way some fixed-wing drones can stay in the air for more than 16 hours.

The main disadvantage of fixed-wing drones is that they cannot hover on the spot and are always moving forward. It is much more difficult to survey one area and take a closer look if more info is needed. Also take-off and landing is more difficult because of the high speeds. Depending on their size a runway or catapult are needed to launch them into the air and either a runway, parachute or net are needed to retrieve them again. Some smaller drones are capable to be launched by hand and land safely on their belly in a field. Some other cons are their higher costs and difficulty to control.

Fixed-wing hybrid drone
A fixed-wing hybrid drone combines the main advantages of rotor and fixed-wing drones. These types of drones are also called VTOL's, which stands for Vertical Take-Off and Landing. These types of drone do not need a runway or catapult to take-off but can tilt their rotors or switch between rotors to take-off and land vertically, but fly like a fixed-wing drone. Currently there are not many hybrid drones on the market but several companies such as amazon are doing research into this type of drone for delivery purposes.

The combination of the two types of drones means it is not perfect in either hovering or forward flight, but the option to hover greatly increases its functionality.

https://www.auav.com.au/articles/drone-types/
file:///X:/Downloads/COMPARISON_OF_A_FIXED-WING_AND_MULTI-ROTOR_UAV_FOR.pdf

Drone Functionalities

For the drones to be able to successfully survey an area and detect hotspots they will need to have certain qualities. In this chapter a list of functionalities will be given and explained in further detail. Several options will be laid side to side and recommendations for the drone will be given. The following functionalities are needed for the drone:

Detection of temperature difference to spot beginning fires
Detection of surrounding environment for additional information
Path-finding and collision detection
Communication of data with main operating base/main operator
Large range and long battery life to patrol surrounding area
High visibility for surrounding environment
Low noise for surrounding environment
Optional: means to delay and/or extinguish beginning fire

Sources (To be referenced)

Allison, R. S., J. M. Johnston, G. Craig, and S. Jennings. 2016. “Airborne Optical and Thermal Remote Sensing for Wildfire Detection and Monitoring.” Sensors 16 (8): 1310–1339. doi:10.3390/s16081310.
Colomina, I.; Molina, P. Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS J. Photogramm. Remote Sens. 2014, 92, 79–97.
https://www.researchgate.net/publication/334418384_Early_Forest_Fire_Detection_Using_Drones_and_Artificial_Intelligence

Detection of temperature difference to spot beginning fires

To prevent a full scale wildfire from occurring, hotspots have to be detected as fast as possible. The detection of hotspots can be done by measuring the temperature of the environment, since a beginning fire will have a higher temperature than its surroundings. This temperature difference can be measured in a multitude of ways and sensors, but not all are fit to be attached to a drone. For a sensor to be effective on a drone it needs to be long range, accurate and to be relatively stable at higher velocities.

For the case of detecting areas with increased temperatures, only two methods seem viable. A classic thermometer could be used to measure temperature differences, but this would lead to some difficulties. A drone will have to get quite close to its target for a thermometer to detect a temperature difference. Next to this it can only measure one temperature at once. The other option would be to use an infrared or thermal camera. An infrared sensor is a non-contact sensor which measures the radiation of objects. When attached to a drone it can detect this radiation from a long range with fairly high accuracy from multiple objects. Then in one image the different temperatures in the area can be seen. In the past it has been used in tasks such as surveillance, search & rescue and also firefighting. There are however many different specifications for a thermal camera and dependent on the use of the camera the choices made will be different. An overview of the specifications and which are important for locating hotspots will be discussed in the following paragraph.

Thermal camera

By patrolling and scanning the area, a thermal camera can create thermal images compare these to detect hotter areas in the landscape. Closer inspection can be done to confirm if a starting fire is present. There are some key aspects to think about when deciding which thermal camera is a good candidate. The main specifications to think about for a thermal camera are the following:

Weight
Radiometricy
Degrees of freedom
Thermal range and sensitivity
Infra-red resolution
Spectral range
Camera lens

First of all its weight. A bigger, heavier camera needs a bigger drone to carry it. At the same time a heavier payload will cause for a shorter air time of the drone and thus the need for a bigger battery pack. When deciding upon which camera to choose, a lighter camera would be optimal.

Secondly radiometric vs non-radiometric. A non-radiometric thermal camera only display a thermal image while a radiometric camera also provides the temperature measurements. For the purpose of finding hotspots and fire-prone areas a radiometric camera greatly improves performance. These cameras can give a warning whenever a certain threshold temperature is crossed, at which point the drone could act immediately.

Next is a stable camera or one attached to a gimbal. When a camera is attached to a gimbal it gives the drone or operator more control over the cameras movement. A gimbal makes it easier to survey the area without having to turn the entire drone

Furthermore the range and thermal sensitivity of the camera. The range means the entire span of temperatures the camera can measure. For the purpose of finding fire-prone areas a lower range is sufficient. The thermal sensitivity of the camera describes the smallest temperature difference you can see with the camera. This means that the lower the number the better the thermal sensitivity is and the better it can detect temperature differences. For this case a low sensitivity is not necessary, since there will generally be wide temperature differences.

IR resolution is also important when choosing a camera. A higher resolution means that the image created contains more detail and information. Especially for longer distances, like a drone surveying the area, a higher resolution is necessary to measure everything in enough detail.+

Finally the spectral range of the camera. This is the range of wavelengths that the camera detects, measured in micrometers. Almost all thermal cameras are longwave cameras which have a spectral range of 8 to 14 micrometers and are appropriate for finding fires.

^{[citation needed]}

Colomina, I.; Molina, P. Unmanned aerial systems for photogrammetry and remote sensing: A review. ISPRS J. Photogramm. Remote Sens. 2014, 92, 79–97.
- Paper about current state-of-the-art UAS and remote sensing. Talks about several sensors used for different spectrums, including thermal imaging. Also mentions different types of drones used for different aspects.
- Also talks about Autopilot and navigation systems

Camera lens

Another important part of the thermal camera is the type of lens. The lens has an impact on the resolution and field-of-view of the camera. The type of lens that is used depends heavily on the situation it will be used in. In the case of a fire-seeking drone, the camera will be at a reasonably high altitude and will need to scout as much area in as little time as possible for maximum efficiency.

First of all the height of the drone. Since the distance to the ground, the target, will be relatively large the thermal images might not that have that much detail. To increase this detail the thermal camera will need a higher resolution. A higher resolution means that there will be more pixels in the image, therefore the area that one pixel represents becomes smaller and thus more detail in the image.

Next the field-of-view of the camera(FoV). FoV means the amount of degrees the camera can observe. A bigger FoV therefore means that the camera can observe more at once, however smaller objects at a larger distance will be more difficult to spot. For the UAV to be able to patrol the largest area a wide FoV is optimal.

When deciding upon which type of camera and lens to use a balance between the amount of detail and the FoV has to be found. For the finding of hotspots the amount of detail is relevant, but the image does not have to be extremely detailed. Once a general hotspot has been detected the drone can be used to investigate further in that area. Still the highest possible resolution is recommended for maximum detail possible. A standard FoV of 45 degrees is recommended to be able to scan a wide area while still keeping high detail.

Detection of surrounding environment for additional information

On top of a thermal camera sensing the temperatures below the drone, an additional camera is used to for observation of the surrounding area. This camera can be used by an operator for further inspection or to fly the drone if necessary. For example once a increased temperature is detected a drone operator could check if there is no false positive at play, by taking manual control using the camera to pilot the drone and check the area. Furthermore, the camera could check the horizon for smoke plumes, indicating a fire could be present at that location.

Path-finding and collision detection

For autonomous patrolling of a certain area, sufficient GPS and navigation systems have to be in place. These systems should be able to follow specific flight paths with are predetermined or autonomous flight paths could be implemented based on previous data of hotspots. Collision detection should also be part of the UAV's sensors to avoid collision with wildlife, other aerial vehicles or other objects. Most consumer drones have integrated collision detection, however most only in front of the drone. There are only a few drones that have collision detection in all six directions.

https://www.sciencedirect.com/science/article/pii/S0924271614000501#s0040\

Communication of data with main operating base/main operator

Once a hotspot or starting fire has been detected, this information has to be relayed to the main operating base or fire brigade. This communication should be fast, high quality and over a large range. Communication with a drone is most often done via radio-frequency transmissions. These kind of transmission can include the location, battery life, distance, payload information and much more data, including (live) video. Next to data transmission, the UAV is also controlled via radio-frequencies. Three main data link systems can be distinguished for drones:

UAV control
Video transmission
Telemetry

Radio communication

Before diving deeper into the data link systems, a further look into radio frequencies is needed. There are a couple frequently used frequencies, with each a common use based on their capabilities regarding object penetration and range. In general, the lower the frequency, the longer the wavelength and the greater the penetration into objects and the longer the range. However, a lower frequency means there is limited maximum data rate, meaning only lower quality data can be transmitted. The most common radio frequencies used are:

900MHz
1.3GHz
2.4Ghz
5.8Ghz

For UAV control the most popular frequencies are 2.4Ghz and 900Mhz. Most consumer drones fly on 2.4 Ghz, which has a range of around 1.6 to 6.4 kilometers. The penetration of this frequency is quite low hoever and it will have difficulty flying in areas with many buildings, mountains or forests. 900Mhz has a much longer range from 20 to sometimes even 100 kilometers, including a much higher penetration.

Video transmission is a bit more tricky, since 900MHz is unable to transmit good quality video. The most popular frequencies used here are 1.3GHz, 2.4GHz and 5.8GHz. The same properties from before hold, 1.3GHz has a long range up to 60 kilometres and high penetration, but will only be able to transmit poor video quality due to the limited data rate. 5.8Ghz is the opposite, it will give the clearest and highest video quality, however it's range will be around 10 kilometres with low penetration capability. 2.4GHz is the balanced option, giving decent video quality on a range of around 25 kilometres. The downside of this frequency is that it is often used for controlling the drone as discussed previously. Only one can use this frequency or there will be interference.

For remaining data lower frequencies such as 400MHz and 900MHz are used. This data does not need the high data rate of video so lower frequencies can be used for maximum range and penetration.

https://www.911security.com/learn/airspace-security/drone-fundamentals/drone-communication-data-link

LTE Communication

LTE communication is still an experimental way of communication for drones and currently not yet fully operational. LTE stands for Long-Term Evolution and is part of the cellular network. The idea is to control and communicate with UAV's via 4G as an alternative to radio control. The advantages of LTE is that the network is connected to satellites and broadcasted via towers. This greatly improves the distance limitations and improves long-range communication with drones. The challenges currently for this type of communication are however that these networks can be quite unstable and good network connection is needed for real-time drone controlling. There is also quite some infrastructure necessary to be able to use this communication. There are however promising experiments and research papers on the use of LTE communication for drones and will likely be a viable option in the near future.^{[citation needed]}

Large range and long battery life to patrol surrounding area

To be able to monitor an entire nature reserve or forest, a big enough range to cover the area is needed. The range of a drone not only depends on the speed and flight time of a drone, but also its data communication range. First of all the speed and flight time of the drone. In the chapter "types of drones"(In page link?) a distinction between flight range has already been made. Fixed-wing drones use their wings to create lift and therefore preserve battery life. Next to this battery life is dependent on multiple other factors such as drone weight, wind, altitude and camera use.

Factors such as wind are of course uncontrollable, but to other factors extra attention should be paid, such as weight. The weight of the drone should be kept as low as possible to increase flight time. A lighter drone means the propellers or wings need to create less lift to stay up and the drone can generate more speed. Camera use is also an important factor for the case of hotspot detection, since it will require continuous camera use. This will take a toll on the battery life.

Depending on the type of drone, the flight time will be between 20 to 30 minutes for rotor-designs up till 16 hours for fixes-wing drones. After this time limit the drone will have to return to recharge or change its battery. During this time there will be a gap in the surveillance of the area. To get continuous or near continuous monitoring multiple drones or pre-charged battery packs should be available. The moment a drone returns to recharge another drone can leave to take over its job. Another possibility would be for an operator to quickly switch battery packs so it can continue on its way. Some research^{[citation needed]} is being done into automating the process of swapping battery packs for drones. In the future this could be implemented to reduce workload on on-site operators or completely automate the operation.

The flight time is often not the limiting factor of drone range, but the data communication range is, as discussed in the previous section.

Range does not only depend on how big the area is you need to cover, but also from where you are controlling the drone. If the main base is in the middle of the area, the radius does not have to be as large as when the main base is on the outskirts of the area. When surveying a nature reserve however, a drone station in the middle of a park could not be a possibility because of disturbing wildlife or building restrictions.

https://www.altiuas.com/FAQ.html

High visibility for surrounding environment

The UAV should have high visibility so wildlife or other aerial vehicles can see it coming This can be done by means of lights and reflective strips. Also bright eye-catching colours can be used for the drone to stand out from the environment. To preserve battery life the use of lighting should be kept to a minimum and preference is laid upon bright colours and reflective materials.

Low noise for surrounding environment

Noise should be kept to a minimum if the UAV is flying in nature, both for surrounding wildlife but also hikers or other civilians. Current consumer drones generally create noise between 70 and 80 decibels. This equal to quite loud traffic and excessive noise levels start generally at around 85 dB.^{[citation needed]} Of course the level of noise depends on distance and the dB level will drop over distance. The rule-of-thumb for the drop-off distance is that sound decreases by 6 dB every time the distance doubles.

^{[citation needed]}

Now how a quiet a drone has to be depends on the ambient noise levels which differ per area and time of day. Generally during day time in a busy city centre the ambient noise level will be much higher than at night in a rural forest. Since the surveillance drone will be flying in nature reserves the noise it generates should be quite low. The ambient noise level in a rural area generally do not drop below 45 dBA at day and 35 dBA at night. The ideal noise range for a drone would therefore be 35-45 dBA.^{[citation needed]}

To reach this level the drone could of course fly very high, but this would decrease the detail of the thermal camera and would make it difficult to detect hotspots. Therefore the drone has to be designed in such a way that the noise level is reduced. Reduction of propeller noise can be achieved by increasing the diameter of the propeller while also reducing the rotational speed. This means the blade tip speed is reduced while maintaining enough thrust.^{[citation needed]}

https://www.airbornedrones.co/drone-noise-levels/

Optional: means to delay and/or extinguish beginning fire

The main purpose of the surveillance drone is to monitor the area and find hotspots or starting fires. As discussed before the flight time needs to be as long as possible to have the most continuous surveillance. To preserve battery life the drone has to stay as light as possible. Therefore the addition of a system to delay or extinguish fires is not necessarily a beneficial addition to the drone. A quick response drone could be designed to respond on the signal of the surveillance drone to start extinguishing the fire, but for this case such a system is not worked out and discussed.

Budget (not sure where to place this)

To give an estimation of the costs of project O.W.L. a minimum price for various parts of the project will be given. Thermal camera:

FLIR Vue Pro R 650X512
Price: ~€3000,-

UAV:

ALTI Transition?
AVY Aera? (dutch drone)

User requirements

Stakeholders

Scouting for fires preemptively benefits multiple stakeholders, and their responsibilities are intertwined. Staatsbosbeheer’s primary task is maintaining nature parks across the Netherlands, so they are responsible for monitoring their reserves closely for fires. The people that hold this task are the foresters. The Dutch fire department is responsible for extinguishing fires. During an interview they have stated that the largest strides can be made in fire prevention. Since wildfires require great resources, preventing them will be beneficiary.

Users

In the early stages of transitioning to drone monitoring for nature reserves, the users will most likely be certified drone pilots. Teams of which the fire department already deploy nationwide. This is necessary because of strict European drone regulations. When, in the course of a few years, reliable autonomous drones can be deployed, the user requirements will most likely become less strict. Allowing foresters to use the system themselves. Because of this predicted shift in userbase, user requirements will change and evolve over time.

Degrees of user requirements

Because drone technology and legal restrictions change over time, drone usage is dived into multiple stages. Note that these stages are not strictly exclusive and overlapping is possible.

Total control

This stage is an example of how drones work in the field currently, for example at the fire department. Current drone regulations require certified pilots. They are this stage's users. Combatting fires usually requires a team of two or three professionals. One for piloting the drone, another for camera controls. The last optional member handles technical problems and helps with the drone setup. Since our goal is surveillance instead of reconnaissance, this solution requires the full attention of at least two pilots, for the largest part of a day. It goes without saying that this is very strenuous and monotonous work. Furthermore, it is not clear if the money is available to pay three full time employees.

The feedback these pilots will recieve is very rudimentory. The drone controlling pilot gets access to images obtained from a front facing camera. This helps pilot the drone from beyond visual line of sight, as well as noticing smoke from far away. The second pilot has control of a thermal camera. They can rotate it and angle it up and down. They arguably have the hardest task, which requires constant evaluation of thermal images for dangerous temperatures. Both video signals are usually fed back to the controllers, but feedback to a computer system is also possible.

Semi-autonomous

This stage, semi-automous, aims to scale the drone team down to only one pilot. This is achieved by automating some simple procedures.

Drones that move automatically already exist, but are not used in any professional fire combatting applications. Since our goal is surveilance, drone movement is not complex and requires only large-scale routing. What we propose is that the pilot brings the drone to a height that oversees the entire nature reserve. Now, the pilot can activate automatic routing mode. This entails that the drone stays at a fixed height and flies directly to specific coordinates. These coordinates, or waypoints, can be manually selected by the pilot. This requires licensed sofware or custom software specifically made for this purpose.

The workload of the pilot will consist of the following tasks:

Patrol route selection
Manual drone takeoff
Thermal camera control and image surveillance
Manual drone landing
Battery pack replacement

Feedback will be provided in two major ways: live camera feed from both cameras and real time GPS drone location on a map of the area.

Advanced semi-autonomous

This stage, as the name implies, is an advancement on the last. It cuts eliminates more workload on the surveillance functionality. Since the camera motion is simple and easily programmable, it can be automated with an efficient search strategy in mind. It can sweep around by itself and scan a large area without the need for manual control.

The next step in automating the surveillance task is automatic fire detection, which is explained in detail in link to other heading. The main idea is that the drone supervisor is alarmed when dangerous temperatures are detected. These cameras exist already commercially, mainly for use in factories and other work environments with possible failure due to high temperatures. ^[2]

With current regulations, the person supervising the drone still needs to be a licensed pilot. Their only task requiring drone piloting is take off, landing, and taking over manual control when routing goes wrong. This greatly reduces the workload on the pilot's part.

Fully autonomous

A fully autonomous system would reduce the responsibility of the user to the bare minimum. The fullest extent of autonomy regarding drone surveillance reaches to complete unsupervised take-off and landing and guaranteed safeguards for GPS malfunction. Because the supervisor would not need to intervene, they do not need to be licensed pilot. This does, however mean the person activating the drone cannot be responsible for whatever actions it takes. You could agree that activating the drone in and of itself makes that person responsible, whether or not they have a drone pilot's license. Another party that could be responsible would be the manufacturer. If implementation of fully autonomous drones is only allowed with a complete guarantee for safety from the manufacturer, they would be held responsible for any violations. Most realistically, both parties come to an agreement before activating the system. The manufacturer can provide guidelines, within which the drone is guaranteed to behave safely. If the drone malfunctions while these guidelines are being honored, the manufacturer is responsible. If the guidelines are breached, the user is.

European drone regulations

Since December 31 2020, the Netherlands follow European drone regulations. These new regulations divide drones in 3 separate categories: Open/zero, specific and certified. Normal consumer or hobby drones usually fall in the open category. These drones have a few restrictions^[3] ^[4] :

Maximum weight: 25 kg (at takeoff)
Maximum height: 120 meters
No transporting hazardous material
No dropping materials
Always have visual line of sight

There are subclasses for the first category, depending on the weight of the drone. Most relevant is subcategory A3 which concerns drones from 2kg – 25kg. With normal regulations this category cannot fly 150 meters near any living, trade, industry or recreational zones.

The next category, specific concerns flights that:

May be near people
May fly near airports
May have a weight above 25kg
May fly in inhabited environment
May fly above a height of 120 meters
May drop materials
May fly beyond visual line of sight (BVLOS)

Drones deployed by the Dutch fire brigade fall under the specific category^[5], and more than likely, will be used by the forestry department as well. Obtaining authorization for flight needs to be done at the national aviation authority. The Dutch fire department has broader permissions regarding drones because of the fact that they have a specific flight originization.^[6] Prior to this, the Dutch fire brigade had unique exemption from specific drone laws granted by the government. ^[7] Before testing and small scale rollout of the surveillance procedure is takes place, such a temporary exemption can probably be attained.

It is also worth noting that the people controlling these drones need to be certified pilots. The Dutch fire brigade already has an official training program for aspiring drone pilots . It would not be unrealistic to expand this training to other applications as well.

Captured data

Once images have been taken, there can be conflict. This depends on the fact whether or not it contains personal data. This is the case when someone is visible on the images and is recognisable with reasonable effort. With a thermal camera this would hardly be the case. Also based on the distance between people on the ground and the angle (mostly seeing top down) recognising people with the thermal camera would be very unlikely.

With a normal camera however, it is quite possible that images are taken and people will be recognisable. In this case there is personal data being recorded when someone is recognisable on the drone footage. This is an infringement on the privacy every person in entitled to.

Personal data can be proceeded to be used only if this data is used for the original goal of the footage. For example when footage of a concert is taken for promotional purposes, it is allowed to use this even if this is personal data because of people being recognisable in the footage. However, this footage is not allowed to be used later on for purposes like identifying people visiting the concert. This is a goal unrelated to the original goal of the footage. https://www.rijksoverheid.nl/binaries/rijksoverheid/documenten/rapporten/2015/12/02/tk-drones-en-privacy/tk-drones-en-privacy.pdf

Drone state-of-the-art

A company named DJI Enterprise currently produces drones that firefighters in the USA use. Namely, the Mavic 2 enterprise advanced is used. These drones mainly help with urban fires, wildfires, and HazMat Operations. For urban fires, they help by:

Fly over buildings and obstacles, and see through smoke with thermal cameras to help prioritize targets
Stream live video intelligence back to command centers to align teams and eliminate uncertainty
Leverage high-resolution cameras to remotely monitor remaining threats and document damage for future analysis

https://www.dji.com/nl/mavic-2-enterprise-advanced

Another company named Parrot produces a drone named ANAFI Thermal. This professional drone also offers a high quality thermal camera that could potentially be used by firefighters. Details about the drone's features: https://www.parrot.com/assets/s3fs-public/2020-07/bd_anafi_thermal_product-sheet_02_a4_2019_04_10-1.pdf

Both of these drones are pretty similar, and are also used in similar ways. Because of their great mobility, these drones offer live feeds via great vantage points. Furthermore, they can instantly swap from a normal camera to a thermal camera, offering vital information that would otherwise be hard to detect. Drones are not really used for going inside though. For now, they are just Mostly equipped with lots of cameras and other sensors to quickly collect as much data as possible. One bottleneck is that operators of the drones need an ample supply of batteries. Also, these drones function to a temparture up to around 40 degrees Celsius, which is not enough for buildings on fire

Simulation

The purpose of the simulation is to check whether a drone can detect small fires outside of cities and notify the forest rangers and/or the firefighters. We decided to make the simulation in NetLogo because it has all the functionalities needed, especially the function “import-pcolors”, which copies a picture on top of the patches and gives each patch the corresponding color from the picture.

To test if the drone can detect a fire in time, we decided to use the National Park Loonse en Drunense Duinen because it has a forest, sand and grass which have a different impact on the growth of the fire. We took a screenshot from the satellite view of the map of approximative 5.72 km2 (2.6km x 2.2km). We placed a drone, a base and 2 charging stations. The coordinates of the charging stations and the base will be decided later and the drone will start from the base. We also created a fire, by changing one of the patch’s color into red.

All patches have 2 variables fire and grow. Variable fire can have values 0, 1, 2, 3, or 4. Value 0 means there is no fire, and the other values denote a fire in that patch, with intensity from 1 to 4, 1 signifying a fire that just started and 4 signifying that the fire in the respective patch reached maximum intensity. At the start of the simulation, fire=0 for all patches. When a patch has value 3 or 4, the patch above it, below it, to the left and to the right will turn red, showing that the fire has spread. Those patches will have fire=1.

Variable grow keeps track of the time, symbolized by ticks. At the beginning of the simulation all patches have grow=0. After each tick, grow is increased by 1 only for the red patches. When grow reaches to 3, the intensity of the fire increases and grow gets reset back to 0. Both the values of grow and fire will be changed with more accurate values to create a more realistic scenario. For now, we placed a fire only in the forest. When we will know how fast the fire grows and other fire related facts that might impact the results, we will adapt the variables depending on the environment the fire is in.

The drone has two types of cameras; one short-ranged, broad camera which is able to see the details of the ground, and one long-ranged, narrow camera, which can be used to detect smoke. For the user's convenience, the areas that the drone can scan, are highlighted on the map.
Each tick, the drone checks with its short range camera on what kind of area it is flying over. When more than half of the patches that are checked are sand, then it makes 90 degree right turn, otherwise it moves forward.
The long-range camera only scans for red patches. This is is to simulate that it can only see smoke. When such a red patch is detected, then the drone immediately starts flying in that direction. With the short-range camera, the drone can accurately guess the coordinates of the fire. So when the short-range camera detects a red patch, it sends the coordinates the drone operators, thus ending the simulation. Of course, the specific specs for the camera, drone speed and searching strategy are liable to change.

Update:

We introduced a new variable: wind, which can take values from 0 to 4 included. 0 means there is no wind, 1 means the wind is coming from west, 2 means the wind is coming from east, 3 means the wind is coming from north and 4 means the wind is coming from south. The value of the wind is selected randomly. If wind = 1 the fire will expand more to the right and so on. The value for wind is chosen at the beginning of the simulation and remains constant for the rest of the current simulation.

The drone scouts randomly the selected zone, visiting the areas with grass or forest more often. If the person at the base thinks some areas need to be checked by the drone, it can click on a point on the map and sends its coordinates to the drone. Then, the drone will go towards that location. More locations can be sent and the drone will visit all of them, visiting the closest one first. The coordinates of each location are kept in a list, as well as the distance from the drone to that location. The distance is calculated using Pythagoras’s Theorem. Each location is kept in another list, called destinations. When a new location is added to the list, the distance from the drone to each location from destinations is updated and the list is sorted in ascending order by the distance to each location the drone has to visit. When the closest location has been visited, that location is removed from destinations and the drone will go check the next location. If there are no locations left to search, the drone will scout the area. The forest rangers should have a database with the location which have been on fire, to make the drone visit those first.

We introduced another variable: battery. With each thick, battery is decreased by 1. When the battery is smaller than the distance to the closest base, the drone will go to that base and its battery will get replaced. This is not finished yet.

To do next week:

Finalize the battery and charging of the drone
Replace certain variables with real values
Test the simulation to see how many stations are needed and if the drone can detect the fire in time

Protocol

In this section, a detailed look at how O.W.L. can be implemented is given. Every suggestion made is based on conclusions drawn from previous headings.

The team

The O.W.L. team consists of three members during the first phase of implementation. These members are certified drone pilots with the capability of flying fixed wing drones in line with European regulations. Training such pilots usually takes one week. Some additional training is required to understand the specific tasks that come with the job.

Since the O.W.L project is only active during dangerous weather conditions, when wildfire risk is high, the pilots are only needed a small portion of the year. An inconsistent schedule makes training and employing the right people difficult. Some groups to consider for the program are volunteers or students. Or indeed any people who are available during extreme heatwaves or drought. Most ideally the team consists of at least one firefighter with drone experience. To this end, an agreement between staatsbosbeheer and the national fire department can be arranged. Both parties will benefit from such a contract.

The drone

The right drone for the job is a fixed-wing hybrid drone. There are quite some suitable options such as the ALTI Transition^{[citation needed]} or the Avy Aera^{[citation needed]}. Combining the efficiency of a fixed-wing drone and the mobility of a multi-rotor drone it will be able to survey a larger area for longer at once while also being able to land and take-off almost everywhere. With endurances of up to 12 hours and ranges of 70 or more kilometers, virtually any area in the Netherlands can be patrolled.

A payload capacity of up to 1.5 kilograms makes it more than suitable to carry the FLIR Vue Pro R radiometric thermal camera, which weighs around 150 grams. The Vue Pro has a resolution of 640x512 giving the most precise temperature readings. The camera is also attached to a gimbal for complete control and high flexibility.

Control and communication with the drone will be done via radio frequencies. Depending on the size of the area a choice on which frequencies used can be made. For a range smaller than 10 kilometers a control frequency of 900 Mhz and a data communication frequency of 5.8Ghz is recommended. This gives best video quality, however minimum interference is necessary, therefore an antenna has to reach above the treeline or other obstructions to retain line of sight. For a range larger than 10 kilometres the data communication frequency is reduced to 2.4Ghz, increasing the range to around 25 kilometres while still able to send decent video quality.

System installation

(Mention charge stations, amount of battery packs, need for electricity, location, (other hardware))

Average work day

When the project starts, technology for automated drone flight is not regulated. Therefore, the drone needs to be controlled by humans at all times. There are three roles that need to be filled: pilot, camera operator and supervisor. To combat fatigue and monotony, these roles are rotated periodically.

When a person fills the pilot’s role, they are in control of the drones movements. They have access to a standard drone controller and regular video live feedback. On top of this, a map with the drone’s GPS location is also available. They need to follow the predesignated flight path, marked by waypoints on the real time drone location map. The camera is in place to assist with precise movements, such as: take-off, landing, turning and height control. The regular camera feed also doubles as a wildfire detection device. If a fire escalates to the point of visible smoke formation, this camera can assist in long range detection. This is by far the most work-intensive role of the team, requiring drone piloting, large scale maneuvers and smoke surveillance at the same time. Therefore, a maximum time of one hour is recommended.

The second role, camera operator, has less tasks to carry out. They are in control of the zoom, mode and movement of the thermal camera. They are trained to optimize the area under surveillance with clever use of camera movement. They are also the primary means of fire detection. They can detect fires based on live thermal camera feedback. They need to be aware of the camera’s rotation with respect to the drone as well. Because when something that is suspected to be a fire is spotted, they need to inform the pilot to take a closer look. Most of the time, this task consists of evaluating live thermal camera feedback, which can induce inattentiveness, because of its monotonous nature . This is why this role needs to be switched out regularly as well.

The supervisor is the last role in an O.W.L. team. It is their task to more generally keep overview over the entire process. They help with reviewing the drone route and make sure no risky areas get overlooked. They are also responsible for charging the back-up batteries. A supervisor can fill in for another role if a team member needs to take a bathroom break. The time a team member spends as supervisor can be used to eat lunch as well. Because this role has the least work-load by far, it is also in place to mentally refresh the member and allow them to take a break.

As mentioned before, it is advised that a team rotates roles every hour. This allows them to stay alert more often and relieves the workload substantially. Because piloting the drone involves the most risks and requires optimal attention, the supervisor switches to pilot every hour. This leaves the following rotation: supervisor → pilot → camera operator → supervisor.

How drastically will the current system be improved? (not final heading title)

Protocol in case of emergency

Fire detected

How quickly is a fire confirmed, how will the fire department be informed?

Drone malfunction

(and other drone related incidents?)

Roadmap for the future

Drone

Better communication, longer range and better quality
Longer endurance
Better thermal camera's, higher resolutions
lower noise
More autonomous

Papers

Evaluation of a sensor system for detecting humans trapped under rubble: a pilot study

In this paper, a sensor system for human rescue including three different types of sensors, a CO2 sensor, a thermal camera, and a microphone, is proposed. The performance of this system in detecting living victims under the rubble has been tested in a high-fidelity simulated disaster area.

CO2 sensor is useful to effectively reduce the possible concerned area.

The thermal camera can confirm the correct position of the victim.

The use of microphones in connection with other sensors would be of great benefit for the detection of casualties.

An algorithm to recognize voices or suspected human noise under rubble has also been developed and tested.

Currently, rescue teams use life detection systems mainly based on microphones, optical/thermal cameras, and Doppler radar.

Audio signal analysis is an effective method to detect humans trapped under rubble, and some systems are already commercially available, such as the Acoustic Life Detector, which is based on audio signal processing to identify victims’ low-frequency sounds.

Microphones become less accurate in the case of high background noise such as pneumatic drills, breakers, vehicles, wind, power cables, and water flows that can be present in a real scenario.

Another limitation of audio detection systems is that they cannot locate unconscious victims.

Even though cameras are an efficient method to detect casualties, their effectiveness is limited by their inherent reduced angle of view, the presence of obstacles, and the generally limited visibility under the rubble.

Doppler radar has been widely used in disaster rescue operations due to its efficiency in detecting motion behind obstacles.

Frequency or phase shift in a reflected radar signal can be used to detect motions of only a few millimeters such as heartbeat or breathing.

Doppler radar requires accurate calibration and even small environmental changes due to aftershocks and structural instability have a negative impact on the performance of this kind of system.

In extremely noisy environments the detection of feeble sounds will not be possible.

The correct voice recognition rate is 89.36% in a noisy environment. The correct classification rate for human-related suspect noise, including scratching and coughing, is 93.85%. Therefore, using a microphone in connection with other sensors would be beneficial for the detection of casualties.

Conclusion

A CO2 sensor can provide useful information to locate a casualty, but an O2 sensor does not
A voice recognition algorithm based on SVM was also tested and from the results obtained it was confirmed that using the microphone would be of great benefit in the detection of casualties.
The gas sensor is difficult to use in open spaces due to stronger airflow affecting the CO2 concentration
A sensor system using only a thermal camera is not robust because some areas cannot be directly accessed using a telescopic pole or directly observed due to the presence of obstacles.

Use of Fire-Extinguishing Balls for a Conceptual System of Drone-Assisted Wildfire Fighting

This paper gives the suggestion of using extinguishing balls for fighting wildfires. The paper concludes that these balls cannot be used by drones for fighting building fires however. They also give an elaborate design for releasing the balls and drone specifications

https://www.mdpi.com/2504-446X/3/1/17/htm

https://www.brandweer.nl/ons-werk/drones-bij-de-brandweer

Current state of drones in the fire departments in the Netherlands. Mostly used for their camera’s and heat sensors. The fire department now has its own flight department, which makes the regulations for the fire department less strict.

Top 3 Tactical Changes from Firefighter Research

Basic firefighting tactics involve limiting airflow through the fire site. Ventilation was believed to help reduce smoke and heat but turned out to have dangerous effects. A lot of airflow can lead to more oxygen fed into the fire and an increase in the amount of smoke inside. Controlling the airflow before the fire can either decrease or increase the dangers and is very difficult to do and should only be done when the effects are proven to work. The three critical steps described here are confining the airflow to the fire, cooling the fire department and clearing the remaining smoke and heat.

With this knowledge, drones could be specialized to detect where airflow is caused from a different point of view from human level. Heat sensors can see where the heat is escaping a building the most, this place is causing the airflow.

https://www.fireengineering.com/health-safety/top-3-tactical-changes-from-firefighter-research/#gref

Top 20 Tactical Considerations from Firefighter Research

“No amount of technology is going to replace the need for you to know your profession”. Drones should never try to act as a replacement. Drone designers need input from specialists in the field of firefighting.

This source is probably from a safety presentation. Most information is not on these slides but the basic rules are described. Here they talk more about ventilation with which drones could help in the previous mentioned way. Also, safe positions for firefighters is explained. Drones could help the firefighters to better see where they are safe or not with e.g. a top view or other perspectives.

https://nfpa.org/-/media/Files/Membership/member-sections/Metro-Chiefs/Urban-Fire-Forum/2014/S-Kerber-NFPAUFF--Top-20.ashx

Cancer Is the Biggest Killer of America's Firefighters

The danger that kills most firefighters these days is cancer. Not an obvious main cause but the amount of asbestos in the past and other chemicals found in buildings these days is the real danger.

Drones obviously can’t prevent these long term safety issues for the firefighters but they can help in some way. Drones could be used before firefighters went inside a building to measure the toxicity of the air. With this knowledge, the tactics of the firefighters could be changed before entering. The drones would be a safer option to go inside quickly, maybe even before the firefighters have put on their gear and arrived to the site of the fire with the firetruck.

https://www.nbcnews.com/health/cancer/cancer-biggest-killer-america-s-firefighters-n813411

Tristan's Father firefightering experience

Has had the full training and certifications.
Has had one actual building fire experience, though he was working in the building when the fire started, so he only helped with evacuating people in the initial phase.
Doesn’t think that drones specifically made for firefighting are good.
Rather, drones that scan areas for gas, temperatures, size etc. and that carry supplies such as oxygen are better.
Explained the duo team setup when going into buildings:
- One leader, one follower that makes sure there is always a way out.
- Possibly multiple teams in one building.
- Main goal: find other people and animals and bring them to safety.
- Once in a while, stamp really loud followed by shouting “Is someone here?”.
- This has the following benefits:
  - People might hear and might say something back.
  - You know if the floor is sturdy enough.
  - By the echo you might be able to deduce some other properties of the room.
- Leave everything exactly as it was when passing through the building. Essential for your and other team’s backtracking.
- In his time, there was only 20 minutes of oxygen available (probably now there is more). After 10 minutes, the mask makes an annoying sound that becomes louder while your oxygen supply is getting lower.
Other duo’s focus on using fire hoses, obtaining more water, securing the area etc..
Also told story where a very experienced firefighter failed a training and he would have died were it not a training. The man was so psychologically struck that he immediately quit being a firefighter forever.

Drone Swarms in Forest Firefighting: A Local Development CaseStudy of Multi-Level Human-Swarm Interaction

Paper is about drones deployed by firefighters for forest fires. The writers have created a workshop for firefighters where they are given a map with a forest fire somewhere. Then the firefighters have to describe how they would combat the fires with the help of drones.

1 More drones require more mental workload. Eventually the user cannot cope with the system anymore. A promising approach is to control the group as a whole, independent of the group size. Benefits are that the swarm is scalable and decentralized organization makes it robust when individual drones fail as the swarm adapts to find a new way to achieve its goal. Lastly, it is cost-effective because its simplicity enables (comparatively) cheap individual components to perform the same functional task as a single complex, expensive drone.

1.1 Drones are effectively used as scouts to find and provide information about fires.

1.2 Information about why there is not a lot of research on these kinds of topics and what type of research this paper is about. No real substantial information here.

2 Describes how workshops were set up where firefighters (some had more than1 year of firefighting drone experience) would utilize their drones to combat a forest fire in a rural area. This was done by giving the participants a map of the area and cubes that represented the items such as drones, firetrucks or whatever the participants needed. Notes were taken based on the participant’s scenario descriptions and how they interacted with the drones.

3.1 If drones are allowed on site, they firstly scout the whole area to measure the fire, look for terrain features such as water sources, natural barriers, buildings and roads. Then the firefighters make an estimate on how the fire will spread. After that, the drone keeps an overhead view of the site, such that possibly another commander can overview the operation. Firefighters can also use the drone as a (moving) guide through the flames. Other than that, drones also scan the surrounding area for additional fires. Drones generally only update their overview every 10-15 minutes to conserve energy.

3.2 The envisioned use of drones to detect wildfires describes two scenarios: First, when an emergency call is made, a very fast drone is immediately sent to the fire to get an overview of the situation and gather important data. Second, one could use a swarm survey to survey high-risk areas. The swarm would fan out to form a straight line, several kilometers in length, and systematically sweep the selected area for fires, using both visual spectrum and IR sensors. Whenever a drone identifies a potential fire it brings in additional drones to verify the sighting, with the rest of the swarm reorganizing to close the gaps left by the drones that have now stayed behind. When ground units arrive, tasks described in 3.1 are executed for the drones.

Furthermore, large helicopter-like drones could be used to carry lots of water to douse the fire themselves. These drones could also be equipped with loudspeakers to instruct people to evacuate.

3.3 Best to read the whole section

https://www.researchgate.net/scientific-contributions/Jens-Alfredson-30466080

Analysis and design of human-robot swarm interaction in firefighting

The paper discusses possible forms of interactions with swarm robotics being examined in the GUARDIANS[1] project. The paper addresses the use of assistive swarm robotics to support firefighters with navigation and search operations. It reports on existing firefighters operations and how human swarm interactions are to be used during such operations.

1 The paper focuses on employing the swarm as an aid to firefighters once they engage with the fire incident. There are two types of users involved in this situation. First, users remotely overseeing and managing operations in real-time. These users provide decision making support to the operations commanders. Second, users that are directly in the field and fully equipped.

The work reported in this paper assumes that the robots are capable of extracting required information from the environment, as well as be able to navigate. More information about the robots that were used can be found at the end of section 1.

2A. The emergency setting environment for the project is a large single story industrial warehouse. Being blinded by smokes and fumes is one of the largest risks firefighters have. Furthermore, in an area such as this, there are tons of unknown variables, such as a simultaneous ignition of all the combustible material in the area or a sudden release of toxic gases.

2B Describes the procedure that firefighters use when fighting a fire. Procedure is basically the same as described in procedure my father told me.

3A During intervention-oriented missions, such as those of rescue teams and armed SWAT-teams, a considerable amount of communication is devoted to clarifying positional information like confirming the position of specific agents. Moreover, firefighters operate in conditions, such as poor visibility, noisy environment and a thick clothing gear, which restrict their senses, and thus their communication abilities. Also, wireless communication may easily be disturbed due to metallic structures inside the incident area.

3B Firefighters are already experiencing enough stress as it is with their tasks. Making an unclear interface would only add up to the workload firefighters experience. ‘Alternative’ means are currently being investigated.

3C Firefighters only have a short time window to make their decisions on site. As a consequence, it is imperative that acquired information and data allow firefighters and human operators at the base station to comprehend in real time the on-going situation, and accordingly to best perform decision making.

3D In designing interfaces, it is important to take into consideration the roles assigned to humans and robots. For humans, different roles have different expectations or models of the robots. If these differ from reality, this will lead to frustration, additional stress, and possibly serious or critical mistakes.

3E Although simulations may be helpful, operational robot swarms will be required to assess the adequacy and efficiency of the interfaces developed.

4 The authors used prototypes to assess what firefighters think and how they interact with their ideas.

4A The auhtors expect that firefighters will have two roles during operation: team mates or bystander. Team mates will actively cooperate with the robot swarm in achieving the goal, such as scouting the incident area or searching for victims. By-standers do not have direct control over the robot swarm.

4B The GUARDIANS base station shall provide classical robot station features such as mission authoring tools, mission execution monitoring and control means, interface to robots and human crew members, and mission data recording. This will allow for the following roles:

Base station coordinator: responsible for preparing and validating mission plans, coordinating the activities of operators, robots, human crew members and sensor data specialists, taking decisions in the scope of the GUARDIANS appliance activities and is an interface from and toward the commanding chain above the GUARDIANS appliance.

Operators: They have the means and clearance to teleoperate robots, groups of robots and humans crew members. Sensor data specialists: they observe and analyse sensor data and accordingly provide advice and reports to the appliance coordinator. Stakeholder in the commanding chain: They take general purpose decisions regarding the GUARDIANS appliance activities, that the base station coordinator shall apply accordingly.

4C Through consultation and interviews the following activities have been proposed as ways in a robot swarm may assist firefighters. Notifying the firefighters of possible hazards (e.g. obstacles, high temperature, chemicals); Indicating unambiguously the direction to the scene of incident or backwards to the exit point; Grouping - it is important for firefighters that the swarm stays within a relatively close range to them but also maintains its distance to the firefighters to allow them freedom of action

5A Passive: Robots adapt to the movement of the firefighters. Drones have special gear that allows them to see the surrounding area despite the poor visibility firefighters have. They should also be able to specifically see the firefighters, perhaps they can be equipped with electronic sensors.

Tangible: In general the same as passive, however firefighters may now give specific tasks for the robot swarm. In order to do this, a minimalistic interface will have to be developed that will not bother the firefighters in any other way.

Movement-Based: A movement language could enable an easy means of communication with the swarm while being diverse enough to cater to most needs.

5B Tactile: A tactile interface consisting of eight tactors will be attached to the firefighters torso. The interface displays a “tactile picture” of possible hazards locations surrounding firefighters. Both parameters of the frequency and amplitude will be used to communicate the seriousness of hazards.

Visual: The swarm communicates unambiguous directions through a novel visual device (can be seen in paper) to be installed within the firefighters’ helmet. The visual device displays the directions in a simple form which requires minimum attention from firefighters in order to understand them.

5C Another option would be remote interaction via a base station. The crew that control the swarm from the base station then have a real time overall situational awareness, such that other firefighters can be more efficient. Further, the base station could give clear instruction to the men on site. Exact details on how this would be built can be found in the paper. Two types of configurations are considered.

Remote human - robot swarm interaction: The principle of a robot swarm is to rely on auto-organization and group behavior emergence to fulfill tasks, while benefiting from redundancy. Visualization of the swarm activity in the base station is an essential issue: efficiently encompassing the overall robots activities in a single view is a major aim for the GUARDIANS’ base station. During normal operations, robots operate autonomously. However there are situations in which autonomy level adjustment is deemed necessary. For example, when the challange is too complex for a robot or requires more knowledge than the swarm has. This makes the swarm more flexible and creates a nice balance of the workload among humans and robots.

Remote human - human crew members interaction: This allows the base station to also telecommunicate with firefighters. The main benefit is the possibility to coordinate robots and humans activities on the fields together, in a comparable way. Sometimes firefighters face conditions where visibility is null and ambient noise makes it impossible to discuss with other crew members. In such a situation, the base station can send simple step by step elementary actions requests through the designed user interface, for instance to guide the firefighter toward the exit.

[1]: GUARDIANS (Group of Unmaned Assistant Robots Deployed In Aggressive Navigation by Scent) is an European project developing and applying the concept of autonomous robots in urban search and rescue operations. Specifically the project is focused upon assisting humans involved in searchand-rescue emergencies and also employing robot mounted sensors to provide a heightened level of feedback in such settings.

https://www.researchgate.net/publication/4363364_Analysis_and_design_of_human-robot_swarm_interaction_in_firefighting

How Firefighters Can Better Manage Emergency Situations Using Drones

Talks about what drones are currently used for in firefighting and some challenges. From a company that creates software for use of firefighting drones. Drones are mainly used for surveillance and search and rescue.

https://flytnow.com/drone-fire-fighting/

A Survey on Robotic Technologies for Forest Firefighting: Applying Drone Swarms to Improve Firefighters’ Efficiency and Safety

Very recent paper on forest firefighting in Spain. Survey of firefighters asking on current problems in their line of work. Main need is information. Aerial view and Thermal cameras. Also proposes drone swarm concept for surveillance, mapping, monitoring etc.

https://www.mdpi.com/2076-3417/11/1/363/pdf

Use of drones for firefighting operations

Danish Master Thesis on Firefighting drones. 89 pages, haven’t read the whole thing. Nice summary of benefits and limitations below.

https://projekter.aau.dk/projekter/files/294663864/Master_Thesis__Vlad_Tiberiu_Radu__RISK4_11.pdf

Fire Department Drones Serve a Variety of Needs on Incident Scenes

Shorter article on firefighting drones talking about some experiences of fire departments. Again these drones are primarily used for information, not actually fire fighting.

https://www.fireapparatusmagazine.com/fire-apparatus/fire-department-drones-serve-a-variety-of-needs-on-incident-scenes/#gref

An Exploratory Study of the Use of Drones for Assisting Firefighters During Emergency Situations

Exploratory study on drones assisting firefighters in emergency situations Surveys firefighters and 911 callers Also looks at privacy and safety suggests multiple solutions, mainly communication, but also indoor usage

https://dl.acm.org/doi/pdf/10.1145/3290605.3300502

autonomous navigation in complex environments

Autonomous Navigation for Micro Aerial Vehicles in Complex GNSS-denied Environments
- https://doi.org/10.1007/s10846-015-0274-3
A general purpose configurable navigation controller for micro aerial multirotor vehicles
- https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6564733

2 studies on autonomous navigation in complex environments. I think way too difficult to do for us but it is a source to show it is possible

Victim detection

Vision based victim detection from unmanned aerial vehicles
- https://ieeexplore.ieee.org/document/5649223
Hyperspectral imaging or victim detection with rescue robots
- https://ieeexplore.ieee.org/document/4745869

Study on victim detection with UAV’s, the second one is more about finding bodies under ash, maybe not too interesting for us. Unless we also want to look into search after a fire.

AI simulations and programming environments for drones: an overview

Simulations:

Main reason: enable AI to learn how to perform tasks without the need of any human intervention
Objective: study the behavior of the drone-based application, provide training
Help in economizing the cost of the actual implementation of the system
Very important for drones to be simulated and evaluated before formally being put into use
Drones simulated with AI can track the fire outbreak by locating the areas affected and suppress the fire. (the drones have infrared cameras and other hardware)

Reasons drones are simulated:

Evaluate new technology
Low-cost training
Research and development

Vision and control: optical sensing or cameras

Trajectory planning: velocity, coordinates, location, flight path

Automatic navigation system: increases its speed to over 90 miles per hour; reduces the risk of poor navigation performance

Communication system: drones transmit data such as speed, direction, fixed points; communicate with other drones

AI issues in drones’ simulations:

High cost
Human error: drones can make mistakes especially if trained with the wrong data
Security and privacy
Adaptability: impossible for drones to adapt to changes in environments
Required expertise: need for programming and AI skills which are limited

Performance assessment parameters:

Coverage radius: drones have a precise coverage radius determined by its altitude, enables the base to receive and send signals
Drones’ throughput: drones are expected to froward data to stationary base stations
Scalability: depends on drone architecture
Battery lifetime: batteries have restricted capacity; researchers are trying to find a way to manage the power consumption

Open research issues:

Behavior and control
Computer vision: challenging because the nature of drone structure
Security and viability: issues in the GUI applications, affects the operation of the drone network
Communication: choosing the right for drone communication (network topology, architectural design, routing)
Vague simulation environments: difficult to obtain required results especially when several different simulation environments are used (difficult to compare the AI algorithms used for simulation and the accuracy of their performance)

https://www.researchgate.net/publication/341958826_AI_simulations_and_programming_environments_for_drones_an_overview

Machine learning for cyber security frameworks: a review

Machine learning:

Most common applications: image recognition and natural language processing
Appears to be a useful tool in providing security online
The purpose of research on ML applications for cyber security: employ the cognitive capabilities of ML to automate intrusion detection and forensic analysis of security breaches

Machine learning tasks:

Regression: deductions based on precondition
Classification: separating data unit or items into categories based on some attribute of the data
Clustering: grouping of data units or items
Association rule learning: making a conclusion based on an analysis of a previous event
Generative models: simulating data based on previous decisions

Cyber security tasks:

Intrusion detection: detect and notify concerned agents about an intrusion
Malware analysis: use a decompiler and debugger to decrypt the data stored by the malware and understand how it works
Spam detection: involves the techniques used to identify spam emails

Machine learning approaches for cyber security:

Regression: fraud detection (probability of fraudulent actions can be deduced by a linear regression model)
Classification: used in spam filters (natural language processing can also be applied)
Clustering: malware protection to separate valid user files from malicious files
Association rule learning: associate specific responses to different incidents in a system
Generative models: offensive cyber security (used to generate possible input parameters to test vulnerabilities in intrusion tests)

Effectiveness of machine learning in cyber security:

Important to analyze the effectiveness of these ML applications in comparison to already existing traditional methods employed in cyber security
Most existing cyber security protocols that use ML only apply ML to specific aspects of their frameworks
The idea of a fully autonomous cyber security framework still requires more research and experiments

What to take in consideration when decided whether to apply ML approaches or not:

What ML algorithm is best suited for the application
If the framework is aimed at general or specific threats
The frameworks vulnerability to adversarial attacks
The need for continuous and regular retraining the ML model

Conclusion:

ML oriented cyber security frameworks – still require a lot of continuous and fresh research
ML cyberattacks – have also automated cyberattacks as well => more difficult to handle
More useful research must take into consideration the shortcoming of ML approaches to cyber security

https://www.sciencedirect.com/science/article/pii/B9780128199725000021

a survey study on mac and routing protocols to facilitate energy efficient and effective UAV-based communication

Routing protocols for UAVs:

Requires location awareness, energy awareness, increased robustness to fragile links and dynamically changing network topology
Development of the routing strategies and protocols for UAV network: one of the most challenging tasks for UAV-based communication systems
A lot of research is being currently conducted on UAV routing
Existing routing protocols for wireless networks have been modified to suit UAV applications
Classified based on the routing strategies in 2 categories: single-hop and multihop routing protocols

Single-hop routing:

Main purpose of a routing protocol: transmit/forward the data gathered while increasing the delivery ration and minimizing delays and resource consumption
Routing protocols: should consider scalability, loop freedom and efficient use of resources such as energy, memory and computation time
One way to use UAV as communication systems: as packet bearers (transfers the relevant information when flying from the source to the destination)
This approach can mainly be employed for occasion with fixed topology

Multihop routing:

Another popular strategy employed to address the challenges for UAV-based communication systems
Classified into topology based and position based routing protocols
Topology based routing is divided into proactive, reactive, hierarchical and hybrid routing
Position based routing: in UAV, depending on the application, it is usually ideal to consider he network in three dimensions
Hierarchical routing: in UAV based communications used for coverage extension, relaying and data distribution and collection, using UAVs similar to traditional wireless sensor network infrastructures is also becoming quite popular
Hybrid routing: a few clustering based hybrid routing algorithms are proposed in the literature for UAVs

Data delivery models in UAVs:

Very difficult to analyze each and every application in UAVs from data delivery perspective
The traffic characteristics are very specific and distinct to the applications
The network’s performance: very critical while focusing on UAV applications
UAV applications (especially event-driven in nature ones): mission critical, real time and interactive
Query-driven UAV-based applications: also mission critical, real time and interactive
To save energy: queries can be sent on demand

MAC protocols for UAVs:

Self-organization, high-degree of coordination, management among the sensors: required to support the variety of application areas and make use of UAVs as effectively as possible
Energy preservation: one of the most important factors in the design of a MAC layer protocol
The choice of MAC: highly impacts the performance of the UAVs
No MAC protocol ha been standardized for UAVs among a variety of protocols available in literature
While designing a MAC protocol, the following attributes need to be considered:
- Throughput: the requirements of UAVs in terms of delivery efficiency are very specific to the task
- Scalability of the Network
- Latency: most UAV applications are critical where data needs to be sent in real time, latency needs to be kept to possible minimum
- Energy efficiency

Conclusion:

There is a need for newer protocols for applications which use UAVs
Protocols to be developed:
- required to adapt to highly mobility, dynamic topology, intermittent links, power constraints and changing link quality
- should be able to support features such as energy efficiency, high connectivity, delay sensitiveness, high reliability and security

https://www.sciencedirect.com/science/article/pii/B9780128199725000045

Heat Resistance and Flammability of High Performance Fibres: A Review

Paper about the heat and flame resistant properties of BPO, a fiber used in firefighting clothing

https://onlinelibrary-wiley-com.dianus.libr.tue.nl/doi/pdfdirect/10.1002/fam.799

Development of FAROS (fire-proof drone) using an aramid fiber armor and air buffer layer

Concept of a firefighting drone using aramid fiber and air buffer to protect against heat and flame.

https://ieeexplore.ieee.org/document/7992713

Firefighter training (Article)

Training exercises are handled the same as a real incident
Fire simulation: fire in a room on the second floor with a report of people trapped
- Smoke machines: generated medium to heavy smoke conditions
- The units: ensure safe operations, including proper placement of their apparatus
- The engine company: access a water supply from available hydrants
- The truck company: position its apparatus in front of the fire building and provide ground ladders for ventilation, possible rescue of occupants
- The engine company: located a hydrant and proceeded past the front of the fire building to ensure sufficient placement for the ladder company
- The truck company: performed forcible entry on the front door and proceeded to raise portable ladders
- Members of the truck company entered the dwelling and assisted the engine company in performing search and rescue
- Mannequins were located and removed to the exterior
- The simulated fire was quickly knocked down as the primary and secondary searches were completed
- The units then restored their equipment to the apparatus and members returned to the classroom to critique the exercise
training involving multiple units, cross training of members

https://search-proquest-com.dianus.libr.tue.nl/docview/817398692

Firefighting tactics (Article)

Fire behavior was calculated on a laptop computer brought to the scene
If a laptop was not available, a firefighter would relay the fire scene information by radio to someone at the fire station who would do the calculations on a desktop computer
Valuable time was spent, so now they use a software to make different calculations like flow rate, friction loss, pump pressure, hydrant flows, etc

https://search-proquest-com.dianus.libr.tue.nl/docview/221213119

Firefighter rescue (Article)

A fire was reported
A standard box alarm consisting of four engines, two ladder trucks, a rescue squad, two battalion chief; and an ambulance was dispatched
The rescue squad and one engine reported staffing of three; all other units reporting staffing of four or more
The normal radio-controlled "status messaging" was out of service, resulting in manual-verbal staffing and scene status reporting
The "working fire dispatch" was sent, bringing a paramedic unit, the safety officer, the EMS duty officer and the Rehab Bus
The first engine officer directed his crew into the front door and to the left living room/kitchen area, where he believed the fire was located, based on the exterior issuance of smoke
During this attempt at locating the fire, the first-arriving special service crew split into two teams; a two-person inside and a two person outside team
The inside team, was responsible for search, rescue and interior ventilation
The outside team was responsible for exterior ventilation, ladders, utility tasks, etc. when appropriate
A two-person truck crew with a captain operating in quadrants C/D located the fire in a back bedroom
The captain and an engine crew were unsuccessfully attempting to stretch a hose line down the hallway toward the fire room
The new flow path placed the captain and this engine crew in a tenuous location, ultimately resulting in the captain receiving second-degree burn injuries, but managed to go outside
After the regroup and re-evaluation of the scene, crews systematically extinguished the bulk of the fire from the exterior, then re-entered to complete overhaul and extinguishment

https://search-proquest-com.dianus.libr.tue.nl/docview/1685183133

Interview with the fire department

The interview is scheduled to be on March 2nd. We will update this part after the interview

Questions for fire department:

-Could you explain what exactly your role is in the fire department and what you do most days at work?

-What do you feel is the biggest problem faced in fire fighting nowadays? What could have the biggest impact on the speed with which fire can be controlled and extinguished?

-What roles do you think drones could possibly take over?

-Do you believe that drones could be used to actually douse fires?

-What is your experience with drones with fire fighting and what is your view on the usage of drones?

-If specialized drones could be at a fire site faster than a firetruck, what would be the most useful thing a drone could do as preparation for the arrival of the fire department?

-Have you considered any alternative technologies than drones? What are your conclusions regarding these alternatives?

-When do you think (firefighting) drones will be commonly used by firefighters?

-Do you think a companion drone would be useful (a drone that follows firefighters around and has a few tasks to improve safety and help firefighters with their jobs)? If yes, what feature should it have? What would be the most helpful for you?

-Have the rules for the fire department changed with respect to drones, since the recent european regulations? (31 december 2020)

-Are drones possible in the fire department practically? Is there a budget for it and is it possible to have enough people on this?

transcript

“What are your roles in the fire department?"

Mark: We focus mostly on the outside world. Especially flying preventively. For example, above nature reserves. In the case that happens, the drone can aid you, because the drone can provide more information from above, such as: how are the buildings placed in relation to each other, where are the vehicles, where is the smoke going, are there any people on sight, are there any dangerous chemicals etc.. In that way, a drone offers the 3D perspective that a ground team does not have.

“What do you feel is the biggest problem faced in fire fighting nowadays? What could have the biggest impact on the speed with which fire can be controlled and extinguished?”

Paul: For that I have a question for you. What do you exactly want to achieve? In the Netherlands there are 25 different fire departments and some of them already work with drones. There is also a national drone organization for the fire department, so we already know how to use drones.

“Our plan for now is to find out how drones are currently used and if we could invent a new way to use drones or to improve upon an existing method. We don’t think that drones are capable enough for dousing fires. We are focusing on communication via drones and the 3D perspective that drones offer.”

Paul: Actually, in China and Dubai there are drones that are capable of dousing fires. These drones are of course much bigger and heavier up til 60 or 100 meters high. There are also different ways of using water to douse fires. 10 or 15 years ago a system I think was called ‘3FX’ was created where a helicopter fired a very quick burst of water on a fire. But one could use chemicals to douse fires, or maybe even with sounds. So almost literally, the sky is the limit. It is more a matter of: who is going to design this and who is going to pay for this? In the Netherlands this will probably happen not so fast, since in the Netherlands less money is spent on the fire brigade than in Dubai, for example.

Mark: For basic operations, we already have enough materials to deal with those. For us this is more about the escalation incidents. At this moment, we use drones primarily for gathering information at the place of interest, so that we can create a full picture of what is happening there. Though you would rather want to act at the beginning of the chain; preventing the incident from even happening. So very rapidly being able to detect a starting fire in the aforementioned nature reserve, for example. I think that we can gain the most in this aspect.

“That is indeed a new idea. We can definitely work with that.”

Paul: Also, the Rijkswaterstaat (Dutch governmental organization for infrastructure and such) uses drones for checking the quality of dykes or letting a drone check the quality of the air near factories. Again, the potentials are limitless. It is just a matter of how money you want to put in it.

“Alright. Because of extreme heat and smoke in a burning building, a thermal camera would probably be overloaded to function properly. But imagine that such a camera does exist. Do you think that this will help with the communication between firefighters that are already inside the building and the ones that are still outside? What interesting things could then be seen?”

Paul: Currently, there are remotely controlled drones with a camera attached that already can go inside buildings. We are also working on drones equipped with measuring equipment to measure the concentration of gasses in the air.

“Drones cannot get inside a burning building easily in general. What can drones do before the actual firefighters arrive at the incident?”

Paul: I’ve noticed that you have said a few times now that certain things are not possible. But actually a lot of these things áre possible. A drone can fly into a building. One only needs to design doors that can automatically be used, by sending signals between the door and the drone. We are also working with another team from the TU where we are creating drones that can escort people safely outside buildings.

“Are you concerned with legal restrictions on drones? Obviously firefighters have to follow different rules than recreational pilots. When a new drone is available, can you use it immediately? “

Paul: Of course we can use a drone if it’s legal. If it’s illegal we can’t use it. There are rules in place. In fact, the invitation for the training of new drone pilots for the fire department is open at the moment. If you have the proper training and licence you can start flying drones. In a few areas we cannot use drones at the moment right Mark?

“If drones were to be used, you would need a specialised team. Is this something that is already done? Are you looking for pilots at the moment?

Mark: We already have a few drone teams active at the moment, with flying licenses. These people followed pilot training for drones. As well as the supporting team, they are self supported. And for every incident they can be deployed. So regarding your question, drone teams are already active in the Netherlands.

“I had a question about when drones could be actually used, but it seems that they already are. Are there other alternative methods, apart from drones, that are currently being looked at or tested?”

Mark: Those would be dousing robots and such. Those are currently being researched. Multiple regions already have them, and are testing with them. But drones can also be used for other purposes, like personal transport. The ministry of defence is currently looking into this. You could hang a patient from a brancard under a drone. So you can secure people from heights quicker. But there are also robots you could use for salvage, transporting materials in impassable terrain, those sorts of applications.

“Regarding the drones that are already being used for entering buildings: Are these drones capable of recognising people in distress? How would that work?

Mark: Drones can already do this with a thermal camera. These can thermally distinguish the environment from victims.

“Wouldn’t the camera be overwhelmed by the heat of the environment?”

Mark: Yes indeed, these temperatures, especially in burning buildings with a substantial fire, are radiated everywhere. With thermal cameras you can ask for different thermal images. So you have images with colour or greyscale. When looking at a colour image, everything would look red, so you cannot make sense of it. But when working with greyscale, you can still distinguish persons.

“We imagine that flying close to fires can cause major problems for drones, like melting propellors or dysfunctioning equipment. How is this currently worked around?”

Paul: It depends on what you want to do with the drone. At the moment, it is not a priority to fly the drone directly at the fire. We use these drones to spot people. Or, in early stages, escort people outside. When it comes to dousing, we would rather use a dousing robot (with a camera and hose) than a drone. Drones that are used right now, are not capable of flying through fires. But this is not necessary. We are using them to see where the fire is and what the best plan of action is for extinguishing. They are namely deployed in spaces that are too dangerous to enter, like a big lobby. We can use the zoom function on the cameras to look at the fire closely, and we can estimate distances (by using lidar or radar). So by keeping drones at a distance, there is no need for a heat shield that can withstand 800 degrees. It depends on the drone’s purpose. Right now, we cannot see why a drone would need to fly through fire.

“What are typical temperatures firefighters need to deal with?”

Mark: That is a difficult question, it depends on what is burning etc. A big fire would be 1000 to 1500 degrees. Paul: Of course, we don’t send people in with these kinds of temperatures. Typical temperatures that we can still send teams into would not be 1000 degrees. Mark: Typically we are present when there is a flash-over. With lots of smoke, where everything in the room starts burning. This is typically around 600 degrees. This is still too high, when people are present at these temperatures, we are doing something wrong. So our maximum temperature would be 500 degrees. ...At the ceiling, lower to the ground the temperature is lower.

Daniel: These were all the questions we had come up with, maybe Ruben or Tristan came up with any questions?

Ruben: Since European rules came into effect since this year whether something has changed for you or if you have an exemption when it comes to the use of drones?

Paul: I don't know what the impact of European regulations is, but of course we have to comply with the regulations, which is why our pilots are specially trained. I do not know what the substantive changes are, but we are complying with the laws and regulations. We are working with the legislator to see when we can get an exemption. We do it not for fun but for a social dilemma. And then it seems logical to me that you look together with the legislator when you can get exemption, you must of course be strict. When you fly over an audience, I understand that of course you have to be strict with that. But it is something else if you want to work with a drone on public safety, for example if you are going to fly above riots it is something different than if you are going to fly above an audience at an event in your spare time to make beautiful film images. Of course we will look at where we can get exemption, but we do have to deal with the laws and regulations. My counter-question remains what you want to achieve with this investigation. I say this because we already do a lot with drones in the fire department and it would be nice if you would do additional research and not, so to speak, spend a lot of time in a report and that Mark and I say "yes but, we already have that in Twente, in Twente a drone is already going to leave automatically in case of a fire report. And I already have Utrecht and there it already is" because then you have a report that we say "yes, this may be nice but that doesn't make us any wiser and you might not be any wiser yourselves eventually." Hence, my counter-question about what exactly do you want to achieve with your research.

Daniel: We've already done some research into what kind of drones are used in the fire department but we haven't been able to find much of it and from what I'm hearing now I think we need to look even deeper. But as far as we have found there are only a few drone teams in the Netherlands, I thought we had seen somewhere that there are only 7. I do not know whether we can find exactly to what extent they are now being used, how much information we can find about them. Until now, our plan was to see if we could come up with an innovation and of course we needed more knowledge of what is now being used in the fire department.

Paul: No, I get that. Then it is easiest for you to talk to the national coordinator, Mark Bogdan, Via the website brandweer.nl you can certainly find it. He can tell you all about it. I’m having a hard time wrapping my head around what you could deliver right now, and this is what I mean positively and I mean it mostly realistically.

Daniel: Yes, we understand that. We do not yet know exactly what we want to do and that we still have to do a lot of literary research ourselves.

Mark: What you notice, is that a lot is being put into a piece of exploration and extinguishing with all kinds of systems at the moment. But I think most of the profits can be made, and Paul and I have been in the field for that before, right at the front of the chain. So being able to signal it very quickly and get the profit there. That is also the most difficult thing at the same time. Prevention. We've also been talking to the Department of Defense about it. They want to use these systems in war zones to take over the tasks of patrols. Patrolling, so to speak. And being able to signal about hostilities in time or things like that and immediately respond to that. In fact, the same task could also lie with the fire department, only from a different capacity. So if you already know that you have risk areas somewhere, which Paul just described, and you can fly a drone over there in a certain time and it can send signals immediately to report it to the fire department which saves us a bit of alarm time, road time and deployment right away, which prevents those escalation fires. I think there's a lot of profit to be made there, but it's also the hard part about the story.

Ruben: To what extent is that already being done, flying for prevention?

Mark: I don't think the fire department does it. But there will be other parties that do do something like this preventively, for example, think about events with crowd management where they can just fly a drone above. If somewhere a disturbance is found and a signal is sent, they can immediately send people. You're faster with that than if you constantly have to send teams into the field to keep up. Just something comes to mind. So I think for example an event industry, those kinds of parties that work are already thinking along. Police might already be.

Ruben: By risk areas you mean, for example, nature reserves when it is very dry and warm. Also in urban areas it could also be flown on prevention or, is that a lot more difficult?

Mark: Yes, when you talk about buildings, of course it becomes a lot more difficult, because then you’re talking about systems that can look through something. But then the question is whether that task is for us or whether that task should not be invested with another party. Paul: And that's the question anyway. In Oost 5, in the east of the Netherlands, a project is being worked on to achieve autonomous nature fire exploration, that a drone just flies around there itself. The question is also, is that the responsibility of the fire department or is that the responsibility of the owners. And often it is the responsibility of the owners. Also for the railway sector, then should not be a drone of the fire department flying above to look for leaks, there would be mainly ProRail or something, having to invest in a system that discovers that something is going on there. When it comes to natural fires, the Staatsbosbeheer has to do so. This applies, of course, to all parties. In this sense, we mainly see drones as a tool that we can bring along or can send in advance when we are notified, but building owners or owners of areas etc., they can mainly use drones from the preventive atmosphere. If you look at a port area with a container storage area, it would make sense if [the owners] are the ones who mainly look at whether containers are leaking or if there may be people crawling in or out who do not belong, either human trafficking or crime. So we are also talking about that than, for example, the fire department or the police should do so or, if mainly the owner is primarily responsible for safety and surveillance and crime. And that also applies to event organization, event organizations are, of course, also primarily responsible for ensuring that an event goes well. So they will primarily have to use the drones to see ‘how am I going to make sure everything goes safely’. Because now you already have to, as Mark just said, you have to make people walk around for that now, but you can also use such a drone. Well, that's also possible at a trainway complex, you can put all kinds of gadgets on the ground there, you can also fly a drone around but keeping in mind that as owner he is responsible of course for ensuring safety and preventing nuisance. And if that goes wrong, then the emergency services like us come mainly to contain the emergency, because the prevention is of course primarily up to the owner.

Who did what?

**Week 1**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)	6:15h	Meetings (1:30h + 1:15h + 1h), Brain storming (1h), reserach (1:30h);
Jos Garstman(145722)	5:45h	Meetings (1:30h + 1:15h + 1h), Brain storming (1h), research (1h);
Oana Radu (1325973)	6:15h	Meetings (1:30h + 1:15h + 1h), Brain storming (1h), research (1h), wiki entry (0:30h)
Ruben Stoffijn (1326910)	6:45h	Meetings (1:30h + 1:15h + 1h), Brain storming (2h), research (1h) ;
Daniël van Roozendaal (1467611)	5:45h	Meetings (1:30h + 1:15h + 1h), Brain storming (0:30h), research (1:30h);

**Week 2**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)	10:00h	Meetings (1h + 1h + 0:30h), Talking to firefighter and summarizing that (1:45h), Reading (2:45h), Research (2:15h), Edit wiki (0:45h)
Jos Garstman(145722)	5h	Meetings (1h + 1h + 0:30h), Reading and finding sources (2h), editing wiki(0:30h)
Oana Radu (1325973)	7:30h	Meetings (1h + 1h + 0:30h), Reading(2:30h), Research (2h), Edit Wiki (0:30h)
Ruben Stoffijn (1326910)	5:30h	Meetings (1h + 1h + 0:30h), Reading/Research (2h), Letter (1h)
Daniël van Roozendaal (1467611)	6h	Meetings (1h + 1h + 0:30h), contacting firefighters for interview (1:30h), reading articles (2h)

**Week 3**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)	4h	Meetings(0:30h + 0:30h), Research(1:45h), Edit wiki(00:30h), Add USE to wiki(00:45)
Jos Garstman(145722)	5:30h	Meetings(0:30h + 0:30h), Research(4h), Edit wiki(00:30h)
Oana Radu (1325973)	5h	Meetings(0:30h + 0:30h), Research(4h)
Ruben Stoffijn (1326910)	5:30h	Meetings(0:30h + 0:30h) Research (4:30h)
Daniël van Roozendaal (1467611)	5h	Meetings(0:30h + 0:30h), Research (4h)

**Week 4**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)	6:30h	Meetings(1h + 1h), Interview and transcription (3h), Research simulation (1:30h)
Jos Garstman(145722)	6h	Meetings(1h + 1h), Research(2h), Editing wiki(2h)
Oana Radu (1325973)	8h	Meetings(1h + 1h), Research(3:30h), Research Simulation(2h), edit wiki(0:30h)
Ruben Stoffijn (1326910)	8h	Meetings(1h + 1h), Interview + Transcription (3h), Research(2h), Introduction (1h)
Daniël van Roozendaal (1467611)	7h	Meetings(1h + 1h), Interview + transcription (3h), Wildfire research (2h)

**Week 5**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)		Meetings(1h + 0:45h), Simulation(6h), edit wiki(0:45h)
Jos Garstman(145722)	10:15h	Meetings(1h + 0:45h), Research and editing wiki[Drone functionalities](5h), Research and editing wiki[Drone functionalities/Drone types](3:30h)
Oana Radu (1325973)	11:15h	Meetings(1h + 0:45h), Simulation(7:30h), edit wiki(1h)
Ruben Stoffijn (1326910)	12:45h	Meetings(1h + 0:45h), User requirements (10h), Editing wiki(1h)
Daniël van Roozendaal (1467611)	10:45h	Meetings(1h + 0:45h), Wildfires(5h), Detection in the Netherlands(3h), Editing wiki(1h)

**Week 6**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)		Meetings (1h + 2h)
Jos Garstman(145722)	12:00h	Meetings (1h + 2h), Research and editing wiki Wednesday (4h), Research and editing wiki Sunday(5h)
Oana Radu (1325973)	12h	Meetings (1h + 2h), Simulation (8:30h), Editing wiki (0:30h)
Ruben Stoffijn (1326910)		Meetings (1h + 2h)
Daniël van Roozendaal (1467611)	13h	Meetings (1h + 2h), Taskforce Natuurbranden (5h), Captured Data (3h), Fire spreading speeds (1h), Editing wiki (1h)

**Week 7**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)
Jos Garstman(145722)
Oana Radu (1325973)
Ruben Stoffijn (1326910)
Daniël van Roozendaal (1467611)

**Week 8**
Name (Student number)	Time spent	Tasks
Tristan Deenen (1445782)
Jos Garstman(145722)
Oana Radu (1325973)
Ruben Stoffijn (1326910)
Daniël van Roozendaal (1467611)

References

Reference example.^[8]

^[8]

↑ https://www.staatsbosbeheer.nl/over-staatsbosbeheer/projecten/de-pelen-natuurherstel-brand-deurnsche-peel
↑ https://www.flir.com/instruments/continuous-monitoring
↑ https://www.rijksoverheid.nl/onderwerpen/drone/nieuwe-regels-drones
↑ https://www.easa.europa.eu/domains/civil-drones-rpas/specific-category-civil-drones
↑ https://www.rijksoverheid.nl/binaries/rijksoverheid/documenten/kamerstukken/2018/05/28/voortgangsbrief-drones/voortgangsbrief-drones.pdf
↑ https://www.brandweer.nl/ons-werk/drones-bij-de-brandweer/meer-over-drones/brandweer-nederland-krijgt-eigen-luchtvaartorganisatie
↑ https://www.brandweer.nl/media/9028/stcrt-2018-33332.pdf
↑ ^8.0 ^8.1 Miskelly, F. (2001). Assistive technology in elderly care. Age and Ageing, (30), 455–458. Retrieved from https://watermark.silverchair.com/300455.pdf.

[Nature_recovery_deurnse_peel-1] ttps://www.staatsbosbeheer.nl/over-staatsbosbeheer/projecten/de-pelen-natuurherstel-brand-deurnsche-peel

[2] ttps://www.flir.com/instruments/continuous-monitoring

[3] ttps://www.rijksoverheid.nl/onderwerpen/drone/nieuwe-regels-drones

[4] ttps://www.easa.europa.eu/domains/civil-drones-rpas/specific-category-civil-drones

[5] ttps://www.rijksoverheid.nl/binaries/rijksoverheid/documenten/kamerstukken/2018/05/28/voortgangsbrief-drones/voortgangsbrief-drones.pdf

[6] ttps://www.brandweer.nl/ons-werk/drones-bij-de-brandweer/meer-over-drones/brandweer-nederland-krijgt-eigen-luchtvaartorganisatie

[7] ttps://www.brandweer.nl/media/9028/stcrt-2018-33332.pdf

[Assistive_technology_in_elderly_care.-8] 8.0 ^8.1 Miskelly, F. (2001). Assistive technology in elderly care. Age and Ageing, (30), 455–458. Retrieved from https://watermark.silverchair.com/300455.pdf.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

@@ Line 281: / Line 281: @@
 The weight of the drone should be kept as low as possible to increase flight time. A lighter drone means the propellers or wings need to create less lift to stay up and the drone can generate more speed. Camera use is also an important factor for the case of hotspot detection, since it will require continuous camera use. This will take a toll on the battery life.
-Depending on the type of drone, the flight time will be between 20 to 30 minutes for rotor-designs up till 16 hours for fixes-wing drones. After this time limit the drone will have to return to recharge or change its battery. During this time there will be a gap in the surveillance of the area. To get continuous or near continuous monitoring multiple drones or pre-charged battery packs should be available. The moment a drone returns to recharge another drone can leave to take over its job. Another possibility would be for the drone to quickly switch battery packs so it can continue on its way. A system should be in place however that manages the switching of battery packs.
+Depending on the type of drone, the flight time will be between 20 to 30 minutes for rotor-designs up till 16 hours for fixes-wing drones. After this time limit the drone will have to return to recharge or change its battery. During this time there will be a gap in the surveillance of the area. To get continuous or near continuous monitoring multiple drones or pre-charged battery packs should be available. The moment a drone returns to recharge another drone can leave to take over its job. Another possibility would be for an operator to quickly switch battery packs so it can continue on its way. Some research{{cn}} is being done into automating the process of swapping battery packs for drones. In the future this could be implemented to reduce workload on on-site operators or completely automate the operation.
+*https://www.researchgate.net/publication/262296753_Endless_Flyer_A_Continuous_Flying_Drone_with_Automatic_Battery_Replacement
+*https://core.ac.uk/download/pdf/191015665.pdf
+*https://link.springer.com/content/pdf/10.1007/s10846-011-9616-y.pdf
 The flight time is often not the limiting factor of drone range, but the data communication range is, as discussed in the previous section.

PRE2020 3 Group1: Difference between revisions