PRE2018 4 Group7

---

Group members:

Name	Student ID	Email	Study
Emiliyan Greshkov	1281666	e.greshkov@student.tue.nl	Computer Science
Thomas Janss	1006697	t.f.w.janss@student.tue.nl	Mechanical Engineering
Perry Kloet	1236356	p.a.j.kloet@student.tue.nl	Computer Science
Bram Schut	1019001	b.b.j.schut@student.tue.nl	Computer Science
Sem de Werdt	1017882	s.j.a.d.werdt@student.tue.nl	Automotive Technology

General information:

Problem statement and objectives

As urban environments grow, so does the need for means of transport for commuters and leisurely travellers. This is why trains are getting more cramped and more overcrowded. This makes it increasingly more important to use the available space and seating optimally to maximize the amount of people in the train and the comfort in which these people can travel. The objectives of the project are twofold. One part of the problem is detecting the amount of people in the train and the amount of seats available within each compartment of the train. The other part of the problem is clearly passing that information on to the passengers. The information about the amount of passengers in the train has to be collected reliably to forward that information to the travellers.

Previous done work

1) NS App, The NS app shows how crowded each carriage is on some trajects, using sensors in the rails that measure the weight of the train.
2) Schiphol airport train station, has an Intelligent Platform Bar (IPB) giving the passengers boarding information like where the doors will be.
3) s'Hertogenbosch train station has an Intelligent Platform Bar showing if there is space in the carriage.
4) Trainstation in Stuttgarden Germany has a luminous platform

Users

The users that would benefit from solving the problem mentioned above are the people that travel by train, and the train operators and coordinators.

Travellers will benefit from an increased spread of people along the train, because it will reduce the clusters of other travellers inside specific train compartments. This in turn will allow travellers to find seats without walking through a cluster of people on a moving train, and unless the train is full, they will not have to switch compartments in order to find seats.

Other users that shall benefit from this technology include train operators and train dispatchers(or dispatching systems). Increasing the spread of travellers along the train will reduce waiting time at stations.

The enterprises that would benefit would be various train companies, such as the NS or DeutscheBahn. The more effective use of time due to lesser wait time will allow for more trains to travel between stations, which will allow for more passengers to travel on time, which increases customer satisfacion and leads to more usage of these companies' services.

User requirements
The passengers and train operators both have several requirements. The passengers and train operators both need a reliable system to count the amount of passengers in the train and the position of those passengers within the train. This is important for the passengers because they need accurate information to have the best chance of finding a seat or finding a place to stand. The information about the available space also has to be passed on to the passengers in a user friendly and unambiguous way. The user interface has to give the passengers the information in a clear and understandable way so that they can make optimal use of it. The train operators mainly require a cost-effective system that is reliable, ohterwise there is no incentive for the train operator to deploy this system in the trains.

Approach, milestones and deliverables

Approach
The problem will be devided into two problems. A counting system and a user interface. The counting system has to accurately count to amount of people in each compartment and compare it with the available space to get the information about the available space. The user interface has to pass the information on to the passengers in a clear and understandable way. Combining both should provide the best possible solution for the problem of overcrowded trains and ineffective use of space.
Milestones
Achievable milestones include implementing software to recognise the presence of a person in a train compartment, software to handle t hat information onto a server or directly to users, and an application to clearly depict the information to users.

Deliverables
The deliverables at the end of the project will be a system that accurately counts the amount of people in each compartment, and a user interface that passes that information onwards to the passengers as effectively as possible. Both parts will be combined to make a total system that gets accurate information about the occupation of each compartment and passes it onwards to the passengers through a straightforward user interface.

Planning

Week	What to do	Person(s)
3	In-depth research
4	Concepting
5	Detailing
6	Building and Testing
7	Finish prototype
8	Prepare presentation
9	Finish wiki

Who's doing what?
The problem will be split into several parts. Each group member will work on a part that best fits their skills to optimize the end results.

Relevant scientific papers:

Research

1) https://www.alstom.com/our-solutions/digital-mobility/optimet-real-time-train-occupancy-smoother-passenger-flow-platforms
2) https://www.researchgate.net/publication/280735165_A_robust_system_for_counting_people_using_an_infrared_sensor_and_a_camera
3) https://www.dilax.com/en/public-mobility/portfolio/seat-management/
4) https://www.researchgate.net/publication/323027620_Smart_Bus_An_Automated_Passenger_Counting_System
5) https://www.google.nl/url?sa=t&rct=j&q=&esrc=s&source=web&cd=21&cad=rja&uact=8&ved=2ahUKEwiCudCpgPbhAhUJr6QKHRJQBlM4ChAWMAp6BAgIEAI&url=https%3A%2F%2Fpdfs.semanticscholar.org%2F55a0%2F9a9adb1e7905f99607846f7a286e3f39bf17.pdf&usg=AOvVaw0ZK1-RYUZ15nYZshrA0cHs
6) https://www.usenix.org/legacy/events/hotos03/tech/full_papers/gruteser/gruteser_html/
7) https://www.researchgate.net/publication/267387412_APPROPRIATE_TECHNOLOGY_FOR_AUTOMATIC_PASSENGER_COUNTING_ON_PUBLIC_TRANSPORT_VEHICLES_IN_SOUTH_AFRICA <br\> 8) https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=9&cad=rja&uact=8&ved=2ahUKEwiR9p2Uw4HiAhWNZ1AKHUeuBI4QFjAIegQIAhAC&url=http%3A%2F%2Fwww.movetec.fi%2Fimages%2Fpdf%2FTapeswitch-tuntoreunat.pdf&usg=AOvVaw0I2j-QILXPBH48Jq9N8T_d <br\> 9) http://www.instantcounting.com/technology.html
10) https://reader.elsevier.com/reader/sd/pii/S2352146517307159?token=960AEE718A60D47CF7E7F08701AD27EDC69A9913B5CBAA27DE0D3C81DA363B16C3FF122C62F1C5A3EB601DE44AE97706
11) https://www.tandfonline.com/doi/abs/10.1080/23249935.2013.795199?casa_token=U8PLb3o3OP8AAAAA:0a6jqeVO-6AR9W3YHihtHAag3XO5rRUyfBMkblxZQqgccoFb-AFONkHsasHFF4kCI8CDsYv7PV1B
12) https://ieeexplore.ieee.org/abstract/document/5715528
13) https://www.ns.nl/reisinformatie/service-verbeteren/zitplaatszoeker.html
14) https://www-sciencedirect-com.dianus.libr.tue.nl/science/article/pii/0262885694900531

16) https://patents.google.com/patent/US7788063B2/en
17) https://trid.trb.org/view/481481
18) https://blipsystems.com/hardware-overview/
19) https://nos.nl/artikel/2271485-ns-vrije-zitplaatsen-op-meer-trajecten-in-app-te-zien.html
20) https://repository.tudelft.nl/islandora/object/uuid:a67e550b-5c38-456e-9e21-90802ad36f6a?collection=education
21) https://www.researchgate.net/publication/276408492_Semisupervised_Pedestrian_Counting_With_Temporal_and_Spatial_Consistencies
22) https://www.its.ucla.edu/wp-content/uploads/sites/6/2015/11/passenger-flows-in-underground-railways-stations-platform.pdf
23) http://www.strc.ch/2017/Bosina_EtAl.pdf
24) http://ijtte.com/uploads/2018-12-08/b2ddb9bc-d1c1-4333ijtte.2018.8(4).04.pdf
25) https://www.deutschebahn.com/en/Digitalization/DB_Digital/productworld/Luminous_Plazfrom_en-1214708
26) https://onlinelibrary.wiley.com/doi/abs/10.1002/atr.5670180102

Categorize

Counting people:
1,2,3,4,7,8,9,11,12,14,17,18,21
Application itself:
4, 19, 25
Walking behaviour at platform:<br\> 10,20,22, 23, 24

1:
Alstom is a company that provided sensors tecnology (passive IR) to count people boarding and deboarding. At the platform, LED's show which compartments are full and which are not. With colors they influence people where they board. THe system is modular and can therefore be placed at any station of any length.
2:
pyro-electric infrared (PIR) sensor and a camera (2). Two possible ways: detection-based and map-based methods. Latter option more precise in counting (10,11). Differential PIR sensors used, since this is only possibility for differentiate between entry and exit of an environment and ordinary activities in that area by analyzing body movement. A couple of modules are used that consist of multiple PIR sensors. This data is collected and are input for a list of classifiers. Wavelet transform is used to create output signal. Using only camera yields ~ 80% efficiency, while integrating PIR has ~ 100% efficiency (Tutorial: https://www.youtube.com/watch?v=6Fdrr_1guok )<br\> 3:<br\> DILAX' active infrared sensors are capable of detecting people entering a door. The system is only active while doors are open. Each DILAX LAN can operate 382 sensors. The system is capable of counting in dense popluated areas with a high accuracy.
4:
Also, a pressure sensor could be used. Pressure sensors behaves like a open-closed circuit which delivers voltage while closed that can be placed underneath the padding of the seat. The Voltage is converted from a real output to a binary output which is created by Arduino. The application can read the amount of 0's and 1's and can convert that into images. The used pressure pad detects weight from 20 kg and higher.<br\> 7: <br\> Next to PIR, infrared beams could be used that detect when interrupted. Can be either active or passive: Passive sensors sense IRradiation and with that can find moveing direction, active sensors actually can locate the person. Ultrasonic sensor works approxiametly the same way. Test in South Africa: 28000 Rand (1866 euros) per bus with 1 sensor per door. This gives an accuracy level of 95%, while 3 sensors per door give 99%. Other methods are also given in this article, giving treadle mats, IR again, load cell and normal camera.<br\> 8: <br\> Tapeswitch is a company that produces copyright public transport equipment. Among those also belongs the treadle mat which already are in use at Amtrak trains, Copenhagen and melbourne. These mats commenly are produced with multiple zones that have different functionalities: Opening and closing a door or actions such as counting passengers. <br\> 9: <br\> Instant counting is a company that provided treadle mats with the provided software. This software is capable of detecting the movement of a person when boarding/deboarding. It is possible to link 90 of these mats to eachother in one system. An interface shows the amount of people entering and the amount of people exiting. The system can detect direction of walking and can track different people simmultaniously.
10:
Maybe not directly relevant, but we could take into account how people walk accros the station to the destinated train to improve user experience (USE-aspects)
11:
A system that estimated the number of passengers using the weight of the train. This has the huge advantage that errors in measurement do not propagate (ex: if you use an infraredsensor and you miss one passenger leaving, the system will always keep counting one too many. Weightsensors don't have this issue)
See 13 (<- not an article), appearantly, the ns is already doing this, so we need to expand on this idea.
Appearantly, this idea has been pattented (see 16)
12:
Using face recognition. Might be a bit overkill to install an entire camera for this one purpose, and might give some privacy issues, but seems straigforward
14:<br\> Counting with IR can sometimes give difficulties in dense areas. Image sequence processing does not. Divided into two parts: Target detection and target validation and direction-estimation. This way, the algorithm is rather fast. The system is more accurate and still fast in dense areas.
17:
A study on how to interpret data from multiple pressure sensors (a "pressure mat")
18:
This company counts the ammount of people going in or out a door using sensors that track WiFi/BLE/Bluetooth-enabled devices. When someone walks past this sensor with his mobile phone he wil get counted and tracked with a user ID. When he later leaves the door, the count will go down again.
19:
NS launches an app, that helps find passangers train seating, by putting weight sensors in the tracks, which measure the weight distribution of each carriage.
20:
Research from TU Delft about spreading passangers over the platform. Giving crowdness information did not lead to much more spreading. Giving passengers personal boarding advice has better results.
21:<br\> Available techniques of APC suffer from using sequences of seperate frames, where much energy is being lost. To address this issue, this paper proposes a semisupervised methodology to extract temporal consistency in a continuous sequence of unlabeled frames. The experimental results show that this is more robust and does not require much training data 22:
This study examines the planning and analysis of station passenger queuing and flows to offer rail transit station designers and transit system operators guidance on how to best accommodate and manage their rail passengers.
23:
Study of passanger flows, with hypothesis about passanger behaviour. They study the important factors for stations getting more crowded.
24:
Analysis on how passengers distribute along the platform.
25:
Application of a luminous platform in Stuttgart-Bad Cannstatt station