Robot control software
For the behaviour of the NXT Robots a state-based algorithm has been used. There are several main states in which te robot can be:
- 1. Searching straight ahead
- 2. Turning
- 3. Found something
- 4. Check if the object is too heavy
- 5. Push the object away
- 6. Ask for help
This behaviour has been visualized in the following flowchart:
Localisation
The localisation of the robots is a very important part of the project. With localisation, the robot is able to keep track of its own position and direction. This is of high importance when a robot encounters a heavy object, because now it can find out which robot is the nearest to him and ask this specific robot for help. Besides the localisation, also a bluetooth-communication script is necessary to accomplish this. The way this communication is drafted and scripted is written in Bluetooth Communication.
Programming the Localisation
We created a square field in which the robots would be present the entire time. The center of the field would have the coordinates (0,0). Since the field is 2 x 2 meters and distance in the code is expressed in centimeters, the corners of the field have the following coordinates: (-100, -100), (100, -100), (100, 100) and (-100, 100). A schematic representation of the field is given:
The dotted lines are not present in the real world. They are in this schematic picture to clarify the (0,0) point in the field.
To begin, first the following information should be a given for the robot:
- Its beginposition (x- and y-coordinate)
- Its begindirection (angle of its direction with respect to the x-axis)
From this point on the rotation sensor inside of the actuators used for the NXT Robots are used to keep track of the robot's position. When the wheels of the robot are rotating, the robot is either going forward, going backwards or turning. This has to be taken into account when converting the steps of the motor to either angle or distance.
When the robot is going forward, the rotation sensor counts the steps that the actuator makes. These steps are then converted to a distance in the java script. To calculate this convergence factor, the robot was programmed to drive forward and continuously print the steps of the actuators on its display until the pressure sensors gave a value above zero. Next, the robot was placed at an exact distance of 1 meter from a heavy object. After hitting the heavy object the values of step was read and the convergence was calculated by dividing 100 by the amount of steps. This gave us the amount of steps per centimeter. This was done 3 times and the average value was exactly 35 steps. So in conclusion, from here the robots were able to drive a given straight distance with an inaccuracy of approximately 1 cm.
This same principle was used to establish the amount of steps per degree of turning. We entered an amount of steps (positive for one actuator, negative for the other) so the robot would start turning. This was done until the amount of steps for turning 360 degrees was known. After this the convergence factor from steps to degrees turned out to be 5/31.
From here we were able to make the robots go to any given position. However, an inaccuracy of approximately 5 degrees was found in the turning of the robots, due to slipping and the inaccuracy of the rotation sensors in the actuators themselves. This lead to the fact that when the robot was following a route, the inaccuracy of keeping track of its location, increased after every turn the robot made.
The way the convertion of steps to distance and degrees is calculated, is shown below:
[math]\displaystyle{ X += -T/35)*cos(F) }[/math]
[math]\displaystyle{ Y += (-T/35)*sin(F) }[/math]
[math]\displaystyle{ F = F-Radians(D) \mod 2 \pi }[/math]
As you can see, the Tachocounter (rotationsensor of the actuator) is reset before it starts moving straight, backwards or starts turning. Also the script shows that the robots will move straight ahead for the amount of 10.000 steps. This is a random high number. This means that the robots will move straight ahead until they end up in another state. Other states the robot could end up in are:
- The "Out of Bounds" state, where the robot has reached one of the borders of the field.
- The "Go to object" state, where the robot encounters an object.
- The *Asking for help" state, where the robot determines which robot is nearest to him and asks this robot to help him.
- The "Going to help" state, where the robot is on its way to another robot that needs help, pushing a heavy object out of the perimeter.
Out of Bounds State
Each robot is equipped with a light sensor that points to the ground. This light sensor is shown in the Figure below:
The area in which the robot should stay is set up with tape that has a different color than the surface the robots are driving on.
Whenever the light sensor of a robot detects the change of light intensity, caused by the tape, the robot will end up in the "Out of Bounds" state. Whenever the robot reaches the tape, it will go backwards for 30 centimeters and will then turn 120 degrees. After this the robot goes back to the first state in which it will drive straight again.
Go to Object State
Every robot is also equipped with an ultrasonic sensor which can detect objects. When this sensor detects an object within a distance of 40 centimeters, it will drive towards it. The code for this state is shown below:
Script gedeelte "go to object" state
This code will make the following things happen:
- When the robot drives over the tape, it will return to the "Out of Bounds" state.
- When the robot encounters the object and the object is heavy enough to press in either the left or the right pressure sensor, the robot will go to the "Asking for Help" state.
- When the robot is asked for help before it has encountered the object it will go to the "Going to Help" state.
In short, this will make sure that when the object is light enough not to press in one of the pressure sensors, the robot will push the object out of the perimeter. When the object is so heavy it will press in one of the pressure sensors, the robot will ask for help and when the robot is asked for help by another robot before it encountered a heavy object, the robot will go and help the other robot instead.
Asking for Help State
Whenever the robot is in this state, it means it has encountered an object which was heavy enough to press one or both of the pressure sensors. From here the robot will have to determine which robot is closest to him. To accomplish this, a working wireless communication system is needed and some vector calculations. The communication will be explained in section 2 on this page called "Communication". What happens when the robot ends up in the "Asking for Help" State, is that he will ask both robots to send him their current location. Then, knowing its own position and the position of the other robots, it is able to calculate the distance between itself and the other robots using the Pythagorean theorem. After the robot has determined which robot is nearest to him, he will send his own current location to that specific robot and stops driving.
Now the robot that has to come help has received the coordinates where it should go. From here it will enter the "Going to Help" state.
The process of the robot asking other robots for help is also shown in our video that can be viewed by clicking this link: https://youtu.be/i56Wzx9wmNc.
Going to Help State
As described above, a robot will enter the "Going to Help" state when it is closest to the robot asking for help and has therefor received the coordinates and direction of the robot asking for help.
When the robot comes in this state, it first calculates the coordinates it should go to, which is determined to be 20 centimeters behind the robot that is asking for help. It does this by using the received direction of the robot asking for help and using sine and cosine functions, as shown in the script at the bottom of this section. These calculated coordinates will be referred to as the destination coordinates.
Next, the robot transforms its direction into a unit vector. It does this by taking the sine and cosine of the angle it is pointed in. Next, the robot computes the vector that goes from his own current position to the destination coordinates, it calculated at the beginning of this state.
The last two things the robot has to do is calculate the angle it should make from his starting position to go in the direction of his destination coordinates and the angle it should make after it reaches its destination coordinates to align with the robot asking for help. These two angles will, from here on, simply be referred to as first and second angle respectively.
The first angle is calculated using the dot product as shown in the following formula:
Here vector "a" represents the robot's direction as unit vector. Vector "b" represents the vector that goes from the robot to its destination coordinates.
The only problem that occurred here was that the dot product calculates the sharpest angle between two vectors, but we programmed the robots to always turn left. This meant that whenever turning right would make the smallest angle, the robot would go in the wrong direction, as it would turn left. This problem was fixed by using 5 different if-statements which can also be seen in the code, shown at the bottom of this section. The if-statements determine whether the smallest angle would be to turn left or right.
The code that calculates the destination coordinates, first angle and second angle is shown here:
Case 1 van BTReceive.java
Communication
Asking for help will be done using a bluetooth communication protocol:
Bluetooth
Because the NXT robots use bluetooth communication and several other devices around use this aswell the robots were paired first to make sure it's mac adress inventory contained all the needed content. Whenever a robot has to send a message it will try to connect with one of the robots based on bluetooth-id. Because every robot runs a seperate thread continuously listening for pending bluetooth connections a connecting try to one of the robots will always result in a stable connection in which both robots can send and receive information. However, if another robot wants to send or receive information the current connection has to be terminated because only one connection at a time is possible.
Seperate Receiving Thread
As stated above a seperate thread was used continuously listening for pending connections. Based on the first integer received a certain case within this thread is triggered. The code below shows the way this is implemented.
--put code here---
Used Cases
receive
In the receive thread three cases were used, one of which will be chosen according to the first integer received (0, 1 or 2) when a connection is established.
- 0
The robot checks in which state he is, according to this the integer 'busy' will either get a value 0 or 1. After this the robot will send it's bluetooth id, x location, y location, angle relative to the x-axis and busy value to the robot which tried to connect and send integer 0 first.
- 1
The robot is being asked for help and therefore needs to read the location of the other robot after which the robot will calculate the needed route to go for aid.
- 2
The right route has been traveled and the robot is in location. It will follow the other robots until it is either out of bounds or the pressure sensor is being triggered.
send
In the send function three subfunctions were used: run, help and arrived.
- run
The run function will try to connect to all available robots and send integer 0, after which te other robot will send their location which will be stored using a hashmap with robot id's for keys.
- help
When the shortest distance to both robots is calculated the help function will connect to the closest robot and sent it's own locations to it. This way the other robot can calculate the route to come for aid.
- arrived
When a robot arrives after being called for aid it will send a message to the robot in need to make sure it knows both can start pushing.
Communcations code
put code here
Pseudo Code
hier komt de pseudo code te staan
SRC Code
hier komt de src code te staan
Back to: PRE2015_2_Groep1