Line Detection

Design Choice

The purpose of detecting lines is to identify the lines that enclose the field and be able to referee an out of pitch ball or a goal scored. Along with ball detection, a vision based method was required to gain accuracy while refereeing without using invasive methods on the ball or the pitch.

Methodology

Similar to the circular shape matching described in the ball detection approach, here the Hough transform is used to detect lines. Before doing so, several steps must be performed:.

1. Undistort image to get straight lines (In case a wide/fisheye camera is used)

2. Apply a color mask to get only the lines on the frame

3. Line Detection

Camera Calibration App. Source: MATLAB

Undistort image (If applicable)

In order to undistort the image to get the real perspective you should get the transformation matrix between the frame and the real world. Thus, the camera parameters should be known. If this are not known you can always calibrate the camera based on the output of a specific object with several frames from different perspectives. The commonly used technique is to use a calibration template with black and white squares of the same length disposed alternatively like a ‘chessboard’. Then, you will only need to know the real size of the squares to calibrate it. In this project, the ‘Camera Calibration’ App from MATLAB was used to get the camera parameters.

Original frame (left). Result after undistorting the image (right)

The result after applying the correct transformation matrix should be getting the real straight lines within the frame:

Result after applying Red Ball & Line mask + undistorting

Apply a color mask to get only the lines on the frame

See Ball Detection color filtering section for a detailed explanation.

Line Detection

In the last step, the Hough transform is used to get lines candidates after some pre-processing has been done, e.g. RGB to black and white conversion, thinning, etc.

The main concern here is to be able to select the correct lines to enable the refereeing. The selecting process used in this project involves the following steps:

• Clustering lines with similar ‘rho’ and ‘theta’ (For definitions of these parameters see Hough transform MATLAB). The real number of lines detected will be the number of clusters identified under a pre-defined ‘rho’ and ‘theta’ threshold.

• Selecting the longest line segment within each cluster detected as a representative of that line.
• Filtering the real outer lines out of all the candidates by comparing them to the information provided by the Field Line predictor.

Line detection performed in the pre-processed frame

Thus, in the end, we will compare the ‘rho’ and ‘theta’ of the candidate lines provided by the Hough transform with the ‘rho’ and ‘theta’ estimation of the outer lines provided by the Field Line predictor that takes into account the drone/camera position, FOV, height and psi/yaw angle. One condition to enable Refereeeing Out of Pitch is to have a positive matching between the lines detected and the outer lines references provided by the Field Line predictor.

Line detection output

The Line Detection sub-task outputs the best line candidates detected.

Use in refereeing

One condition to enable Refereeing Out of Pitch is to have detected and matched the lines detected with the references provided by the Field Line predictor.