TrafficCAM: A Versatile Dataset for Traffic Flow Segmentation

Zhongying Deng1,2
Yanqi Cheng1
Lihao Liu1
Shujun Wang1
Rihuan Ke3
Carola-Bibiane Schönlieb1
Angelica I. Aviles-Rivero1

1University of Cambridge      2University of Surrey     3University of Bristol
affiliations

[Paper]
[Dataset]
The image provides a quick visualisation of the image with annotations in the dataset.
This is a website made for TrafficCAM: A Versatile Dataset for Traffic Flow Segmentation. The benchmark dataset-TrafficCAM will be released soon.

Abstract

Traffic flow analysis is revolutionising traffic management. Qualifying traffic flow data, traffic control bureaus could provide drivers with real-time alerts, advising the fastest routes and therefore optimising transportation logistics and reducing congestion. The existing traffic flow datasets have two major limitations. They feature a limited number of classes, usually limited to one type of vehicle, and the scarcity of unlabelled data. In this paper, we introduce a new benchmark traffic flow image dataset called TrafficCAM. Our dataset distinguishes itself by two major highlights. Firstly, TrafficCAM provides both pixel-level and instance-level semantic labelling along with a large range of types of vehicles and pedestrians. It is composed of a large and diverse set of video sequences recorded in streets from eight Indian cities with stationary cameras. Secondly, TrafficCAM aims to establish a new benchmark for developing fully-supervised tasks, and importantly, semi-supervised learning techniques. It is the first dataset that provides a vast amount of unlabelled data, helping to better capture traffic flow qualification under a low cost annotation requirement. More precisely, our dataset has 4,402 image frames with semantic and instance annotations along with 59,944 unlabelled image frames. We validate our new dataset through a large and comprehensive range of experiments on several state-of-the-art approaches under four different settings: fully-supervised semantic and instance segmentation, and semi-supervised semantic and instance segmentation tasks.


Demo


Dataset Description



(a) Geographic distribution of TrafficCAM collection.
(b) Correlation analysis.
(c) Dataset statistics regarding complexity: the frequency of images with a fixed number of annotated object instances per image.
(d) Illustration of number of images per category.


Paper and Supplementary Material


Zhongying Deng, Yanqi Cheng, Lihao Liu, Shujun Wang, Rihuan Ke, Carola-Bibiane Schönlieb and Angelica I. Aviles-Rivero.
TrafficCAM: A Versatile Dataset for Traffic Flow Segmentation
(hosted on ArXiv)


[Bibtex]


Acknowledgements

ZD, AIAR and CBS acknowledge support from the EPSRC grant EP/T003553/1. YC and AIAR greatly acknowledge support from a C2D3 Early Career Research Seed Fund and CMIH EP/T017961/1, University of Cambridge. LL gratefully acknowledges the financial support from a GSK scholarship and a Girton College Graduate Research Fellowship at the University of Cambridge. AIAR acknowledges support from CMIH and CCIMI, University of Cambridge. CBS acknowledges support from the Philip Leverhulme Prize, the Royal Society Wolfson Fellowship, the EPSRC advanced career fellowship EP/V029428/1, EPSRC grants EP/S026045/1 and EP/T003553/1, EP/N014588/1, EP/T017961/1, the Wellcome Innovator Awards 215733/Z/19/Z and 221633/Z/20/Z, the European Union Horizon 2020 research and innovation programme under the Marie Skodowska-Curie grant agreement No. 777826 NoMADS, the Cantab Capital Institute for the Mathematics of Information and the Alan Turing Institute. The authors also greatly acknowledge KritiKal and Christina Runkel for their insightful discussion.