Data Collection and Analysis
The widespread availability of computers and inexpensive sensors is making it possible for city residents to collect and analyse transport data in ways that could hardly be imagined just a few years ago. Residents can use sensors in their smart phones or purpose-built sensors to monitor air quality, count traffic or trace their trips. They can combine this data with open data sets to create new applications or analyse data in new ways. This page summarises crowdsourced data collection and analysis.
Sensor Based Data Collection
The ability of residents to collect data means that agencies can no longer hide behind data. It’s possible for neighbourhood residents to measure air quality or traffic volumes themselves. They can use this information to check official figures and/or develop their own ideas for solving transport problems.
For example, Japanese citizens were the first to publicly describe radiation impacts of the Fukushima earthquake, the government was forced to take action after citizens publicised the data. The European Commission’s Making Sense Project is developing a toolkit to help residents develop and use sensors to improve their environment.
In the transport-related sector sensors have been developed for:
GPS Tracking Data Collection
The GPS function in mobile devices enables applications to track users as they travel. These data are an excellent source of planning and transport information. They show paths actually taken by users (more accurate than questionnaires) and also enable users to add information to maps (for example: problem locations). It’s also possible to track users in real time to obtain actual speed information (e.g., WAZE tracks users to understand roadway congestion).
Tracking applications have been developed for all transport modes. Many bicycling and walking apps have been developed commercially as “fitness” apps. They represent a goldmine of information for planners and agencies, but require making agreements to obtain the data.
Open Source Data
Open source data is information provided by agencies and organisations (e.g., geographic and socio-economic data). Agencies make this data available for residents to use and analyse.
The great benefit of open source data is that residents often think outside of traditional silos. They combine data sets from different agencies and in different ways. This makes it possible to draw new conclusions and identify potential improvements, especially more comprehensive ideas.
Many agencies organise Hackathons to develop new apps using open source data, an excellent resource is: New York’s Pursuit of a More Useful App Contest from the Atlantic’s CityLab.
Public agencies are increasingly offering their data via open source. Many agencies require users to sign an agreement to access and use the data. It’s important that agencies offer data in machine readable formats rather than scanned copies of data tables via pdf.
Transitland collects and standardizes public data sets for developers. Read more from Wired: Transit nerds get a handy new tool for easily turning data into apps by Aarian Marshall, 7 June 2016.
Transport for London is a leader in providing open data about its services. Here’s a case study on open data at Transport for London.
The World Bank is supporting efforts to make traffic data open as part of the Open Traffic Partnership. Read more at: Open Traffic Data to Revolutionize Transport from the World Bank’s website (December 2016).
GovLab and the Omidyar Network have developed a website (http://odimpact.org/) with detailed open data case studies from around the world. It’s an excellent resource for anyone interested in open data. One of the case studies coming soon document’s Transport for London’s fantastic open data program.
The real value of resident-collected data is created when residents share their data so that others can analyse it and use it in their own applications (in other words, it’s good for residents to provide open access to their data, just like it’s good for government to do so).
There are a variety of networks developed to share user collected data. Often sensor builders create their own data sharing network on the Internet as part of the project. For example you can go to the Smart Citizen site to see all the data collected with the Smart Citizen environmental data sensors worldwide.
More information about data networks is available from the following resources:
Citi-Sense Project – is an EU funded research project designed to help facilitate creation of a “sensor-based Citizens’ Observatory Community for improving quality of life in cities”. The CITI-SENSE Citizens’ Observatory Web Portal provides an access point to all the apps, widgets, web pages and sensor based tools and questionnaires developed in the project. The website includes information about using the apps, accessing data collected, and general information about sensing devices, and how to use them.
Citizen-Generated Data and Governments: Towards a Collaborative Model – is a research report by Christopher Wilson and Zara Rahman describing “how government hosting of citizen‑generated data sets (CGD) can meet the needs of both governments and civil society, and open up opportunities for increased collaboration between government and civil society on collecting and sharing data, and using data to monitor and enhance progress on sustainable development. The report describes (1) the idea, (2) the incentives, obstacles and benefits in the context of open data, and (3) a model for this type of collaboration. More information on the report from DataShift.
Citizen Sense – is a European Research project investigating the relationship between technologies and practices of environmental sensing and citizen engagement. Projects include using sensors to map and track flora and fauna (Wild Sensing), using sensors to monitor environmental quality (Pollution Sensing), and, using sensors in smart city projects (Urban Sensing).
The Internet of Anything: A Social Network for the World’s Online Sensors – WIRED article by Klint Finley (12.08.2014) describes OpenSensors.io, a project by Atomic Data Labs built to simplify large scale publishing and subscribing of device data. Thanks GovLab.
Living Mobs – is an application developed by Gómez-Mont, Jose Castillo and Carlos Gershenson designed to use big data to solve Mexico City’s traffic problems. The plan includes Living Mobs, a data-donating platform that collects information on origin and destination, transit times, and modes of transit. Read more on Next City: How a Mexico City Traffic Experiment Connects to Community Trust.
Blog Posts: Data
Project Sidewalk is designed and operated by the Makeabilty Lab at the University of Maryland. The project’s interactive tool allows you to rate the accessibility of sidewalks in the Washington DC area based on Google Streetview photos. According to the website “You virtually walk through city streets and mark accessibility attributes such as missing curb ramps, blocked […]
The Boston area public transport operator MBTA held a competition during the summer to select an “endorsed” user application. The agency decided that having a single, full service app can provide a tremendous improvement in customer experience. The MBTA evaluated four apps: Transit App, Moovit, Swiftly and Moovel. In September 2016 the MBTA chose Transit App […]
radwende.de is a really neat project from Wiesbaden Germany. They use a GPS tracking app to crowdsource bike trips and then turn the information into a beautiful map you can hang on the wall. Of course they use the data too to help determine where people ride in the city to help planners improve bike […]
Chicago is installing sensors throughout the city in a project called Array of Things (AoT) to collect a wide variety of data. The sensor data will be provided to the public for analysis via the city’s open data policy. This is an excellent example of sharing data so residents can use it to help improve […]