Updating Who's On First Neighbourhoods - Part II This is a blog post by stepps00 and zbsingleton that was published on Apr 20, 2017 and tagged whosonfirst, neighbourhoods and data
In a previous blog post, we outlined Mapzen’s efforts to update neighbourhood records in Who’s On First. Since that blog post was published, we’ve been busy updating our records in several major metropolitan areas like Washington D.C., Helsinki, Amsterdam, Chicago and New Orleans, which are all now available in Mapzen’s basemap styles.
We’ve not only updated our records, but we’ve also developed a streamlined approach to importing new sources and adding new properties to existing records. In addition to neighbourhoods, Who’s On First has gained new and updated microhood, macrohood, borough, and locality records. For more information on how we define our placetypes, see our handy placetypes repository.
##How do we update records?
We want to make it straightforward for anyone to contribute, so all of the standard tools Mapzen uses are open-source and freely available for download. The major software tool we use to manually enhancing our Who’s On First data is the QGIS open-source geographic information system.
###Our Workflow
Our workflow revolves around finding authoritative geospatial neighbourhood information and integrating that into our current inventory of records. That means importing new neighbourhoods from open sources and updating current neighbourhood records, often with sourced geometries and attributes. In most situations we reviewed and modified local authoritative sources, but in certain situations where open data was not available, we hand-crafted new neighbourhood shapes.
###Additional Resources
On the surface, the process to update these neighbourhoods is simple, but can get more challenging. Neighbourhoods are usually represented as polygons, but sometimes they are points. We have to consider naming conventions and languages across different sources, as well as making sure neighbourhoods don’t extend outside their locality.
For a more-detailed technical rundown on our process, our updated document on WOF neighbourhoods is a good place to start.
##Where do we find sources?
In our mission to improve Who’s On First records, we often turn to municipal or other authoritative open data portals to furnish the framework for our neighbourhood data. Local governments often provide high-quality maps and data of their neighbourhoods in order to aid in planning or community development efforts, which we can then use to provide more reliable information in Who’s On First.
However, not all data needs to come from government sources. Just as regularly, we use detailed, open neighbourhood data from private entities. Regardless of the source, all data is distributed with a permissive license, often coming in the form of a CC0 or a CC-BY license.
##How can you view sources?
All of the sources we use are listed in our detailed sources page. If you ever wonder where a particular bit of information or property comes from, that page will direct you to its source. This list is updated whenever a new, open-license source is incorporated into Who’s On First. To search an individual source, simply look through our list for the appropriate reference code (“mz”, “wof”, etc.) applicable to the data in question.
##Where have neighbourhood records been updated?
We’ve been busy updating neighbourhood (and associated placetype) shapes; as of this blog post, we have updated administrative features in 35 localities! A list of those places, alphabetically:
- Amsterdam
- Atlanta
- Baltimore
- Berlin
- Boston (including Cambridge and Somerville)
- Chicago
- Denver
- Greater Finland (includes Vantaa, Turku, Tampere, Oulu, Kuopio, Kauniainen, and Espoo)
- Helsinki
- Los Angeles
- Minneapolis & St. Paul
- New Orleans
- New York City
- Oakland
- Philadelphia
- Portland
- Rotterdam
- San Diego
- San Francisco
- San Jose
- Seattle
- The Hague
- Utrecht
- Washington, D.C. (including Arlington and Alexandria)
##Nice list, but how do the new shapes compare?
We can talk all we want about new neighbourhood shapes, but it’s probably best to show these new shapes in Tangram. Below, we have two localites to compare, pre-update and post-update: Denver and Amsterdam.
Note that the original shapes have a more organic, popcorn-looking shape, while the new shapes are more regularly aligned along arterial roads and other major landmarks.
####Denver, Colorado, USA:
- Original neighbourhood features are shown up to zoom 11 (default map zoom) in orange.
- New macrohood features are shown from zoom 11 to zoom 12 in blue.
- New and updated neighbourhood features are shown from zoom 12 to zoom 13 in green.
- New microhood features are shown past zoom 13 in purple.
####Amsterdam, Netherlands:
- Original neighbourhood features are shown up to zoom 11 (default map zoom) in orange.
- New borough features are shown from zoom 11 to zoom 12 in blue.
- New and updated neighbourhood features are shown from zoom 12 to zoom 13 in green.
- New microhood features are shown past zoom 13 in purple.
##In conclusion…
Neighbourhood updates are not over yet; we plan on continuing this work and have many more localities in the pipeline. Keep an eye on our Who’s On First data repository for continued updates!
If you have a specific request or suggestion, please do not hesitate to contact us! Thanks for reading!
Photo Credit: midnightboheme, Pixabay