Leafsnap: An Electronic Field Guide

Columbia University, the University of Maryland, and the Smithsonian Institution are working on visual recognition software to help identify species from photographs. Leafsnap is the first in a series of electronic field guides being developed to demonstrate this new technology. This free mobile app helps identify tree species from photographs of their leaves and contains beautiful high-resolution images of their flowers, fruit, petiole, seeds, and bark. Leafsnap currently includes the trees of the Northeast and will soon grow to cover the trees of the entire continental United States.

Leafsnap turns users into citizen scientists, automatically sharing images, species identifications, and geo-coded stamps of species locations with a community of scientists who will use the stream of data to map and monitor the ebb and flow of flora nationwide.

The Leafsnap family of electronic field guides aims to leverage digital applications and mobile devices to build an ever-greater awareness of and appreciation for biodiversity. Click on "Species" above to browse Leafsnap’s gallery of species.

The genesis of Leafsnap was the realization that many techniques used for face recognition developed by Professor Peter Belhumeur and Professor David Jacobs, of the Computer Science departments of Columbia University and the University of Maryland, respectively, could be applied to automatic species identification.

Professors Jacobs and Belhumeur approached Dr. John Kress, Chief Botanist at the Smithsonian, to start a collaborative effort for designing and building such a system for plant species. Columbia and the University of Maryland designed and implemented the visual recognition system used for automatic identification. In addition, Columbia University designed and wrote the iPhone, iPad, and Android apps, the leafsnap.com website, and wrote the code that powers the recognition servers. The Smithsonian was instrumental in collecting the datasets of leaf species and supervising the curation efforts throughout the course of the project. As part of this effort, the Smithsonian contracted the not-for-profit nature photography group Finding Species, which collected and photographed the high-quality photos available in the apps and the website.

For press inquiries, please email press@leafsnap.com.

Leafsnap in the news!

Frequently Asked Questions

How do I create an account?
The first time you take a photo, it automatically creates an account for you, after which you can go to the options screen and change your username and/or password.
How do I label a potential match as the correct species?
Simply "swipe" across the result to mark it as that species.
How do I delete an image from my collection?
Simply "swipe" across the image on the collection page to delete it.
Why was my leaf not recognized?
Photos of leaves must be taken with a single leaf on a fully-white background for our automatic algorithms to find them. Also, keep in mind that the app must first send the image to our servers for processing, and so you must have a working internet connection when you press "Snap It!" No internet connection is required to browse through the rest of the field guide, however.
When will there be an Android version of Leafsnap?
We have one under development, but since the app is free and the work is being done by volunteers, we do not have a release date, nor a firm guess as to when this will be.
Will there be a Blackberry/Palm/Windows Mobile/Windows/Computer version of Leafsnap?
We are working on a volunteer basis and thus have to prioritize our efforts. Our primary goals are to expand coverage and release an Android app first. After that, we will consider additional platforms if there is sufficient demand.
When will you have coverage of my city/region/country?
We are working to first complete coverage of the Northeast US, then the rest of the United States, and finally the rest of the world.
I am a botanist, ecologist, arborist, or tree expert, and would like to volunteer in future collection efforts. How can I do this?
Please email us at volunteer@leafsnap.com - we are keeping a list of those experts that have offered to volunteer, with the hope of building such a collaborative mechanism in the near future.
I am not an expert on trees but would like to help in collecting photographs. How can I do this?
Please email us at volunteer@leafsnap.com - we are keeping a list of potential volunteers that could help with collecting field photographs.

Columbia University

Aman Agrawal improved the performance of the feature extraction code.

Guangyu Sun is investigating new leaf identification algorithms.

Chun-Kang Chen is automating the backend processing pipeline.

Wei Li designed the Leaflet game and has worked on automating our image editing pipeline.

Jacky Jacob helped develop the iPhone app.

Emma Liu is developing the iPad app.

Yu Huang is working on testing the website and API.

Wei An is developing the website.

Ivy Deliz started the iPad app, helped develop the iPhone app, and lent a hand in the design of the Leaflet game.

Peter Belhumeur supervises the Columbia team.

Wenxin Zhu is developing the Android app.

Yi Zhang is developing the Android app.

Peiti Li is developing the website.

Weikang Wan is building an automated tool for data curation.

Jian Ma originally created the website and is working on its design.

Vinay Kumar stress-tested the backend and worked on database management.

Gaurav Agrawal explored the use of SIFT for leaf recognition.

Yu-Wei Chang is developing the iPad app.

Oliver Sui is developing the Android app.

Yin Liu is developing the website.

Paul Vishayanuroj is developing the iPhone app.

Sean White lead the design and development of early tablet PC, UMPC, and mobile phone prototypes and helped with the initial design of the current iPhone app.

Neeraj Kumar is leading the software development effort.

Priyank Singh worked on improving the leaf identification algorithms.

Joseph Lin helped develop the iPhone app and was one of the original Central Park Collectors.

Steve Feiner is helping supervise the design of the user interfaces.

Vincent Zeng worked on profiling and porting the segmentation and recognition code to the iPhone.

Ila Agrawal helped with leaf identification.

Qi Liang helped work on the website design.

University of Maryland

Aditya Malik is working on image segmentation for leaves.

David Jacobs supervises the University of Maryland team.

Joao Soares is working on image segmentation for leaves.

Haibin Ling designed the original leaf recognition algorithm and participated in the development of the initial electronic field guide (EFG) prototype.

Angjoo Kanazawa is working on improving the leaf recognition algorithm.

Arijit Biswas is working on improving the leaf identification algorithms.

Daozheng Chen has worked on speeding up the recognition code.

Smithsonian Institution

Ellen Farr is the Smithsonian Botany Department computer specialist.

Norm Bourg, PhD., was the plant specimen collector for much of the project.

Daniel Grant is a long-term volunteer in the Smithsonian Botany Department. He assists with specimen and image data processing.

Rusty Russell, US Herbarium Manager, is the Smithsonian co-investigator for the project.

W. John Kress, PhD. is the Principal Investigator of the Leaf Project at the Smithsonian.

Ingrid Pol-Yin Lin is the Smithsonian photographer who images voucher specimens and leaves used in the project.

James Short is a long-term volunteer in the Smithsonian Botany Department. He assists with specimen and image data processing.

Jamie Whitacre is the Smithsonian database developer for the project.

Ida C. Lopez is the project coordinator at Smithsonian. She also led the collection expedition into the wilds of Central Park in New York City.

Finding Species

Roxana Bravo has refined details in the high-resolution photographic method, and has photographed plants.

Michelle Downey collects plants in the Southeastern US and processes photographs.

Michael Honsaker has provided technology support and maintained photographic metadata.

Tanya Tarasova has researched flowering times, coordinated expeditions, and assisted with permits. She has provided administrative oversight.

Diego Acosta assists with processing and editing photographs, and photographs plants on special expeditions.

Bejat McCracken is the current lead US photographer for LeafSnap from Finding Species and selects high-resolution photographs.

Martin Bustamante coordinates the Finding Species photographers and solves photographic challenges.

Hugo Mogollon supervises the Finding Species team, in the US and South America.

Leonel Velasquez trains the Finding Species botanical photographers. He photographs plants for LeafSnap on special expeditions.

Matthew Smith has collected plants in the DC area.

Yuri Huta created Finding Species'' photographic method for the high-resolution photographs in LeafSnap, and has photographed plants.

Margot S. Bass coordinates the Finding Species LeafSnap US team, and conceived of the standardized high-resolution plant photographs.

Linda Keenan writes the Plant Profiles and has collected plants in the DC and Boston areas.

Gorky F. Villa Muñoz is the current lead botanist for LeafSnap from Finding Species, collecting and photographing plants throughout the US.