Thanks to recent advances in deep learning, the visual recognition abilities of machines have improved dramatically, permitting the practical application of computer vision to tasks ranging from pedestrian detection for self-driving cars to expression recognition in virtual reality. One area that remains challenging for computers, however, is fine-grained and instance-level recognition. Earlier this month, we posted an instance-level landmark recognition challenge for identifying individual landmarks. Here we focus on fine-grained visual recognition, which is to distinguish species of animals and plants, car and motorcycle models, architectural styles, etc. For computers, discriminating fine-grained categories is challenging because many categories have relatively few training examples (i.e., the long tail problem), the examples that do exist often lack authoritative training labels, and there is variability in illumination, viewing angle and object occlusion.
To help confront these hurdles, we are excited to announce the 2018 iNaturalist Challenge (iNat-2018), a species classification competition offered in partnership with iNaturalist and Visipedia (short for Visual Encyclopedia), a project for which Caltech and Cornell Tech received a Google Focused Research Award. This is a flagship challenge for the 5th International Workshop on Fine Grained Visual Categorization (FGVC5) at CVPR 2018. Building upon the first iNaturalist challenge, iNat-2017, iNat-2018 spans over 8000 categories of plants, animals, and fungi, with a total of more than 450,000 training images. We invite participants to enter the competition on Kaggle, with final submissions due in early June. Training data, annotations, and links to pretrained models can be found on our GitHub repo.
iNaturalist has emerged as a world leader for citizen scientists to share observations of species and connect with nature since its founding in 2008. It hosts research-grade photos and annotations submitted by a thriving, engaged community of users. Consider the following photo from iNaturalist:
 |
| The map on the right shows where the photo was taken. Image credit: Serge Belongie. |
In contrast to other image classification datasets such as ImageNet, the dataset in the iNaturalist challenge exhibits a long-tailed distribution, with many species having relatively few images. It is important to enable machine learning models to handle categories in the long-tail, as the natural world is heavily imbalanced – some species are more abundant and easier to photograph than others. The iNaturalist challenge will encourage progress because the training distribution of iNat-2018 has an even longer tail than iNat-2017.
 |
| Distribution of training images per species for iNat-2017 and iNat-2018, plotted on a log-log scale, illustrating the long-tail behavior typical of fine-grained classification problems. Image Credit: Grant Van Horn and Oisin Mac Aodha. |
FGVC5 will be showcased on the main stage at CVPR 2018, thereby ensuring broad exposure for the top performing teams. This project will advance the state-of-the-art in automatic image classification for real world, fine-grained categories, with heavy class imbalances, and large numbers of classes. We cordially invite you to participate in these competitions and help move the field forward!
Acknowledgements
We’d like to thank our colleagues and friends at iNaturalist, Visipedia, and FGVC5 for working together to advance this important area. At Google we would like to thank Hartwig Adam, Weijun Wang, Nathan Frey, Andrew Howard, Alessandro Fin, Yuning Chai, Xiao Zhang, Jack Sim, Yuan Li, Grant Van Horn, Yin Cui, Chen Sun, Yanan Qian, Grace Vesom, Tanya Birch, Wendy Kan, and Maggie Demkin.
There’s nothing we spend more money on for a worse experience than housing. Keyo wants to fix all of it. The audacious startup envisions a world where a building’s other tenants get $20 to show you an available apartment on your schedule. Where you auto-pay your rent online and it improves your credit score. Where you get local business perks and can communicate maintenance… 
Filed under moves that are potentially groundbreaking with big implications but with quite small numbers, Facebook has signed an exclusive deal with the MLB to stream 25 afternoon games, according to Bloomberg. The deal is a bit reminiscent of the one Twitter signed for Thursday Night Football back in 2016 to stream games that are outside of the range of primetime football (usually reserved… 
Just weeks after signing a large licensing deal with leading indy label representative ICE, Facebook has continued its march into the world of music with the news that it has now added Warner Music Group into the mix, the last major label that was not yet working with the social network. Facebook has signed a wide-ranging licensing deal that covers all of Warner Music’s recorded and… 
It’s Mario Time! Beloved gaming character Mario is coming to Google Maps, thanks to a partnership between Google and Nintendo ahead of Mario Day, March 10. (MAR10…get it, Mario?) In addition to the various deals and sales on Nintendo games, the mustachioed plumber will also make an appearance in Google Maps’ navigation, if you opt in to have Mario accompany you on your… 
The storied 911 will not be immune from Porsche’s electrification plans and that could be a good thing. The car company’s CEO recently told Autocar that the hybrid 911 “will be the most powerful 911 we’ve ever had; 700 bhp might be possible.” Count me in (as long as someone buys it for me). Porsche already makes 911 models above the 700 mark so it’s likely… 
Social planning apps have yet to take the world by storm. A handful of these apps tried and failed years ago, and even Swarm decided to ditch that methodology and focus on location logging. But a new Y Combinator-backed company seems to be picking up traction. And shockingly enough, the winning ingredient seems to be location! Location! Location! The startup is called Playbook, and its main… 
Waymo’s autonomous trucking program is coming along – though we haven’t heard much about it since discovering it was a real thing last year, Waymo today announced that it’s launching a pilot program in Atlanta to focus specifically on self-driving trucks and automated logistics. The pilot is being done in partnership with Google, another Alphabet company and… 
“Facebook has played at times a negative role in the political discourse,” according to Facebook co-founder and Mark Zuckerberg’s Harvard roommate Chris Hughes. “The algorithms are not neutral,” he said today at a Bloomberg Beta event promoting his new book Fair Shot: Rethinking Inequality and How We Earn. Mentioning “the filter bubbles” and… 
Samsung’s new Galaxy S9 may not quite live up to the iPhone X when it comes to Samsung’s implementation of a Face ID-style system or its odd take on AR emoji. But that’s not going to matter much to Samsung device owners – not only because the S9 is a good smartphone overall, but because Android users just aren’t switching to iPhone anymore. In fact, Android users… 
You may remember that in December, a pair of new planets was discovered via machine learning, using NASA data and Google Brain ingenuity. If you’re interested in doing the same, the team behind the system has just released the code they used to accomplish this astronomical achievement, which they call AstroNet. 
Over the last couple of years, Google has been slowly (very slowly!) opening up the ability for celebrities, politicians, sports teams, museums and local businesses to post social media-like updates directly to its search result pages. Today, after testing this in a few markets over the course of the last year, Google is also opening this feature up to musicians in the U.S. This means that… 
The rapidity with which falsity travels is proverbial: “Falsehood flies, and the Truth comes limping after it,” wrote Swift in 1710. Yet evidence of this common wisdom has been scarce. A new study from MIT looks at a decade of tweets, and finds that not only is the truth slower to spread, but that the threat of bots and the natural effects of social media are no excuse:… 
Bixby is, by far, the most frustrating part of the S9. It’s true, of course, that no voice assistant is perfect, but a full year after Samsung’s smart assistant debuted on the Galaxy S8, it still feels unfinished. Of course, the company’s made some significant progress, and a slew of artificial intelligence startup acquisitions point to an offering that’s going to… 
There are tons of services out there from Slack to Jira that are designed to help developers communicate with one another about code issues, but there is a surprising dearth of tools that have been purpose-built to provide communication capabilities right in the IDE where developers work. CodeStream, a member of the Y Combinator Winter 2018, aims to fix that. “We are team chat in your… 
Google’s AMP project is not uncontroversial. Users often love it because it makes mobile sites load almost instantly. Publishers often hate it because they feel like they are giving Google too much control in return for better placement on its search pages. Now Google proposes to bring some of the lessons it learned from AMP to the web as a whole. Ideally, this means that users will… 
