Tip Trick Here: 12/21/17

21 December 2017

Talent trickles out of Snapchat as Timehop founder leaves

Less than a year after joining Snapchat, social media nostalgia app Timehop’s founder Jonathan Wegener is departing the company. He tells TechCrunch he wants to build his own thing again, but the fact that the #1 teen social network isn’t exciting enough to stay at is telling. Share prices are down, user growth has slowed to a crawl in the face of Instagram’s competition,… Read More
Read Full Article

Evaluation of Speech for the Google Assistant

Posted by Enrique Alfonseca, Staff Research Scientist, Google Assistant

Voice interactions with technology are becoming a key part of our lives — from asking your phone for traffic conditions to work to using a smart device at home to turn on the lights or play music. The Google Assistant is designed to provide help and information across a variety of platforms, and is built to bring together a number of products — including Google Maps, Search, Google Photos, third party services, and more. For some of these products, we have released specific evaluation guidelines, like Search Quality Rating Guidelines. However, the Google Assistant needs its own guidelines in place, as many of its interactions utilize what is called “eyes-free technology,” when there is no screen as part of the experience.

In the past we have received requests to see our evaluation guidelines from academics who are researching improvements in voice interactions, question answering and voice-guided exploration. To facilitate their evaluations, we are publishing some of the first Google Assistant guidelines. It is our hope that making these guidelines public will help the research community build and evaluate their own systems.

Creating the Guidelines
For many queries, responses are presented on the display (like a phone) with a graph, a table, or an interactive element, like you’d see for [weather this weekend].

But spoken responses are very different from display results, as what’s on screen needs to be translated into useful speech. Furthermore, the contents of the voice response are sometimes sourced from the web, and in those cases it’s important to provide the user with a link to the original source. While users looking at their mobile device can click through to read the original web page, an eyes free solution presents unique challenges. In order to generate the optimal audio response, we use a combination of explicit linguistic knowledge and deep learning solutions that allow us to keep answers grammatical, fluent and concise.

How do we ensure that we consistently meet user expectations on quality, across all answer types and languages? One of the tools we use to measure that are human evaluations. In these, we ask raters to make sure that answers are satisfactory across several dimensions:

Information Satisfaction: the content of the answer should meet the information needs of the user.
Length: when a displayed answer is too long, users can quickly scan it visually and locate the relevant information. For voice answers, that is not possible. It is much more important to ensure that we provide a helpful amount of information, hopefully not too much or too little. Some of our previous work is currently in use for identifying the most relevant fragments of answers.
Formulation: it is much easier to understand a badly formulated written answer than an ungrammatical spoken answer, so more care has to be placed in ensuring grammatical correctness.
Elocution: spoken answers must have proper pronunciation and prosody. Improvements in text-to-speech generation, such as WaveNet and Tacotron 2, are quickly reducing the gap with human performance.

The current version of the guidelines can be found here. Of course, guidelines are often updated, and these are just a snapshot of something that is a living, changing, always-work-in-progress evaluation!

Audiophiles Will Crave These Noise-Canceling Headphones

Headphones enhance a variety of activities. From music listening to hands-free calling, gaming, and even movie watching, a robust pair of headphones is a must for anyone. However, noise-canceling headphones elevate audio consumption. Through filtering outside sounds, these isolate the audio pumping through the cans. Need to reduce noise pollution? These are the best noise-canceling headphones available for audiophiles. Why Buy Noise-Canceling Headphones Noise-canceling headphones offer plenty of benefits over standard headphones. Namely, noise-canceling headphones fight noise pollution. That snoring guy in the window seat next to you in what’s definitely not first class? Not a problem. Your obnoxiously loud...

Read the full article: Audiophiles Will Crave These Noise-Canceling Headphones

Pages

21 December 2017