![]() ![]() Think of learning another language - super helpful to have those captions in that language.” You’re on the train, you’re on the plane, you don’t want audio in certain cases. You’re sitting at I/O and you need to watch a video and you want to do so silently. “Not only to make that media accessible to people who can’t hear or who have trouble hearing, but also for people like us. Meanwhile, “Live Caption is the notion that, at the OS level, we should be able to caption any media on the device,” Kemler explained. You can also type back into it - Live Transcribe is really a communication tool. But unlike Live Caption, it’s a full-screen experience, uses your smartphone’s microphone (or an external microphone), and relies on the Google Cloud Speech API to caption real-time spoken words in over 70 languages and dialects. Live Transcribe also uses machine learning algorithms to turn audio into real-time captions. If you want a transcription tool, Google offers Live Transcribe, released in February. He wouldn’t provide a word error rate target or range for Live Caption, but it’s clearly low enough for Google to confidently include the feature in Android Q. There is no separate app required, no need for a Wi-Fi or data connection, and no perceptible delay. Kemler let me play with the feature on a Pixel 3a, and it did indeed work as described. Unlike TV and film, which by law are required to have captions, user-generated content doesn’t have it.” Even if you took YouTube, that’s 400 hours uploaded every minute, and then think of Facebook, Instagram, Snap, all podcasts, etc. Which also, remember, is the vast majority of content. But for apps where that caption content is not available, which remember is the vast majority of user-generated content. “Not that cloud transcription is perfectly accurate, but it’s going to be a little bit better. Because we took this cloud-based model that was over 100GB and shrank it down to less than 100MB to fit on the device, it’s not going to be quite as perfect or accurate,” Kemler explained. ![]() When you enable Live Caption for the first time, Google plans to show a banner explaining the feature. Kemler explained that Google made Live Caption a movable overlay because it’s not easy for Android to predict where the content will be or what else the user may want to do as they’re reading. You can double-tap to show more and drag the captions to anywhere on your screen. Turn it on with a single tap, and as soon as speech is detected, captions will appear on your phone screen. To use Live Caption, you hit one of your phone’s volume buttons and then tap the software icon when the volume UI pops up. That also includes games, though Kemler has not tried it with Stadia yet. It doesn’t matter if it’s from a first-party app or a third-party app - if your phone can play it, your phone can caption it. The feature captions any content that you’re streaming, that you’ve downloaded, or even that you recorded yourself. Live Caption works with songs, audio recordings, podcasts, and so on. For example, the ability to watch any video if you’re in a meeting or on the subway, without disturbing the people around you.” Afterwards, he added: “You can imagine all the use cases for the broader community too. And AI is providing us with new tools to dramatically improve experiences for people with disabilities,” Google CEO Sundar Pichai said onstage before showing off Live Caption and Google’s three new accessibility projects. “We believe technology can be more inclusive. The pitch was that this great on-device machine learning feature was coming in the latest Android release, for everyone to use. This wasn’t clear from Google’s keynote or any of the ensuing coverage. In the beginning it will be limited, but we’ll roll it out over time.” As we get closer to Android Q’s launch, Google plans to release a list of sanctioned devices that will offer Live Caption. ![]() This requires a lot of memory and space to run. “It’s only going to be on some select, higher-end devices. “It’s not going to be on all devices,” Brian Kemler, Android accessibility product manager, told Venturebeat. “Live Caption is coming to select phones running Android Q later this year,” a Google spokesperson confirmed. But it turns out that “your phone” can’t be just any Android Q phone. The company touted Live Caption as able to caption any media on your phone. Missed the GamesBeat Summit excitement? Don't worry! Tune in now to catch all of the live and virtual sessions here.Īt its I/O 2019 developer conference this week, Google showed off Live Caption, an Android Q feature that provides real-time continuous speech transcription. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |