Google is preparing to let you use “Live Captions” during phone calls

Must read

How to disable and delete Samsung Pay from your Galaxy phone

When it comes to paying conveniently, Samsung Pay makes using your phone as a bank card an easy process; however, there may come...

Hands on: DJI RSC 2 review

You can leave your dolly at the door: the arrival of the DJI RSC 2 means Hollywood-worthy tracking shots are more accessible than...

How to Hack the Hidden Google Chrome Dinosaur Game

Most of us have seen the dreaded “No Internet” error message on Google Chrome. You can actually turn this screen into a fun,...

Microscopic Photos Show The Hidden Beauty Of An Invisible World

We know that wildlife photos of large mammals and wide open vistas can be breathtaking, but you know what doesn't get...
Bhawani Singh
I am a blogger who believes in delivering latest tech news from around the world to my viewers.

Google first announced its “Live Captions” accessibility feature at Google I/O 2019 last year. Using three on-device machine learning models, this feature detects English-language speech in media and generates captions automatically. The feature was first made available on the Pixel 4 but later expanded to the Pixel 3a, Pixel 3, Pixel 2, Samsung Galaxy S20, OnePlus 7T, and OnePlus 8. Since the feature launched, however, it hasn’t received any updates to its functionality. That could change soon, though, as we spotted evidence that Google will allow Live Caption to work over phone calls.

An APK teardown can often predict features that may arrive in a future update of an application, but it is possible that any of the features we mention here may not make it in a future release. This is because these features are currently unimplemented in the live build and may be pulled at any time by the developers in a future build.

In Android 11 Developer Preview 3 for the Google Pixel 4, we analyzed version 2.13.302920511 of Device Personalization Services, the application responsible for Live Captions. In it, we spotted strings that state users will be able to turn on Live Caption over a phone call.

<string name="call_confirmation_cancel">CANCEL</string>
<string name="call_confirmation_confirmation_message">Enable Live Caption over this phone call? Your use of the feature will be annonunced to others on the call.</string>
<string name="call_confirmation_dialog_name">Enable Live Caption confirmation dialog</string>
<string name="call_confirmation_enable">ENABLE</string>
<string name="call_other_side_transcription_prefix">Caller</string>
<string name="call_system_message_prefix">System</string>
<string name="call_turn_indicator_text">…</string>
<string name="call_user_typed_input_prefix">You typed</string>

Enabling the feature over a phone call will announce to all participants that the call is being transcribed into captions. An audio file will be played in the phone call, and this audio file simply says the following line:

<string name="system_message_start_call_speaking_mode">Hi, the person you’re about to speak with has call captions turned on. They’ll see captions of what you say to help them listen along.</string>

Currently, the API that Live Captions relies on, AudioPlaybackCaptureConfiguration, does not allow for capturing voice call audio. However, it’s possible that a new system-only permission added in Android 11 Developer Preview 3 will allow the feature to bypass this restriction.

Thanks to PNF Software for providing us a license to use JEB Decompiler, a professional-grade reverse engineering tool for Android applications.

More articles

Leave a Reply

Subscribe to our newsletter

To be updated with all the latest news, offers and special announcements.

- Advertisement -

Latest article

NASA’s OSIRIS-REx spacecraft successfully touches asteroid

CAPE CANAVERAL: A NASA spacecraft descended to an asteroid Tuesday and, dodging boulders the size of buildings, momentarily touched the surface to collect...

PayPal allows Bitcoin and crypto spending

Cryptocurrencies are being added to one of the world's biggest online payment networks. Source link

Quibi Calls It Quits After Just Six Months of Operation (Update: Confirmed) – Review Geek

QuibiIn a weird, but not unexpected turn of events, the mobile-first streaming service Quibi has come to an end. According to the Wall...

Final Fantasy 16 release date predictions, trailer and what we know

Final Fantasy 16 (XVI) was announced on September 16 as a PlayStation 5 exclusive. The RPG is the next mainline title in the...

iOS 14.1, iPadOS 14.1 Released With 10-Bit HDR Video Playback, Edit Support for Earlier Models

Apple has released iOS 14.1 and iPadOS 14.1 as the latest improvement-focussed updates for compatible iPhone and iPad models. The new updates come...
- Advertisement -