smartfilming

Exploring the possibilities of video production with smartphones

#33 Auto-transcribe all your audio for free with Live Transcribe! — 26. October 2020

#33 Auto-transcribe all your audio for free with Live Transcribe!

While writing my last blog post about Google Recorder 2.0, I stumbled upon a hack that can also be utilized for another app from Google, one that currently understands over 70 languages, not only English: It’s called “Live Transcribe & Sound Notifications” and is available for pretty much every Android device. Have you always been looking for a tool that transcribes your audio recordings but doesn’t require an expensive subscription? Here’s what I like to think is a very useful and simple trick for achieving this on an Android phone. You will need the following things:

  • Android device running at least Android 5.0 Lollipop (if your phone is less than 5 years old, you should be safe!)
  • the app Live Transcribe & Sound Notifications by Google (free download on the Google Play Store)
  • an internet connection (either mobile data or wifi)
  • a quiet environment

Let’s say you have recorded some audio like an interview, a meeting, a vox pop, a voice-over for video or even a podcast on your smartphone (look here for some good audio recorder apps) and would like to have a text transcription of it. If you read this before making such a recording, do include a few seconds of silence before having someone talk in the recording and it’s also important that the recording is of good quality in terms of speech clarity, the reasons will become obvious soon. 

Here’s how it works!

Live Transcribe can be used to transcribe speech/audio from over 70 languages.

Open Live Transcribe and check the input language displayed in the bottom toolbar (if the toolbar isn’t there, just tap on the screen somewhere). It needs to be the same as the recording you want to have transcribed. If it’s a different one, tap on the gear icon and then on “More settings”. Choose the correct language. Unlike Google Recorder which I wrote about in my last article, Live Transcribe works with a vast number of languages, not only English. Also unlike Recorder however, Live Transcribe needs an active internet connection to transcribe, you can’t use it offline! If you are planning on pasting the transcription into a context with a white background later on, you should make sure that “Dark Theme” is disabled in Live Transcribe. Otherwise you will be pasting white text onto a white background. Leave the settings menu and check that Live Transcribe’s main screen says “Ready to transcribe” in the center. Now double-check that you are in a quiet environment, leave Live Transcribe and open the audio recording app. Locate the recording you want to have transcribed and start the playback of the file (do make sure the speaker volume is sufficient!), then quickly switch over to Live Transcribe. One way to do this is to use Android’s “Recent Apps” feature which can be accessed by tapping on the square icon in the 3-button navigation bar – some Android phone makers use a different icon, Samsung for instance now has three vertical lines instead of a square. If you are using gesture navigation, swipe up from the bottom and hold. But you can also just leave the audio recording app and open Live Transcribe again without going into recent apps. The recording will keep playing with Live Transcribe picking up the audio from the phone’s speaker(s) and doing its transcription thing as if someone was talking into the phone’s mic directly. This actually works! Don’t worry if you notice mistakes in the transcription, you can fix them later. Once the recording and subsequently the transcription is finished, long-tap on any word, choose “Select transcription” and then “Copy”. You have now copied the whole transcription to the clipboard and can paste it anywhere you like: eMail, Google Docs etc. That’s also where you are now able to correct any mistakes that Live Transcribe has made (within Live Transcribe, there’s no option for editing the transcription yet). Two more things: You can have Live Transcribe save your transcripts for three days (activate it in the settings or activate auto-save under “More settings”) and if you want to clear out the app’s transcription cache, you can also do this under “More settings”, then choose “Delete history”.

Can you do the same with video recordings?

When in recent apps view, tap the app’s icon to show a pop-up menu. This menu looks slightly different on different Android devices. LG G8X (center), Pixel 3 (right).
Active app windows of Live Transcribe and Google Photos on one screen using “Pop-up window” feature on the LG G8X.

What about video recordings? Could you have them transcribed via Live Transcribe as well? Basically yes, but it’s not quite as easy. That’s if you want to do it using only one device (it’s very easy if you use a second device for playback). When you leave an app that’s playing back a video, the video (and with it its audio) will stop playing so there’s nothing for Live Transcribe to listen to. You can work around this by using Android’s split-screen or multi-window feature to actively run more than one app at the same time. On Android 7 and 8 you are able to access split-screen apps by long-pressing the square icon (recent apps) in the bottom navigation bar and select the app(s) you want to run in split-screen mode. Things have changed with Android 9 however. For one, gesture navigation was introduced as an alternative to the “old” 3-button-navigation bar. So if you are using gesture navigation, you access recent apps by swiping up from the bottom and then hold. If you use the 3-button-navigation, long pressing the square icon doesn’t do anything anymore. Instead, just tap it once to access the recent apps view, tap on the app’s icon at the top of the window and you will get a pop-up menu. Depending on what Android phone you are using the menu will have slightly different items, or at least they are named differently: On my LG G8X I get “App info”, “Multi window”, “Pop-up window” and “Pin app”, on my Pixel 3 I get “App info”, “Split screen”, “Freeform” and “Pause app”. The items you will want to choose to run two apps side by side are “Multi window” (G8X) / “Split screen” (Pixel 3) which will split the screen in half or “Pop-up window” (G8X) / “Freeform” (Pixel 3) which will display the app(s) in a small, desktop-like window that you can move around freely. By doing this, you can playback a video clip and have Live Transcribe running at the same time. Of course you can also use this feature to have both Live Transcribe and the playback of an audio recording app on the same screen simultaneously but for audio file transcriptions, you don’t have to go the extra mile.

Can I do this on an iPhone as well?

Google Translate main interface on Android (top) and iOS (bottom).

Google has a whole range of apps for iOS, but unfortunately, Live Transcribe isn’t among them – it’s currently Android-only. But hey, maybe you have an older Android phone in your drawer that you could put to good use again? That being said, there is the possibility that Google will eventually release an iOS version of Live Transcribe or Apple will come up with an app that does something similar. I also thought of another way, using a Google app that is already available for iOS: Google Translate. Yes, it’s meant for translation and not transcription but in the Android version, you can also find a “Transcribe” button. Initially, using this will only give you a transcription of the translated language but if you tap the cog wheel in the bottom left corner and choose “Show original text”, you will actually get a transcription of the original language which you can then copy and paste. When checking the iOS version of Translate though, I noticed that there is no “Transcribe” button. There is a “Voice” button (which in the Android version has been moved to the search bar) but this will only pick up a limited amount of input and is quite slow. There’s also no “Show original text” option. I suppose there might be a chance that Google will update its iOS version to match the Android version but there are no guarantees. The Android version of Google Photos has had a pretty impressive video stabilization feature for quite a while now, something that is still missing from the iOS version. It might be a purely strategic thing and Google wants to give certain features only to users of its own mobile operating system, but it might also be for technical reasons like that the core transcription engine is deeply rooted in the Android system and it’s just not possible to tap into this on iOS where Google is “just” a 3rd party app developer. Let’s see how things will turn out in the coming months.

If you have any questions or comments, leave them here or hit me up on the Twitter @smartfilming. Do also consider to subscribe to my Telegram Newsletter to get notified about new blog posts and receive the new “Ten Takeaways Telegram” monthly bullet point recap of what happened in the world of mobile video creation during the last four weeks.

#32 Google Recorder 2.0 – A fantastic update for an already brilliant app! — 18. October 2020

#32 Google Recorder 2.0 – A fantastic update for an already brilliant app!

Note: The Post-It in this image was added by me and is not part of the Google Recorder app icon.

Not too long ago, I wrote an article about my favorite audio recorder apps for Android. One of the apps I included was Google Recorder. Officially, the app is only available for Pixel phones but can be sideloaded to a range of other Android devices. Google Recorder has a unique place among audio recording apps because of one killer feature: it transcribes audio into text – offline and for free. This can be extremely useful for a lot of people, particularly journalists. With the launch of the new Pixel 5 / Pixel 4a 5G, Google has introduced version 2.0 of Recorder and it packs some really exciting new features and improvements!

Edit the transcript

As good as Google’s voice recognition and subsequent transcription works, it occasionally makes mistakes. Before version 2.0, you weren’t able to make any kind of edits to the transcription within the app (it was possible to export the text and then make corrections). With the update you can now edit your transcript, however only one word at a time.

Edit your recording

Another new feature of version 2.0 is that you can now edit the audio recording itself by cropping/trimming (cut off something at the beginning/end) or removing a part in the middle. You can actually also do this by removing words from the transcript and it will automatically cut the audio file accordingly! You can access this feature by tapping on the scissors icon in the top right corner when having a recording selected. This particular feature can also come in very handy to bypass a limitation of another new feature which I will talk about in a second.

Create a video with waveforms and captions

Quite possibly the coolest new feature of version 2.0 is the ability to create a video with waveforms and captions from your audio file. This is very useful for sharing audio snippets or teasers on social networks where everything is primarily focused on visual impressions. I was even more delighted to find that you can customize a couple of things for the video: You can choose whether you want the waveforms plus captions or only the waveform. You can also select the aspect ratio of the video (square, portrait, landscape) and the color theme (dark/light). This is great! One thing they could have added is an option to choose a photo as a background image for the video. You will also notice that there are two watermarks at the bottom (the Recorder app logo and a “Recorded on Pixel” branding), unfortunately there’s no way to hide them before exporting. You can however use a separate video editing app to crop the image or place a black/white layer over the bottom part to cover it up. One last thing to mention: You can only create videos from clips that have a maximum length of 60 seconds. So for longer recordings you need to cut out a chunk via the editing tool, save it as a copy and then create your video from this excerpt. The export resolution of the video is 1080×1080 for square, 720×1280 for portrait and 1280×720 for landscape, all at 30fps.

Perfect? Not quite!

Two shortcomings that I already pointed out in my other blog post and that unfortunately haven’t been improved with version 2.0: Google Recorder is still limited to English. I’m sure though that support for other languages will be coming soon because Google’s own Live Transcribe app which I think uses the very same engine for voice recognition and transcription is already polyglot. The second minor set-back concerns its potential use in a professional (broadcast) environment: The app only records with a sample rate of 32kHz. It’s not a problem for professional use per se because I think it’s fair to say that you can also call it a “professional” tool when you “just” use the transcription for your work. But if you want to use the audio recording as such (say for broadcast radio), the sample rate doesn’t match the usual standards of 44.1/48 kHz. If Google Recorder allowed importing audio files from outside the app, this limitation could be circumvented but you can only use files recorded within the app – and I don’t think this is going to change soon as Google probably wants the user experience to be as easy as possible and importing files from other apps might not fit the bill. Ease of use is probably also the reason for not being able to customize anything in terms of recording quality. The sample rate of 32kHz should however be just fine for less “official” formats like podcasts or social media / the web. I have also thought of a hack to record in higher quality but still take advantage of Google Recorder’s features: Record you audio with another app that gives you a higher sample rate (for instance ShurePlus Motiv) and then play it back on your phone while simultaneously recording with Google Recorder. Google Recorder picks up the playback from your phone’s speaker and treats it as if you were talking into the mic. This actually works quite well but of course you need to be in a quiet environment. If you want to use the app’s ability to create a video with waveforms and captions but incorporate the original audio and not the lower quality re-recording, export the re-recording as a video file, then import the video into a video editing app that lets you exchange the audio with the original higher quality recording.

For which devices is Google Recorder available?

Officially, Google Recorder is only available for Google’s own Pixel phones, excluding the very first Pixel (XL). These are: Pixel 2 (XL), Pixel 3 (XL), Pixel 3a, Pixel 4 (XL), Pixel 4a, Pixel 4a 5G and Pixel 5. If you have used version 1 but can’t find the new features, you need to update the app. So are you totally out of luck if you don’t own a Google Pixel? Not quite! It’s actually possible to sideload the app to a whole range of other Android phones running Android 9 or newer (version 1 of Google Recorder) or Android 10 or newer (version 2). However, while the app can be installed on other Android devices that – in theory – should be able to run it, not all do so without problems in reality. I have had excellent results with phones from LG (V30 running version 1 of Google Recorder and now the G8X running version 2) where the app seems to work flawlessly. It also works well on the Huawei P30. On the other hand, the OnePlus 3 only does the recording part, not the transcription. And the Xiaomi Pocophone F1 lets you install and open the app but the moment you try to start a recording, the app crashes. Bottom line: Your mileage will vary with non-Pixel devices and if you’re about to buy a new phone and want to make sure Google Recorder 2.0 runs with all relevant features, you should get one of the recent Pixel phones. If you have a non-Pixel phone that theoretically should be able to run the app by sideloading it, just give it a go, you might be lucky!

How can I sideload the app and is it safe?

Unlike with Apple’s iOS, Android lets you sideload apps to your device. Sideloading basically means you can install apps from other sources than the official app store, in the case of Android the official app store is Google’s Play Store. When you download an Android app from outside the Play Store, you will get an apk file that you can then open and install. For security reasons, installs from other sources than the Play Store are disabled by default on Android and the system will give you a warning when trying to install an apk file. You can override this protective layer though by allowing certain apps (in most cases it will be the browser which you used to download the apk file) to perform installs from so-called “unknown sources”. I highly recommend only downloading and installing apk files from sites you trust. Personally I have only downloaded apks from XDA Developers and APKMirror so far. Now if you want to rush over to APKMirror and get the Google Recorder 2.0 apk, there’s one more hoop you have to jump through, at last for the moment: The download is provided not as a single apk file but as an “apk bundle”, this is a different way of packaging an app to reduce the file size. But while Android can handle installing single-file apks out of the box, you need an extra app to install apk bundles. I used APKMirror’s own APK Mirror Installer which you can download as a regular app from the Google Play Store. After downloading both the APKMirror Installer and the Google Recorder 2.0 apk bundle onto your Android device, open APKMirror, tap “Browse files” and select the Google Recorder 2.0 apk bundle (it has an .apkm file extension). Choose “Install package” and you’re finally done!

To wrap it up: With the 2.0 update, Google has immensely improved its fascinating Recorder app and made it an even more powerful tool for recording, auto-transcribing and sharing audio, one that might be a decisive factor for choosing a Google Pixel over any other phone, be it Android or an iPhone. What’s your experience with Google Recorder? Have you used it? If you have sideloaded it onto a non-Pixel device, how does it work? Let me know in the comments or hit me up on the Twitter @smartfilming. If you like this article, do consider subscribing to my Telegram Newsletter to get notified about new blog posts.