smartfilming

Exploring the possibilities of video production with smartphones

#34 Apple is about to give us 25fps in the iPhone’s native camera app (finally catching up to Windows Phones) — 17. November 2020

#34 Apple is about to give us 25fps in the iPhone’s native camera app (finally catching up to Windows Phones)

One of the things that has mostly remained a blindspot in video recording with the native camera app of a smartphone, is the ability to shoot in PAL frame rates, i.e. 25/50fps. The native camera apps of smartphones usually record with a frame rate of 30/60 fps. This is fine for many use cases but it’s not ideal under two circumstances: a) if you have to deliver your video for traditional professional broadcast in a PAL broadcast standard region (Europe, Australia, parts of Africa, Asia, South America etc.) b) If you have a multi-camera shoot with dedicated ‘regular’ cameras that only shoot 25/50fps. Sure, it’s relatively easy to capture in 25fps on your phone by using a 3rd party app like Filmic Pro or Protake but it still would be a welcome addition to any native camera app as long as this silly global frame rate divide (don’t get me started on this!) continues to exist. There was actually a prominent example of a phone maker that offered 25fps as a recording option in their (quasi)-native camera app very early on: Nokia and later Microsoft on their Lumia phones running Windows Phone / Windows Mobile. But as we all know by now, Windows Phone / Windows Mobile never really stood a chance against Android and iOS (read about its potential here) and has all but disappeared from the smartphone market. When LG introduced its highly advanced manual video mode in the native camera app of the V10, I had high hopes they would include a 25/50fps frame rate option as they were obviously aiming at more ambitious videographers. But no, the years have passed and current offerings from the Korean company like the G8X, V60 and Wing still don’t have it. It’s probably my only major gripe with LG’s otherwise outstanding flagship camera app. It was up to Sony to rekindle the flame, giving us 25fps natively in the pro camera app of the Xperia 1 II earlier this year. 

And now, as spotted by BBC multimedia trainer Mark Robertson yesterday, Apple has added the option to record with a frame rate of 25fps in the native camera app on their latest iOS public beta 14.3. So far, you were only able to record video at 24, 30 and 60fps (if you exclude the dedicated slow-motion options 120/240fps). This is a pretty big deal and I honestly didn’t expect Apple to make that move. But of course this is a more than welcome surprise! Robertson is using a new iPhone 12 Pro Max but his colleague Marc Blank-Settle also confirmed that this feature trickles down to the very old iPhone 6s, that is if you run the latest public beta version of iOS. The iPhone 6 and older models are excluded as they are not able to run iOS 14. While it’s not guaranteed that all new beta features make it to the finish line for the final release, I consider it to be very likely. So how do you set your iPhone’s native camera app to shoot video in 25fps? Go into your iPhone’s general settings, scroll down to “Camera” and then select “Record Video”. Now locate the “Show PAL Formats” toggle switch and activate it, then choose either “1080p HD at 25fps” or “4K at 25fps”. Unfortunately, there’s no 50fps option at this moment, I’m pretty sure it will come at some point in the future though. I recorded several clips with my iPhone SE 2020 and tested the frame rate via the MediaInfo app which revealed a clean 25.000fps, Marc Blank-Settle on the other hand apparently got some minimal deviation in his testing, nothing to write home about though I suppose. What other implications does this have? Well, many interested in this topic have been complaining about Apple’s own iOS editing app iMovie not supporting 25/50fps export. You can import and edit footage recorded in that frame rates no problem but it will be converted to 30/60fps upon export. I believe that there’s a good chance now that Apple will support 25/50fps export in a future update of iMovie because why bother integrating this into the camera app when you can’t deliver in the same frame rate? Android phone makers in the meantime should pay heed and consider adding 25/50fps video recording to their native camera apps sooner than later. It may not be relevant for the majority of conventional smartphone users but it also doesn’t hurt and you can make certain “special interest” groups very happy! Why exactly Apple has finally decided to make this move now is anybody’s guess. If you are not part of the iOS public beta program you can follow this guide by Lifewire to sign up. I highly recommend that you don’t run the beta on your daily driver phone as beta versions often still contain bugs that can cause trouble in everyday usage. If you have an older secondary iOS device that is eligible for the iOS 14.3 beta, then go ahead!

As always, feel free to comment here or hit me up on the Twitter @smartfilming. If you like this blog post, do consider subscribing to my Telegram channel to get notified about new blog posts and also receive my Ten Telegram Takeaways newsletter including 10 interesting things that happened during the past four weeks in the world of mobile content creation/tech.

#27 No, you don’t need a second video track for storytelling! (… and why it really doesn’t matter that much anymore) — 25. June 2020

#27 No, you don’t need a second video track for storytelling! (… and why it really doesn’t matter that much anymore)

As I pointed out in one of my very first blog posts here (in German), smartphone videography still comes with a whole bunch of limitations (although some of them are slowly but surely going away or have at least been mitigated). Yet one central aspect of the fascinating philosophy behind phoneography (that’s the term I now prefer for referring to content creation with smartphones in general) has always been one of “can do” instead of “can’t do” despite the shortcomings. The spirit of overcoming obvious obstacles, going the extra mile to get something done, trailblazing new forms of storytelling despite not having all the bells and whistles of a whole multi-device or multi-person production environment seems to be a key factor. With this in mind I always found it a bit irritating and slightly “treacherous” to this philosophy when people proclaimed that video editing apps without the ability to have a second video track in the editing timeline are not suitable for storytelling. “YOU HAVE TO HAVE A VIDEO EDITOR WITH AT LEAST TWO VIDEO TRACKS!” Bam! If you are just starting out creating your first videos you might easily be discouraged if you hear such a statement from a seasoned video producer. Now let me just make one thing clear before digging a little deeper: I’m not saying having two (or multiple) video tracks in a video editing app as opposed to just one isn’t useful. It most definitely is. It enables you to do things you can’t or can’t easily do otherwise. However, and I can’t stress this enough, it is by no means a prerequisite for phoneography storytelling – in my very humble opinion, that is. 

I can see why someone would support the idea of having two video tracks as being a must for creating certain types of videography work. For instance it could be based on the traditional concept of a news report or documentary featuring one or more persons talking (most often as part of an interview) and you don’t want to have the person talking occupying the frame all the time but still keep the statement going. This can help in many ways: On a very basic level, it can work as a means for visual variety to reduce the amount of “talking heads” air time. It might also help to cover up some unwanted visual distraction like when another person stops to look at the interviewee or the camera. But it can also exemplify something that the person is talking about, creating a meaningful connection. If you are interviewing the director of a theater piece who talks about the upcoming premiere you could insert a short clip showing the theater building from the outside, a clip of a poster announcing the premiere or a clip of actors playing a scene during the rehearsal while the director is still talking. The way you do it is by adding the so-called “b-roll” clip as a layer to the primary clip in the timeline of the editing app (usually muting the audio of the b-roll or at least reducing the volume). Without a second video track it can be difficult or even impossible to pull off this mix of video from one clip with the audio from another. But let’s stop here for a moment: Is this really the ONLY legitimate way to tell a story? Sure, as I just pointed out, it does have merit and can be a helpful tool – but I strongly believe that it’s also possible to tell a good story without this “trick” – and therefore without the need for a second video track. Here are some ideas:

WYSIWYH Style

Most of us have probably come across the strange acronym WYSIWYG: “What you see is what you get” – it’s a concept from computational UI design where it means that the preview you are getting in a (text/website/CMS) editor will very much resemble the way things actually look after creating/publishing. If you want a word to appear bold in your text and it’s bold after marking it in the editor, this is WYSIWYG. If you have to punch in code like <b>bold</b>  into your text editing interface to make the published end result bold, that’s not WYSIWYG. So I dare to steal this bizarre acronym in a slightly altered version and context: WYSIWYH – “What you see is what you hear” – meaning that your video clips always have the original sound. So in the case of an interview like described before, using a video editing app with only one video track, you would either present the interview in one piece (if it’s not very long) or cut it into smaller chunks with “b-roll” footage in between rather than overlaid (if you don’t want the questions included). Sure, it will look or feel a bit different, not “traditional”, but is that bad? Can’t it still be a good video story? One fairly technical problem we might encounter here is getting smooth audio transitions between clips when the audio levels of the two clips are very different. Video editing apps usually don’t have audio-only cross-fades (WHY is that, I ask!) and a cross-fade involving both audio AND video might not be the preferred transition of choice as most of the time you want to use a plain cut. There are ways to work around this however or just accept it as a stylistic choice for this way of storytelling. 

One-Shot Method

Another very interesting way that results in a much easier edit without the need for a second video track (if any at all) but includes more pre-planning in advance for a shoot is the one-shot approach. In contrast to what many one-man-band video journalists do (using a tripod with a static camera), this means you need to be an active camera operator at the same time to catch different visual aspects of the scene. This probably also calls for some sort of stabilization solution like phone-internal OIS/EIS, a rig, a gimbal or at least a steady hand and some practice. Journalist Kai Rüsberg has been an advocate of this style and collected some good tips here (blog post is in German but Google Translate should help you getting the gist). As a matter of fact, there’s even a small selection of noticeable feature films created in such a (risky) manner, among them “Russian Ark” (2002) and “Viktoria” (2015). One other thing we need to take into consideration is that if there’s any kind of asking questions involved, the interviewer’s voice will be “on air” so the audio should be good enough for this as well. I personally think that this style can be (if done right!) quite fascinating and more visually immersive than an edited package with static separate shots but it poses some challenges and might not be suited for everybody and every job/situation. Still, doing something like that might just expand your storytelling capabilities by trying something different. A one-track video editing app will suffice to add some text, titles, narration, fade in/out etc.

Shediting

A unique almagam of a traditional multi-clip approach and the one-shot method is a technique I called “shediting” in an earlier blog post. This involves a certain feature that is present in many native and some 3rd party camera apps: By pausing the recording instead of stopping it in between shots, you can cram a whole bunch of different shots into a single clip. Just like with one-shot, this can save you lots of time in the edit (sometimes things need to go really fast!) but requires more elaborate planning and comes with a certain risk. It also usually means that everything needs to be filmed within a very compact time frame and one location/area because in most cases you can’t close the app or have the phone go to sleep without actually stopping the recording. Nonetheless, I find this to be an extremely underrated and widely unknown “hack” to piece together a package on the go! Do yourself a favor and try to tell a short video story that way!

Voice-Over

A way to tackle rough audio transitions (or bad/challenging sound in general) while also creating a sense of continuity between clips is to use a voice-over narration in post production, most mobile editors offer this option directly within the app and even if you happen to come across one that doesn’t (or like Videoshop, hides it behind a paywall) you can easily record a voice-over in a separate audio recording app and import the audio to your video editor although it’s a bit more of a hassle if you need to redo it when the timing isn’t quite right. One example could be splicing your interview into several clips in the timeline and add “b-roll” footage with a voice-over in between. Of course you should see to it that the voice-over is somewhat meaningful and not just redundant information or is giving away the gist / key argument of an upcoming statement of the interviewee. You could however build/rephrase an actual question into the voice-over. Instead of having the original question “What challenges did you experience during the rehearsal process?” in the footage, you record a voice-over saying “During the rehearsal process director XY faced several challenges both on and off the stage…” for the insert clip followed by the director’s answer to the question. It might also help in such a situation to let the voice-over already begin at the end of the previous clip and flow into the subsequent one to cover up an obvious change in the ambient sound of the different clips. Of course, depending on the footage, the story and situation, this might not always work perfectly.

Text/Titles

Finally, with more and more media content being consumed muted on smartphones “on the go” in public, one can also think about having text and titles as an important narrative tool, particularly if there’s no interview involved (of course a subtitled interview would also be just fine!). This only works however if your editing app has an adequate title tool, nothing too fancy but at least covering the basics like control over fonts, size, position, color etc. (looking at you, iMovie for iOS!). Unlike adding a second video track, titles don’t tax the processor very much so even ultra-budget phones will be able to handle it.

Now, do you still remember the second part of this article’s title, the one in parentheses? I have just gone into lengths to explain why I think it’s not always necessary to use a video editing app with at least two video tracks to create a video story with your phone, so why would I now be saying that after all it doesn’t really matter that much anymore? Well, if you look back a whole bunch of years (say around 2013/2014) when the phoneography movement really started to gather momentum, the idea of having two video tracks in a video editing app was not only a theoretical question for app developers, thinking about how advanced they WANTED their app to be. It was also very much a plain technical consideration, particularly for Android where the processing power of devices ranged from quite weak to quite powerful. Processing multiple video streams in HD resolution simultaneously was no small feat at the time for a mobile processor, to a small degree this might even still be true today. This meant that not only was there a (very) limited selection of video editing apps with the ability to handle more than just one video track at the same time, but even when an app like KineMaster or PowerDirector generally supported the use of multiple video tracks, this feature was only available for certain devices, excluding phones and tablets with very basic processors that weren’t up to the task. Now this has very much changed over the last years with SoCs (System-on-a-chip) becoming more and more powerful, at least when it comes to handling video footage in FHD 1080p resolution as opposed to UHD/4K! Sure, I bet there’s still a handful of (old) budget Android devices out there that can’t handle two tracks of HD video in an editing app but mostly, having the ability to use at least two video tracks is not really tied to technical restraints anymore – if the app developers want their app to have multi-track editing then they should be able to integrate that. And you can definitely see that an increasing number of video editing apps have (added) this feature – one that’s really good, cross-platform and free without watermark is VN which I wrote about in an earlier article.

So, despite having argued that two video tracks in an editing app is not an absolute prerequisite for producing a good video story on your phone, the fact that nowadays many apps and basically all devices support this feature very much reduces the potential conflict that could arise from such an opinion. I do hope however that the mindset of the phoneography movement continues to be one of “can do” instead of “can’t do”, exploring new ways of storytelling, not just producing traditional formats with new “non-traditional” devices.

As usual, feel free to drop a comment or get in touch on the Twitter @smartfilming. If you like this blog, consider signing up for my Telegram channel t.me/smartfilming.

#20 Closing the Window of Opportunity – Farewell to Windows Phone — 8. January 2020

#20 Closing the Window of Opportunity – Farewell to Windows Phone

My personal Windows Phone / Windows 10 Mobile device collection: Microsoft Lumia 550, Nokia Lumia 630, Nokia Lumia 920, Microsoft Lumia 950.

If you are reading this, there’s a chance you might at least have heard about a mobile operating system called Windows Phone even though you never came close to owning a device running it. But there’s also a chance you never knew such a thing existed so let me just very briefly recapitulate.

Ever since Microsoft had built its quasi-monopoly in terms of an operating system for personal desktop computers and laptops with Windows, many assumed that they would have a good chance of utilizing this might in the emerging field of increasingly potent mobile phones with more complex operating systems. But that didn’t really happen. While Microsoft did introduce the Windows CE-based „Windows Mobile“ for pocketable computing devices in the early days of the 21st century, the real revolution in this market would only happen years later with the arrival of Apple’s iPhone. In a now infamous statement during an interview with USA Today in 2007, Microsoft’s then-CEO Steve Ballmer was extremely skeptical about Apple’s first phone: „There’s no chance that the iPhone is going to get any significant market share. No chance.“ Things turned out slightly different as we all know today. While Apple with iOS and soon after Google with Android went all-in on mobile touch-screen operating systems for smartphones, Microsoft hesitated for a long time – too long as history would tell. When they finally came out with Windows Phone 7 (the „7“ picking up from earlier OS versions under the „Windows Mobile“ moniker) in 2010 they were three years late to the party and never managed to catch up again despite occasional glimpses of hope. One, maybe THE crucial factor for failure was the fact that many popular 3rd party apps were not available for Microsoft’s platform or only in versions inferior to those on Apple’s iOS and Google’s Android. The acquisition of Nokia’s mobile phone division in 2014, a tighter integration with its desktop OS Windows 10 in the form of Windows 10 Mobile in 2015 and the app porting projects “Astoria” (Android) and “Islandwood” (iOS) were last desperate attempts to turn the tide but to no avail. Satya Nadella taking over from Steve Ballmer as CEO in 2014 also meant Microsoft reevaluated its business strategy and philosophy to concentrate on platform-independent services instead of pushing their own platform. In October 2017 a Microsoft executive revealed that they would cease development of new features and hardware for the platform, in January 2019 the company announced that software support for Windows 10 Mobile will end December 10, eventually postponing the date to January 14 2020 which will be next week.

End of life, end of story?

So why would I now bother to write about Windows Phone / Windows 10 Mobile when it’s being lowered into the virtual „cybergrave“ right now? Does anyone care at all? While I do assume that many will not have exactly waited for someone to do this, I consider Microsoft’s passing mobile OS to be worth a look in retrospect because not only was it a really refreshing alternative to Apple’s iOS and Google’s Android in terms of design but it actually had quite a bit of potential as a platform for mobile content creation in my opinion – potential that was wasted or got lost along the way, that is.

Mobile photographers livin’ the Lumia dream

Nokia Lumia 1020.
Nokia Lumia 1020 in bright yellow. (Photo Credit: Kārlis Dambrāns)

The Windows Phone device that single-handedly put the platform on the map for mobile content creation was without a doubt the Nokia Lumia 1020 which launched in the summer of 2013. Sporting a six-element lens array by Carl Zeiss with a whopping 41 (!) MP sensor to go along, optical image stabilization, a full set of manual controls for photography, a dedicated shutter button and (added via software update a bit later) the ability to shoot in RAW/DNG, the 1020 was a dream come true for mobile photographers, outshining pretty much everything the iPhone or Android handsets had to offer at that time. There weren’t any advanced photo editing apps around in the Windows Phone Store but as long as your focus was on the capturing experience this didn’t really matter much.

What’s with the video?

Things weren’t quite as impressive in the videography department however. Sure, the spectacular 41MP sensor was a very early example of how a photo camera megapixel „overkill“ could be utilized to provide a quasi-lossless digital zoom for video which only needed a small fraction of the 41MP prowess when recording in 1080p resolution. But while you had a pro mode with advanced manual controls for photography at hand, there wasn’t an equivalent for video – the fact that this asymmetrical feature distribution is still the standard with 99% of smartphones today isn’t really an excuse. The common simplicity and bare-bones functionality of most native camera apps doesn’t mean you have to throw in the towel for more ambitious videography work with your phone as long as 3rd party apps fill the gap but that’s exactly the point where we touch upon a sore spot with Windows Phone.

Video mode UI of ProShot on a Lumia 550. In addition to white balance presets and manual focus, an audio level meter and shutter speed / ISO control is available.

Up until very late in the game, when ProShot added video functionality to its advanced camera app for Windows 10 Mobile in the second half of 2016 there was not a single 3rd party video camera app in the Windows Phone store that provided a robust set of manual controls like ISO and shutter speed to set a precise exposure. You couldn’t even lock the exposure for video in any of the camera apps with video functionality. It wasn’t all bad though, there were some lights in the dark. I never owned a Lumia 1020 but had a 920 for over a year as my daily driver and I was pleased to find out that the native camera app supported the use of external mics via the headphone jack which is often an indispensable feature when using the phone for professional video work.

Video mode UI of the native camera app on the Lumia 950. White balance presets, manual focus and exposure compensation are available – but no exposure lock or precise shutter speed / ISO adjustment.

Another beacon (at least for folks residing in regions which use the PAL broadcast standard) was the ability of Lumia Camera (which was a separate app from the stock camera but could be considered an advanced native camera app) to shoot video in 25fps and not only the standard 30fps that is common for the native camera app of basically every single smartphone on the planet. Unfortunately, Lumia Camera did not support the use of external mics while the stock camera app did not support shooting in 25fps so if you needed both (and many did) you were out of luck. There could have been a happy ending to this when the Windows Phone native camera and Lumia Camera were merged into one app (I think they dubbed it „Windows Camera“) for the new Windows 10 Mobile. You now had white balance presets, manual focus and basic exposure adjustment (but only EV, not precise shutter speed / ISO values, and still no exposure lock!) at hand, plus PAL frame rate support. Devices running Windows 10 Mobile (at least the Lumias) were the only smartphones able to shoot in 25fps natively without the help of 3rd party apps. Up until this very day this has not been possible on any phone running Android or iOS! But incomprehensibly, the fusion of the two camera apps dropped the support for external mics (at least that’s what I found on the Lumia 950 and 550) despite the fact that it was still working in a Windows 10 Mobile preview version I ran on a Lumia 630 before the final release apparently killed it off. As mentioned before, ProShot (which had been a photo camera only for a long time) eventually added a video mode with a lot of pro features like precise shutter speed / ISO exposure control, an audio level meter and support for external mics. But it basically did so at a time when the MS Windows 10 Mobile had already hit the iceberg.

Windows Phone = Lumia?

If you are wondering at this moment why I have been only talking about Lumia devices in the context of Windows Phone and if Lumia phones basically equal Windows Phones you are both right and wrong. Yes, there were other companies than Nokia (and later Microsoft itself): Samsung, HTC, Acer, Blu and HP were among those launching phones running Microsoft’s mobile OS but their support for Windows Phone was very sparse and short-lived so it’s pretty hard to imagine that when someone talks about a „Windows Phone“ device now they are not referring to a Lumia phone.

It’s also undisputed that it were the Lumia flagships following the pioneering work of the Nokia Lumia 1020 which gave Windows Phone its reputation with mobile camera enthusiasts: photos and video footage from devices like the Lumia 920, 930, 950 and 950 XL were able to go head-to-head with iPhones and high-end Android handsets in terms of image quality. So why did Windows Phone fail to establish itself as a viable alternative for mobile content creation with smartphones?

Minding the app gap

Yes, we’re back talking about apps again. While the hardware was competitive (at least in certain cases), the software – or to be more precise: the software eco system wasn’t really compared to the other two dominant mobile platforms. I already pointed out that there was a serious lack of advanced 3rd party camera apps for video (FilmicPro actually ran a crowd funding campaign for a Windows Phone version once, it failed miserably) but the problems were not only confined to the capturing experience, they were just as imminent for post production.

UI of Movie Maker 8.1

UI of Videoshop

While Windows Phone 8.1 can actually be considered a huge step forward for the platform in terms of having any kind of video editing app available at all (apparently up until WP 8 the OS had prevented 3rd party apps from integrating even basic video editing tasks into their apps), seeing the launch of apps like Movie Maker 8.1, Videoshop (which turned out to become the only video editor available across all three major mobile platforms), MovieJax and the frustratingly short-lived Movie Creator Beta, they were all relatively basic – none of them offered a second video track for instance. That being said, they did allow you to create and produce a simple video story by adding several clips to a timeline, trim off unwanted parts, add audio like voice-over and very basic titles. But those who had hoped that this first wave of usable video editors would mature or bring about even more advanced ones over time eventually had to admit that their optimism wasn’t justified. The problems of a thin and often quality-lacking eco system in general which got caught up in a vicious circle involving poor sales figures and lacklustre involvement of app developers had a direct impact on the special case of using Windows Phone as a platform for mobile content creation.

You can still get things done!

That didn’t prevent some daring creators from using Windows Phone devices for actual professional videography however, tapping into its strengths while working around the shortcomings. I particularly want to highlight the work of Dutch/Frisian mobile journalist Wytse Vellinga who for some time used a Lumia 930 to produce news reports for the regional broadcaster Omrop Fryslan. Here are some fine examples:

Another example is by Croatian videographer Darko Flajpan who’s working for the national broadcaster HRT and also used a Lumia 930 as a main camera for a whole documentary, here’s the trailer:

To learn something about their personal experience working with Windows Phone in a professional context, I asked them a couple of short questions for the purpose of this article.

Q1: Why did you consider working with a Windows Phone at all?

Wytse Vellinga: “Windows Phone had the best camera quality on any smartphone in those days. And the fact that it could shoot 25fps with the native camera app was extremely helpful for me as a broadcast journalist.”

Darko Flajpan: “Windows Phone (Lumia 1020 in particular) got my attention at the time because of camera capabilities. It was a photo/video beast at that moment and still respectful even today. And with a battery grip which had a tripod thread and a shutter button it was the perfect tool for early MoJos. Also, it had 25fps which was very helpful for later editing and broadcasting. I’ve switched to Lumia 930 as soon it was released and with usable 4K@25fps it was unmatched in the smartphone world. So hardware was top notch and OS was quite polished and user friendly. The price of those smartphones was also on a fair side. I still have couple of 930s…”

Q2: What were the main challenges?

Wytse Vellinga: “The main challenges were the lack of good third party apps. There was no good editor, nor was there an app for making radio reports. And as the years progressed it didn’t get better but it got worse.”

Darko Flajpan: “Main challenges were on the software side. There were just two apps for video editing and those were buggy and not user friendly, so for any editing you had to transfer footage to a laptop. Lack of any support from Google (e.g. no official YouTube app) was quite irritating. On the hardware side, Microsoft never made a tiny bit of code to allow mic input to be used by a camera – for me that was huge.”

Q3: Why did Windows Phone fail in the end in your opinion?

Wytse Vellinga: “Because of what I just said. The lack of apps and the lack of support for those that wanted to build apps. It almost looked like Microsoft did not believe in their own platform.”

Darko Flajpan: “Third party developers were focused on higher value markets (iOS, Android), and Microsoft was not making an effort to attract them. From my point of view Microsoft had no clear strategy for smartphones. Brilliant engineers from Nokia (I’ve met a couple of them) were frustrated how Microsoft treated them – they’ve created great hardware and had just frustrations and lack of support from Microsoft’s side. Now, they are working for Apple and Chinese manufacturers.”

Q4: Do you think there’s any space left between Android and iOS for a third major mobile OS?

Wytse Vellinga: “There is always room for something new. iOS and Android are not perfect so there is room for improvement. But you will have to invest a lot of time and energy in getting app builders on board.”

Darko Flajpan: “This is very complex. If someone creates anything better and more attractive to consumers it will be bought, obstructed or destroyed by the two major players in its very early stage, that is my, not optimistic opinion.”

Finally, I would also like to share a short proof-of-concept video story I created using only the low-budget Lumia 550 (cost me about 50 Euro in used condition), shooting with its native camera app and editing with Videoshop. So it was completely produced on the mobile device. Notice: The Lumia 550 is only able to shoot 720p HD (not 1080p FHD) so the video has the same resolution.

“Slide down to power off”

It’s hard to imagine a more serious focus on mobile content creators alone could have made Windows Phone / Windows 10 Mobile a viable success story but it’s frustrating nonetheless looking back at the undeniable but underdeveloped potential of the platform and the devices that came with it. Fairly recently, Microsoft announced its return to the smartphone market: The long-lasting rumors about a supposed „Surface Phone“ will apparently materialize in the form of the Surface Duo smartphone in 2020. This will however only be a comeback in terms of hardware – the device is supposed to run on Android. So what was your experience with Windows Phone? Did you even know it existed? Did you ever use it and if so did you like it? Let me know in the comments or hit me up on the Twitter @smartfilming.

#19 Stabilizing shaky video footage on your smartphone (incl. Update 2020!) — 5. October 2019

#19 Stabilizing shaky video footage on your smartphone (incl. Update 2020!)

The fact that nowadays pretty much everyone owns a smartphone and shoots video with it has brought a gigantic wave of shaky handheld footage along. While some folks are actually allergic to any kind of shakiness in video, I personally think that depending on the amount and context it can work just fine – but definitely not all the time and under any circumstances. So there is a need to stabilize shaky handheld footage. Now the best thing to get smooth n’ stable footage is to avoid shakiness in the first place while shooting. While there are techniques for shooting (more) stable video handheld, the most common thing would be putting the phone on a tripod (using any kind of rig or clamp for mounting it). But maybe you want to move around a bit? More and more smartphones do have internal stabilization, be it on the hardware side with OIS (optical image stabilization) or on the software side with EIS (electronic image stabilzation). Over the last years there has also been a considerable and increasingly affordable influx of (motorized) gimbals that allow smooth camera movements. But let’s be honest: Unless you’re going to a planned shoot, you probably won’t carry around a tripod or gimbal (if you have one) – as compact as they have become over time, they are still too big and clunky to just put in your pocket. So it’s likely that you will find yourself in situations where you shoot video handheld and want to smooth out some distracting jitter afterwards. While most desktop video editing software has a built-in stabilizer function these days, things don’t look quite as bright on mobile but there are still a few (good) options.

Android

Google Photos
The easiest way to stabilize a pre-recorded video clip on your mobile phone is probably to use a little known feature of an immensely popular (and completely free!) app: Google Photos. Select any video clip and open the edit panel (sliders icon in the middle), then tap on the rectangle with the tilted image inside (to the right of the “Export frame” button). When I first used it I was really surprised how well it worked! The stabilization process doesn’t alter the resolution and frame rate but you will have to live with a lower video bitrate (sample clip: 17 to 11 Mbit/s) while the audio bitrate remains the same. Google Photos is basically available for all Android devices which is great. I have however found that very ancient pre-Android 5 devices (I tested it with two devices running Android 4.4) do not have the stabilization feature baked into the app. “What about iOS?” you may ask as Google Photos is also available on the Apple Appstore. Unfortunately, just like with the ancient Androids, the stabilization feature is not available in the iOS version of the app. Maybe at some point in the future.

PowerDirector
If you are looking for a stabilization feature already built into an advanced mobile video editing app with which you can produce your final edit, then Cyberlink’s PowerDirector is currently your only choice across platforms. Select the clip in your timeline, open the editing panel by tapping the pen icon on the left side bar and choose „Stabilizer“. Unlike with Google Photos where the stabilization is basically a one-button operation, PD does give you a 0-100 slider to increase or decrease the level of correction (default value is 50). The higher the level of correction, the more the image will be cropped. PD can keep the footage’s fps as long as it is a frame rate that is supported for export within the app. That means 24, 30 and 60fps – no PAL frame rates unfortunately. Resolution on the other hand shouldn’t be a problem at all, PD supports export up to UHD/4K resolution. You also get to choose between three bitrate options (Smaller Size/Standard/Better Quality), the actual bitrate will be depending on your export resolution. In the case of the sample clip used here the bitrate of 17Mbit/s remained unaltered when using „Better Quality“ but that seems to be the maximum for projects with FHD resolution. If you use a clip recorded in a higher bitrate it will be compressed upon export. The audio bitrate is reduced (sample clip 320 to128 Kbit/s). PD is free to download with watermark and some restrictions regarding certain features – watermark-free export and the complete feature set are only available with a paid subscription.

Microsoft Hyperlapse Mobile
There’s a third option on Android. Microsoft Hyperlapse Mobile shouldn’t be confused with Instagram’s „Hyperlapse“ app (which is only available on iOS so far). They are actually somewhat similar in that their main purpose is to speed up and stabilize video but while Instagram’s app can only do this for footage shot „live“ within the app, Microsoft’s version allows importing pre-recorded clips. By default, the result you get will be a 4x sped up clip but if you want the original speed, you can move the speed slider to „1x“ instead. As for the resolution, Microsoft Hyperlapse only supports import of clips with up to FHD resolution and you have to activate FHD export in the settings as the default setting is HD (720p). The frame rate remains the same, the video bitrate is seriously crunched (sample clip: 17 to 8 Mbit/s), the audio bitrate is kept intact. The stabilization result isn’t as good as Google’s Photos and while the app is free, you do get a Microsoft Hyperlapse branded bumper screen. There are no in-app purchases to get rid of this so you will probably have to trim it off using another app.

VideoStabilizer for KineMaster
If you were asking me which app I consider to be the best video editing app for Android, I would probably choose KineMaster. It lacked a video stabilization feature though and many people have been asking about it for quite some time. Just recently, KineMaster did something rather unexpected: They released a separate app called “VideoStabilizer for KineMaster” as an early beta (alongside another separate app for speed ramping). The official take on this is that they don’t want the main app to become too big size-wise and also want to keep it available for as many devices as possible. If you ask me, I would definitely prefer to have it as part of KineMaster and not a separate app. As mentioned, the app was released as an early beta and you can definitely tell, the result isn’t particularly impressive at this time and there are some glitches like the fact that it seems to slightly change the color of the original clip. The app is free to download but if you export the video directly to the Gallery, the video will have a watermark in the bottom right corner. You can only avoid the watermark by sharing the stabilized clip directly to KineMaster and you also need to have an active KineMaster subscription (because otherwise you will get a watermark when exporting from KineMaster). If you want to give it a go despite its current beta status, you can download VideoStabilizer for KineMaster on the Google Play Store. There’s currently no beta version on iOS but I think chances are good that there will be one later on or alternatively a version of the final production release.

iOS (iPhone/iPad)

Emulsio
As mentioned above, while Google Photos is available for iOS, the stabilization feature from the Android version is not. And neither is PowerDirector or Microsoft Hyperlapse Mobile. Also, none of iOS’s best video editing apps including the likes of Luma Fusion, KineMaster, Adobe Rush, Videoleap or Splice feature a stabilization tool at this point. The only (fairly good) option to stabilize pre-recorded video that I was able to find was an app called Emulsio. The interesting thing about Emulsio is that unlike all other apps for stabilizing mentioned here, there’s a whole bunch of controls over the stabilization process at your fingertips. Just like PD it gives you a 0-100% scale for the strength of the correction, cropping more of the frame the higher the % is. But on top of that, you get control over which axes (X,Y,XY) are corrected, you can switch rotation compensation and wobble removal on or off and even reduce rolling shutter. Emulsio does keep resolution and frame rate intact but reduces both video bitrate (sample clip 17 to 15Mbit/s) and audio bitrate (320 to 256Kbit/s). It’s free with watermark, you can get rid of the watermark by purchasing a 8.99€ pro upgrade.

Windows Mobile

Microsoft Hyperlapse Mobile
Before I wrap this up let me tell you that while Microsoft Hyperlapse Mobile isn’t available for iOS, it (still) is for their own (now quasi-dead) mobile platform Windows Mobile. So just for the highly unlikely case that you are a die-hard Windows Phone enthusiast still holding on to your Lumia: You can join the stabilization fun! It basically works like the Android version described above but only supports import/export of HD (720p) clips, higher resolution clips will be transcoded to 720p. So when the resolution is reduced it shouldn’t come as a surprise that video bitrate (17 to 7 Mbit/s) and audio bitrate (320 to 192 Kbit/s) are as well. The frame rate remains the same as the original source clip.

And here’s a video presenting the deliberately shaky sample clip (shot on a Motorola Moto Z in 1080p 30fps handheld) in stabilized versions by each mentioned app (in the case of Power Director and Emulsio the default settings were used):

Have I missed something important? Did a new app or new feature for an established app just come out? Let me know in the comments or hit me up on the Twitter (@smartfilming).

#14 “Shediting” or: How to edit video already while shooting on a smartphone — 17. May 2018

#14 “Shediting” or: How to edit video already while shooting on a smartphone

UI of Motorola’s native camera app (“MotoCam”) while recording video. Bottom right is the “pause” button that will let you pause the recording and resume it later if you don’t leave the app.

When using a headline like the one above, camera people usually refer to the idea that you should already think about the editing when shooting. This basically means two things: a) make sure you get a variety of different shots (wide shot, close-up, medium, special angle etc) that will allow you to tell a visually interesting story but b) don’t overshoot – don’t take 20 different takes of a shot or record a gazillion hours of footage because it will cost you valuable time to sift through all that footage afterwards. That’s all good advice but in this article I’m actually talking about something different, I’m talking about a way to create a video story with different shots while only using the camera app – no editing software! In a way, this is rather trivial but I’m always surprised how many people don’t know about it as this can be extremely helpful when things need to go super-fast. And let’s be honest, from mobile journalists to social media content producers, there’s an increasing number of jobs and situations to which this applies…

The feature that makes it possible to already edit a video package within the camera app itself while shooting is the ability to pause and resume a recording. The most common way to record a video clip is to hit the record button and then stop the recording once you’re finished. After stopping the recording the app will quickly create/save the video clip to be available in the gallery / camera roll. Now you might not have noticed this but many native camera apps do not only have a „stop“ button while recording video but also one that will temporarily pause the recording without already creating/saving the clip. Instead, you can resume recording another shot into the very same clip you started before, basically creating an edit-on-the-go while shooting with no need to mess around with an editing app afterwards. So for instance, if you’re shooting the exterior of an interesting building, you can take a wide shot from the outside, then pause the recording, go closer, resume recording with a shot of the door, pause again and then go into the building to resume recording with a shot of the interior. When you finally decide to press the „stop“ button, the clip that is saved will already have three different shots in it. The term I would propose for this is „shediting“, obviously a portmanteau of „shooting“ and „editing“. But that’s just some spontaneous thought of mine – you can call this what you want of course.

What camera apps will let you do shediting? On Android, actually most of the native camera apps I have encountered so far. This includes phones from Samsung, LG, Sony, Motorola/Lenovo, Huawei/Honor, HTC, Xiaomi, BQ, Wileyfox and Wiko. The only two Android phone brands that didn’t have this feature in the phone’s native camera app were Nokia (as tested on the Nokia 5) and Nextbit with its Robin. As for 3rd party video recording apps on Android, things are not looking quite as positive. While Open Camera and Footej Camera do allow shediting, most others don’t have this feature. FilmicPro (Android & iOS) meanwhile doesn’t have a “pause” button but you can basically achieve the same thing by activating a feature called “Stitch Recorded Footage” in the settings under “Device”.  There’s also MoviePro on iOS which lets you do this trick. Apple however still doesn’t have this feature in the iOS native camera app at this point. And while almost extinct, Lumia phones with Windows 10 Mobile / Windows Phone on the other hand do have this feature in the native camera app just like most Android phones.

EDIT: After I had published this article I was asked on Twitter if the native camera app re-adjusts or lets you re-adjust focus and exposure after pausing the recording because that would indeed be crucial for its actual usefulness. I did test this with some native camera apps and they all re-adjusted / let you re-adjust focus and exposure in between takes. If you have a different experience, please let me know in the comments!

Sure, shediting is only useful for certain projects and situations because once you leave the camera app, the clip will be saved anyway without possibility to resume and you can’t edit shots within the clip without heading over to an editing app after all. Still, I think it’s an interesting tool in a smartphone videographer’s kit that one should know about because it can make things easier and faster.

#8 Bare bones or full featured: best stock camera apps for shooting video on smartphones – PART 1 — 20. December 2017

#8 Bare bones or full featured: best stock camera apps for shooting video on smartphones – PART 1

One of the first steps when getting more serious about producing video content with a smartphone is to look at the more advanced video recording apps from 3rd party developers. Popular favorites like „FilmicPro“ (available for both Android and iOS) usually offer way more image composition controls, recording options and helpful pro features that you find on dedicated video cameras than the native stock camera app provided by the maker of the smartphone. While quite a few stock camera apps now actually have fairly advanced manual controls when shooting photos (ability to set ISO and shutter speed might be the most prominent example), the video mode unfortunately and frustratingly is still almost always neglected, leaving the eager user with a bare minimum of controls and options. In 2015 however, LG introduced a game changer in this regard: the V10. For the first time in smartphone history, a phone maker (also) focused on a full featured video recording mode: it included among other things the ability to set ISO and shutter speed, lock exposure, pull focus seamlessly, check audio levels via an audio level meter, adjust audio gain, set microphone directionality, use external microphones, alter the bit rate etc. etc. Sure, for certain users there were still some things missing that you could find in 3rd party apps like the option to change the frame rate to 25fps if  you’re delivering for a PAL broadcast but that’s only for a very specific use case – in general, this move by LG was groundbreaking and a bold and important statement for video production on a smartphone. But what about other phone makers? How good are their native camera apps when it comes to advanced options and controls for recording video? Can they compete with dedicated 3rd party apps?

First off, let me tell you why in most cases, you DO want to have a 3rd party app for recording video (at least if you have an Android phone): external microphones. With the exception of LG, Samsung (and I’m told OnePlus) in their recent flagship lines (plus Apple in general), no stock camera app I have come across supports the use of external microphones when recording video. Having good audio in a video is really important in most cases and external microphones (connected via headphone jack, microUSB, USB-C or Lightning connector) can be a big help in achieving that goal.

So why would you use a stock camera app over a dedicated 3rd party app at all? Familiarity. I guess many of us use the native camera app of a smartphone when snapping casual, everyday photos and maybe also videos in non-professional situations. So why not build on that familiarity? Simplicity. The default UI of most native camera apps is pretty straight-forward and simple. Some might prefer this to a more complex UI featured in more advanced 3rd party apps. Affordability. You don’t have to spend a single extra penny for it. I’m generally an avid advocate of supporting excellent 3rd party app developers by paying for their apps but others might not want to invest. The most important reason in my opinion however is: Stability/Reliability. This might not be true for every stock camera app on every phone (I think especially owners of Sony phones and lately the Essential Phone could beg to differ) but because of the fact that the app was developed by the maker of the phone and is usually less complex than 3rd party apps, chances are good that it will run more stable and is less prone to (compatibility) bugs, especially when you consider the plethora of Android devices out there. The V10’s stock camera app, despite being rather complex,  is rock-solid and hasn’t crashed on me once in almost 2 years now.

Over the last months I have taken a closer look at a whole lot of stock camera apps on smartphones from LG, Samsung, Apple, Huawei, Sony, Motorola/Lenovo, Nokia (both their older Windows Phone / Windows Mobile offerings AND their new Android handsets), HTC, Nextbit, BQ, Wiko and Google/Nexus. It goes without saying that I wasn’t able to inspect stock camera apps on all  the different phone models of a manufacturer. This is important to say because some phone makers give their flagships models a more advanced camera app than their budget devices while others offer the same native camera app across all (or at least most) of their device portfolio. Also, features might be added on newer models. So keep in mind, all I want to do is to give a rough overview from my perspective and offer some thoughts on which phone makers are paying more attention to pro features in the video recording department.

The lowest common denominator for recording video in a stock camera app on a smartphone at the moment is that you will have a button to start recording in full-auto mode with a resolution of 1920×1080 (1080p)  (1280×720 on some entry level or older devices) at a frame rate of 30fps. „full-auto“ basically means that exposure, focus and white balance (color temperature) will be set and adjusted automatically by the app depending on the situation and the algorithm / image processing routine. While this might sound like a convenient and good idea in general to get things done without much hassle, the auto-mode will not always produce the desired results because it’s not „smart“ enough to judge what’s important for you in the shot and therefore doesn’t get exposure, focus and/or white balance right. It might also change these parameters while recording when you don’t want them to, like for instance when you are panning the camera. Therefore one of the crucial features to get more control over the image is the ability to adjust and lock exposure, focus and white balance because if these parameters shift (too wildly/abruptly/randomly) while recording, it makes the video look amateurish. So let’s have a look at a couple of stock camera apps.

To be continued soon with “Part 2″…