Support "video" source type

[incanus]

https://github.com/mapbox/mapbox-gl-js/blob/mb-pages/js/source/video_source.js

I'm imagining this is going to work totally differently than JS. That AFAICT uses an out-of-view video <div> that plays back and whose content snapshot is grabbed periodically to use in GL frames.

On native we'd likely have to decode video directly and get frames that way.

[ljbade]

ah, this is going to be hard and need a lot of dependencies, guess we start with whatever lib VLC is using if we want a lot of format support

or do we just allow h.264 only so we only depend on one library

or on android we could perhaps leverage the platform support for video, need to look at how we can do this from native without being too slow

[artemp]

https://www.ffmpeg.org/

[ljbade]

@artemp wasn't there a project split a while back from ffmpeg? what is the other one?

[artemp]

@ljbade - yes, there is http://libav.org/. Both libs seems to be active - I guess we need pick one.

[jfirebaugh]

My first instinct is to use platform APIs here.

[ljbade]

@jfirebaugh OK on Android we can use the builtin OpenMAX AL interface to the hardware video decoder. This is only available for Android 4.x and above, do we just not support video on older 2.x and 3.x devices? Or do we also add libav or ffmpeg for video decode?

There is also the private lib stagefright

Also see:

• http://stackoverflow.com/questions/11321825/how-to-use-hardware-accelerated-video-decoding-on-android
• https://www.packtpub.com/sites/default/files/downloads/Developing_Multimedia_Applications_with_NDK.pdf
• http://www.canofcode.co.uk/software/mobile/android/hardware-video-decoding-android/
• http://stackoverflow.com/questions/22084784/does-android-ndk-support-native-methodomxal-of-video-encoding - look for jni-media sample
• https://software.intel.com/en-us/android/articles/creating-a-hardware-decoder-integrating-ffmpeg-with-mediacodec-for-intel-atom-based-android
• http://zapek.com/blog/android-mediacodec/
• https://www.ffmpeg.org/doxygen/2.1/libstagefright_8cpp_source.html

@incanus what platform support does iOS have?

Linux will likely use system provided libav or ffmpeg.

[ljbade]

Also can we make a call on whether we should only support H.264? It will make things a lot easier.

[jfirebaugh]

I think it would be fine for certain platforms to support H.264 only. The way a GL style video source works is modeled on the HTML5 <video> element -- the style author can provide several source URLs in different formats and the renderer will pick the one with best support.

[incanus]

My first instinct is to use platform APIs here.

I'm leaning this way as well.

@incanus what platform support does iOS have?

APIs are great, from what I hear, but I don't have a lot of direct experience. I've done a bit on iPad with assembling frames of video and syncing to audio, but not much. But in general, media support is pretty nice on iOS with good high-level APIs.

[kkaefer]

We definitely should use platform APIs here. I think it's fair to not support video on Android 2/3, and to require H.264.

[dylan-chong]

Is this issue dead? :|

[ChrisLoer]

@asheemmamoowala Do I remember you had an example of how to include video support via custom layers?

[asheemmamoowala]

There's a demo of how to do this using custom layers at: https://github.com/asheemmamoowala/MapboxMapVideoLayer

The video is jittery at high zooms when being interacted with, and it consumes a lot of energy.

[stale]

This issue has been automatically detected as stale because it has not had recent activity and will be archived. Thank you for your contributions.