[video_player] #60048 ios picture in picture #3500

vanlooverenkoen · 2023-03-20T20:52:57Z

Replace this paragraph with a description of what this PR is changing or adding, and why. Consider including before/after screenshots.

List which issues are fixed by this PR. You must list at least one issue.

This feature is only available on iOS because android has a different implementation. simple_pip_mode can be used for Android

Fixes flutter/flutter#60048

Migration from flutter/plugin to flutter/packages is done with this pr

old pr: flutter/plugins#6284

No migration needed this is an addon

If you had to change anything in the flutter/tests repo, include a link to the migration guide as per the breaking change policy.

Pre-launch Checklist

If you need help, consider asking for advice on the #hackers-new channel on Discord.

vanlooverenkoen · 2023-03-20T20:56:18Z

@hellohuanlin & @stuartmorgan I did the migration from flutter/plugins#6284 to here

hellohuanlin

carrying over the stamp from previous PR

vanlooverenkoen · 2023-04-03T10:31:45Z

@tarrinneal can I assist you with the review?

tarrinneal

Initial pass. A few changes to be made. Good work on this!

packages/video_player/video_player/CHANGELOG.md

packages/video_player/video_player/README.md

packages/video_player/video_player_avfoundation/CHANGELOG.md

packages/video_player/video_player_platform_interface/lib/video_player_platform_interface.dart

packages/video_player/video_player_avfoundation/ios/Classes/FLTVideoPlayerPlugin.m

packages/video_player/video_player/README.md

packages/video_player/video_player_platform_interface/CHANGELOG.md

# Conflicts: # packages/video_player/video_player/CHANGELOG.md # packages/video_player/video_player/lib/video_player.dart # packages/video_player/video_player/pubspec.yaml # packages/video_player/video_player_android/example/lib/mini_controller.dart # packages/video_player/video_player_avfoundation/CHANGELOG.md # packages/video_player/video_player_avfoundation/example/lib/mini_controller.dart # packages/video_player/video_player_avfoundation/lib/src/avfoundation_video_player.dart # packages/video_player/video_player_avfoundation/pubspec.yaml

…tsPictureInPicture

vanlooverenkoen · 2023-04-17T16:18:14Z

@tarrinneal I updated my pull request fully retested it to make sure it does what I expect.

packages/video_player/video_player/lib/video_player.dart

tarrinneal · 2023-05-10T08:17:19Z

@tarrinneal I updated my pull request fully retested it to make sure it does what I expect.

Seems like you still have a few broken tests. I should be able to get this re-reviewed this week, if you can git them sorted out.

vanlooverenkoen · 2023-05-10T08:22:39Z

@tarrinneal the tests are failing on camera because of the dependency overrides. How should I handle this? Because the dependency override script doesn't update it in the camera package.

I will fix the merge conflicts today

…ported

… pip

…cture-in-picture

philipgiuliani · 2025-02-20T14:41:46Z

Hi @vanlooverenkoen, we are using your fork already for a while in production and it works very well. Our released version was still from the end of last year. We've just updated the library and noticed a strange animation happening when setting the pip overlay rect. Also when changing page the video remains visible for a while. See the video below:

TEST.Simulator.Screen.Recording.-.iPhone.16.-.2025-02-20.at.15.39.09.mp4

Nols1000 · 2025-02-20T14:47:23Z

Hi @philipgiuliani ,
this is probably because of me merging the new main branch and trying to implment the change requests. If you use stuff in production please be sure to pin the commit, or maintain your own branch, as features in development might break. I'll try to get to working on it again, but it might be a bit before my weekends are available again.

philipgiuliani · 2025-02-20T14:51:58Z

Thanks for the quick response and checking it! We pinned the commit, but we had to update the package because the old video_player cannot build on Android with Flutter 3.29.

philipgiuliani · 2025-02-20T16:29:16Z

It seems to work perfectly fine by adding the following code back in the initWithPlayerItem function. This code was removed in the process of the refactoring at the beginning of January.

  _playerLayer = [AVPlayerLayer playerLayerWithPlayer:_player];
  // picture-in-picture shows a placeholder where the original video was playing.
  // This is a native overlay that does not scroll with the rest of the Flutter UI.
  // That is why we need to set the opacity of the overlay.
  // Setting it to 0 would result in the picture-in-picture not working.
  // Setting it to 1 would result in the picture-in-picture overlay always showing over other
  // widget. Setting it to 0.001 makes the placeholder invisible, but still allows the
  // picture-in-picture.
  _playerLayer.opacity = 0.001;
  [self.flutterViewLayer addSublayer:_playerLayer];

stuartmorgan-g

Apologies, doing another review pass had fallen off my radar since the review state was never switched back to review request. I've done an initial pass over the current state.

stuartmorgan-g · 2025-04-01T15:00:00Z

packages/camera/camera/example/pubspec.yaml

    sdk: flutter
  path_provider: ^2.0.0
  video_player: ^2.7.0
+  video_player_platform_interface: ^6.2.3


Why is this addition necessary?

stuartmorgan-g · 2025-04-01T15:02:44Z

packages/video_player/video_player/README.md

+### Picture-in-Picture
+
+#### iOS
+To enable picture-in-picture functionality, you need to add the **Background Modes** capabilities for **Audio, AirPlay, and Picture in Picture** as described in [Configuring your app for media playback > Configure the background modes](https://developer.apple.com/documentation/AVFoundation/configuring-your-app-for-media-playback#Configure-the-background-modes). Resulting in a new string entry `audio` in the array value of the entry `UIBackgroundModes` in your `Info.plist` file, which is located in `<project root>/ios/Runner/Info.plist`:


The second sentence here is a fragment. It should probably say something like "Adding this mode will result in ..."

stuartmorgan-g · 2025-04-01T15:03:29Z

packages/video_player/video_player/README.md

+### Picture-in-Picture
+
+#### iOS
+To enable picture-in-picture functionality, you need to add the **Background Modes** capabilities for **Audio, AirPlay, and Picture in Picture** as described in [Configuring your app for media playback > Configure the background modes](https://developer.apple.com/documentation/AVFoundation/configuring-your-app-for-media-playback#Configure-the-background-modes). Resulting in a new string entry `audio` in the array value of the entry `UIBackgroundModes` in your `Info.plist` file, which is located in `<project root>/ios/Runner/Info.plist`:


Everything from "which is located in" on can be removed; documenting basic iOS project structure isn't necessary here.

stuartmorgan-g · 2025-04-01T15:05:44Z

packages/video_player/video_player/README.md

+> Failing to add the `audio` **Background Modes** capability will result in a silent failure to start picture-in-picture playback.
+
+Example:
+![The example app running in iOS with picture-in-picture enabled](https://github.com/flutter/plugins/blob/main/packages/video_player/video_player/doc/demo_pip_iphone.gif?raw=true)


READMEs should never have references to non-pinned URLs, as it means old versions' READMEs can change or break at any time. E.g., renaming the plugin in the future would break all previous READMEs.

This will need to be added in a follow-up PR, using a hash instead of main.

stuartmorgan-g · 2025-04-01T15:08:45Z

packages/video_player/video_player/doc/demo_pip_iphone.gif

This file should be listed in a .pubignore.

stuartmorgan-g · 2025-04-01T15:18:20Z

packages/video_player/video_player/example/lib/main.dart

+                ),
+              );
+            },
+            child: const Text('Set picture-in-picture overlay rect'),


Why is this something that clients have to call manually? Shouldn't the controller be determining this information from the widget as needed?

stuartmorgan-g · 2025-04-01T15:18:39Z

packages/video_player/video_player/lib/video_player.dart

+  }
+
+  /// Sets the location of the video player view in order to animate the picture-in-picture view.
+  Future<void> setPictureInPictureOverlaySettings({


Per my comment in the example code, it's not clear to me why this needs to be public API.

stuartmorgan-g · 2025-04-01T15:19:40Z

packages/video_player/video_player/lib/video_player.dart

+    );
+  }
+
+  /// Starts picture-in-picture mode.


The methods that require isPictureInPictureSupported to be true in order to call them should all be commented accordingly.

stuartmorgan-g · 2025-04-01T15:21:09Z

packages/video_player/video_player_avfoundation/darwin/RunnerTests/VideoPlayerTests.m

  XCTAssertNil(error);
  XCTAssertEqual(avPlayer.volume, 0.1f);

+  // Set picture-in-picture


This still needs to be resolved.

stuartmorgan-g · 2025-04-01T15:21:35Z

packages/video_player/video_player_avfoundation/example/ios/RunnerUITests/VideoPlayerUITests.m

  XCTAssertTrue([playButton waitForExistenceWithTimeout:30.0]);
  [playButton tap];

+  if ([AVPictureInPictureController isPictureInPictureSupported]) {


This still needs to be resolved.

Piinks · 2025-06-04T23:02:59Z

Hey @vanlooverenkoen did you want to continue working on this change and address the above feedback?

- Set minimal opacity (0.001) to AVPlayerLayer to ensure PiP works - Add comprehensive debugging for layer state and PiP controller - Check and set default bounds if layer has empty bounds - Add isPictureInPicturePossible checks before starting PiP Based on flutter#3500 discussions about PiP requirements. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>

stuartmorgan-g · 2025-07-17T15:09:06Z

From triage: @Nols1000 are you still planning on continuing work on this PR?

Nols1000 · 2025-07-20T16:41:57Z

@stuartmorgan-g If there is someone else looking to finish it please do. It seems that I am not experienced enough with the flutter packages versioning. I've not found the time to work on it on multiple occasions, because of different priorities. If it's still open once I get to it, I'll give it another try.

akaboshinit · 2025-07-20T18:24:02Z

I’d like to take on the remaining work to complete this change.

stuartmorgan-g · 2025-07-29T18:36:09Z

@akaboshinit The next step would be to either coordinate getting commit access to this branch, or creating a fork of the branch and opening a new PR using that branch (referencing this PR for additional context) to continue the work.

akaboshinit · 2025-08-07T00:22:16Z

Thank you. I'm currently working on it locally and will make a PR once it works.

akaboshinit · 2025-08-07T00:26:50Z

To share the progress, I am changing the current PR and direction, and instead of creating a new texture, I am thinking of making the video_player texture directly into a pip.

trim.DDE25789-FE28-4840-88CD-68E95E2213CF.MOV

abdalazeezalyosfi · 2025-09-15T07:37:08Z

Hi @akaboshinit
any update please keep us updated

Azzeccagarbugli · 2025-09-22T14:18:55Z

@akaboshinit it would be very much appreciated if you share any updated, thanks a lot 🥹

stuartmorgan-g · 2025-10-21T18:31:28Z

Thank you. I'm currently working on it locally and will make a PR once it works.

Given that the plan is to open a new PR based on this one, I'm going to go ahead and close this PR. @akaboshinit , or anyone else interested in picking this up, please feel free to open a new PR forked from this once you have something ready for review!

vanlooverenkoen added 5 commits March 20, 2023 19:47

#60048: Migration from flutter-plugins to flutter-packages

595d3df

Updated doc

4831f57

Merged current main into ios pip

976b630

#60048: Formatting

a7d5dd5

Fixed formatting

876dfe8

vanlooverenkoen requested review from camsim99, hellohuanlin and tarrinneal as code owners March 20, 2023 20:52

github-actions bot added p: video_player platform-android platform-ios labels Mar 20, 2023

hellohuanlin approved these changes Mar 20, 2023

View reviewed changes

#60048: Updated the changelogs

a4ca9e7

camsim99 removed their request for review March 27, 2023 15:33

Merge branch 'main' into feature/#60048-ios-picture-in-picture

49f769a

tarrinneal requested changes Apr 14, 2023

View reviewed changes

vanlooverenkoen added 5 commits April 15, 2023 09:20

#60048: Updated comments related to docs & typo's

0764e27

Renamed setAutomaticallyStartPictureInPicture to setAutomaticallyStar…

65fdf65

…tsPictureInPicture

Updated starting to started to match stopped enum values

d4d9ff9

Removed some logic to pause

ff6d02f

vanlooverenkoen requested a review from tarrinneal April 17, 2023 16:17

tarrinneal requested a review from stuartmorgan-g April 17, 2023 18:44

reidbaker requested a review from camsim99 May 4, 2023 18:44

ErickCReis reviewed May 9, 2023

View reviewed changes

packages/video_player/video_player/lib/video_player.dart Show resolved Hide resolved

[video_player_android] add overwrite to fix analysis error

881e80e

github-actions bot added the platform-android label Jan 3, 2025

Nols1000 added 7 commits January 5, 2025 00:47

[video_player_avfoundation] fix type issue with isPictureInPictureSup…

917bdd4

…ported

[video_player_avfoundation] refactore naming and setting the start of…

fba55da

… pip

[video_player] Update dependencies

b0f42d8

Merge remote-tracking branch 'origin/main' into feature/#60048-ios-pi…

e0231d8

…cture-in-picture

[video_player] Upgrade dart version

c58b722

[video_player] Update dependencies

376bcf5

[camera] Add video_player_platform_interface to overwrite

5dd6e13

github-actions bot added the p: camera label Jan 8, 2025

This comment was marked as off-topic.

Sign in to view

stuartmorgan-g requested changes Apr 1, 2025

View reviewed changes

matanlurey removed request for ErickCReis and matanlurey April 2, 2025 15:27

stuartmorgan-g closed this Oct 21, 2025

[video_player] #60048 ios picture in picture #3500

[video_player] #60048 ios picture in picture #3500

Uh oh!

Conversation

vanlooverenkoen commented Mar 20, 2023 • edited by stuartmorgan-g Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Pre-launch Checklist

Uh oh!

vanlooverenkoen commented Mar 20, 2023

Uh oh!

hellohuanlin left a comment

Choose a reason for hiding this comment

Uh oh!

vanlooverenkoen commented Apr 3, 2023

Uh oh!

tarrinneal left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

vanlooverenkoen commented Apr 17, 2023

Uh oh!

Uh oh!

tarrinneal commented May 10, 2023

Uh oh!

vanlooverenkoen commented May 10, 2023

Uh oh!

This comment was marked as off-topic.

philipgiuliani commented Feb 20, 2025

Uh oh!

Nols1000 commented Feb 20, 2025

Uh oh!

philipgiuliani commented Feb 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

philipgiuliani commented Feb 20, 2025

Uh oh!

stuartmorgan-g left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Piinks commented Jun 4, 2025

Uh oh!

stuartmorgan-g commented Jul 17, 2025

Uh oh!

Nols1000 commented Jul 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

akaboshinit commented Jul 20, 2025

Uh oh!

stuartmorgan-g commented Jul 29, 2025

Uh oh!

akaboshinit commented Aug 7, 2025

vanlooverenkoen commented Mar 20, 2023 •

edited by stuartmorgan-g

Loading

philipgiuliani commented Feb 20, 2025 •

edited

Loading

Nols1000 commented Jul 20, 2025 •

edited

Loading