Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: record motion video and convert #896

Merged
merged 16 commits into from
Sep 14, 2024

Conversation

Gerrnperl
Copy link

@Gerrnperl Gerrnperl commented Sep 11, 2024

This pull request integrates a video recorder in the AI sprite editor (anim preview mode).

Todo

  • integrate video recorder
  • update the style and interaction of the recorder for motion record
  • save video and upload
  • forward request in the backend
  • Integrate motion generation and animation generation

- add recording time display
- merge start and stop recording button to prevent pointless operation
- add back, generate animation and export button for recorded
- optimize the layout and style of recording and playing interface
- Show permission request text when user first time open the video recording
- Show denied text when user denied the permission or missing device
@Gerrnperl Gerrnperl changed the title feat: record motion video and convert to anim [WIP] feat: record motion video and convert to anim Sep 11, 2024
Copy link

qiniu-prow bot commented Sep 11, 2024

Hi @Gerrnperl. Thanks for your PR.

PRs from untrusted users cannot be marked as trusted with /ok-to-test in this repo meaning untrusted PR authors can never trigger tests themselves. Collaborators can still trigger tests on the PR using /test all.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Gerrnperl Gerrnperl changed the title [WIP] feat: record motion video and convert to anim [WIP] feat: record motion video and convert Sep 11, 2024
- Rename aigc sprite api to aigc animate api
	- The file `post_aigc_sprite.yap` has been renamed to `post_aigc_animate.yap`.
	- The function `GenerateAISprite` in controller has been renamed to `GenerateAnimate`.
	- Frontend api and task handler have been updated to reflect the changes.

- Update the params and return type of the aigc animate api to match the AI service
@Gerrnperl
Copy link
Author

Gerrnperl commented Sep 12, 2024

A motion video for mock:

const generateAnimation = async () => {
  await (async function loadMockData() {
    const webUrl = await getWebUrl(
      'kodo://goplus-builder-static-test/files/FriPa4F6TnY52CszoQJOf3TxZ6M1-592177'
    )
    const response = await fetch(webUrl)
    const blob = await response.blob()
    recordedBlob = blob
  })()
  // ...
}

- Add a prop of image url to VideoRecorder.vue to retrieve the preview image (in kodo form) from the caller
- Add a step to generate the animation after the motion is extracted
- The VideoRecorder will now emit a `resolve` event with the generated animation url as the payload
@Gerrnperl Gerrnperl marked this pull request as ready for review September 13, 2024 10:16
@Gerrnperl Gerrnperl changed the title [WIP] feat: record motion video and convert feat: record motion video and convert Sep 13, 2024
@Gerrnperl Gerrnperl mentioned this pull request Sep 13, 2024
9 tasks
@JiepengTan JiepengTan merged commit c17f284 into goplus:trailhead_res Sep 14, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants