Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source code of examples with bones? #84

Open
hernanjls opened this issue Jan 18, 2025 · 3 comments
Open

Source code of examples with bones? #84

hernanjls opened this issue Jan 18, 2025 · 3 comments

Comments

@hernanjls
Copy link

Hi again

I am exited with the example using bones I want to explore more details this...https://www.youtube.com/watch?v=4Y9NFnENH5s.... is posible you can share this example?

I am using gemini 2 for generate audio responses in my project I want to integrate this with talking avatars in my web project

@met4citizen
Copy link
Owner

All the code required is already available (except for the script). The video is a real-time screen capture from a Chrome browser running the TalkingHead test app, and you can find the source code of the test app in this repo (./index.html).

Note that in this "dynamic bones" video, I had to use a custom model because RPM avatars don't yet come with hair bones. I purchased a ready-made base model from CGTrader and made it compatible with the TalkingHead class using Blender. Unfortunately, even though the base model has a royalty-free license, it prohibits me from making my custom model available to any third party, so I can't share it here. This means that for now, you would have to make your own custom model with dynamic bones. Alternatively, you can wait for RPM support. I wrote to them about this two months ago and provided my videos as a reference, and they replied that they will add the hair bones to their avatars, but the ETA is still unknown.

PS: If you're wondering about the script of the video, I used the test app's "Script" feature. If you open the "Manuscript" tab and scroll down, you will find a "Script" textarea in which you can enter chapters consisting of both lines to be spoken and JavaScript commands. I added the first two chapters of the script used in this particular video as an example. To play/rewind the script in the test app, you can use Option + arrow keys.

head.lookAtCamera(2000);
head.setFixedValue("Mth.Sml.Sp.1",0.5);
await sleep(1000);
head.setFixedValue("Mth.Sml.Sp.1",null);
Hey guys, welcome back to the channel!

This video is a follow-up to our last one about dynamic bones.
Today, I'll be showing you how pivot bones and excluded zones work.

First, Mika will turn off both features to show you how my dynamic bones look like without them.
head.setView("mid");
await sleep(1000);
head.lookAt(900,250,2);

...

@hernanjls
Copy link
Author

hernanjls commented Jan 19, 2025 via email

@met4citizen
Copy link
Owner

Unfortunately, as of now, I don't have a 3D model with hair bones that I can use in a live demo. I can't use my custom avatar shown in the video, as doing so would make the model "downloadable," which is explicitly prohibited by its license.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants