Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] VNN model face landmark index information and coordinate transformation #59

Open
luckypapa opened this issue May 10, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@luckypapa
Copy link

I'm trying to add a new filter that inherits FaceMakeupFilter, but I think I need to add information to faceIndexs. However, I understand that it uses a VNN model(PC model) that provides 278 landmark pointers, but it seems that 105 landmark points are actually provided. (An additional 5 are created by calculating the middle value of the two points)

Why are there 105 landmarks instead of 278?

Is there any data that can confirm the facial location information of the landmark index provided in the model?

If there is no separate data, I would like to convert the x, y coordinate information of the landmark into the x, y coordinates of a 1280x720 2d window and check the location through opencv. Can you tell me how to transform coordinates?

@luckypapa luckypapa added the bug Something isn't working label May 10, 2024
@1615070057
Copy link

我正在尝试添加一个继承自 FaceMakeupFilter 的新滤镜,但我认为我需要向 faceIndexs 添加信息。但是,我了解到它使用了一个提供 278 个地标指针的 VNN 模型(PC 模型),但似乎实际提供了 105 个地标点。(另外 5 个是通过计算两个点的中间值创建的)

为什么有 105 个地标而不是 278 个?

有没有什么数据可以证实模型中提供的地标索引的面部位置信息?

如果没有单独的数据,我想将地标的x,y坐标信息转换为1280x720的2d窗口的x,y坐标,并通过opencv检查位置。你能告诉我如何转换坐标吗?

大佬,这个问题解决了吗

@1615070057
Copy link

has this problem been solved?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants