Skip to content

Support multiple face contours #49

Closed
@mig35

Description

@mig35

Describe your environment

  • Android device: Xiaomi Mi4c and Samsung S9
  • Android OS version: 7.1.1 and 9.0
  • Google Play Services version: 14.7.99
  • Firebase/Play Services SDK version: firebase-core:16.0.6, firebase-ml-vision:18.0.2, firebase-ml-vision-face-model:17.0.2

Describe the problem:

I'm using Face Detection ml kit library to detect face contour and its lips. So I'm using this configuration:

val options = FirebaseVisionFaceDetectorOptions.Builder()
            .setMinFaceSize(0.15f)
            .setPerformanceMode(FirebaseVisionFaceDetectorOptions.ACCURATE) // I need more then 1 face
            .setContourMode(FirebaseVisionFaceDetectorOptions.ALL_CONTOURS) // I need contours of faces
            .enableTracking()
            .setLandmarkMode(FirebaseVisionFaceDetectorOptions.NO_LANDMARKS)
            .setClassificationMode(FirebaseVisionFaceDetectorOptions.NO_CLASSIFICATIONS)
            .build()

I'm able to get more then 1 face (3 in my example image) with boundingBox and trackingId, but countours are populated only for one face. All others are just empty.
Documentation says that ALL_CONTOURS: Detects FirebaseVisionFaceContour for a given face. Note that it would return contours for up to 5 faces. So I expect that ml kit will return contours for up to 5 faces, but not the only 1 of them.

Steps to reproduce:

  1. Setup Ml Kit and sdk with configuration above
  2. Process an image or camera frame with multiply faces
  3. See face detection result

Observed Results:

  • There are more then 1 face in result (3 in my case of image). But contours are populated only for one face in the result (for others just an empty lists).

Expected Results:

  • Want to get up to 5 faces contours as it is said in the documentation.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions