We can use ARcore to create custom textures and 3D models for Augmented Faces, like the augmentation of a Fox ears. But aside from augmenting 3D objects, can we "transform" facemesh, for instance to make a filter that makes eyes smaller or nose bigger and change the whole face? If so, how?

It doesn't have to be ARcore, any other free SDK would be fine.

Collection<AugmentedFace> faces = session.getAllTrackables(AugmentedFace.class);

  if (face.getTrackingState() == TrackingState.TRACKING) {

    // UVs and indices can be cached as they do not change during the session.

    FloatBuffer uvs = face.getMeshTextureCoordinates();

    ShortBuffer indices = face.getMeshTriangleIndices();

    // Center and region poses, mesh vertices, and normals are updated each frame.

    Pose facePose = face.getCenterPose();

    FloatBuffer faceVertices = face.getMeshVertices();

    FloatBuffer faceNormals = face.getMeshNormals();

    // Render the face using these values with OpenGL.



face transformation

I tried the Fox ear example to augment a 3D model on the face. But not sure how to change the actual face like in the image.



Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.