We decided to use AI techniques for character generation in multiple stages, starting with facial model construction. In order to generate the character's face traits, we used Pawan Kumar's Face as a reference.
A trial run was conducted using a Lidar scanner to scan the face, aiming to understand the current industry standard. This approach allows for a direct comparison between the results obtained from AI tools and the established industry practices.
Images used for Facegen and Hyperhuman
"Hyper Human" includes a feature called "Chat Avatars," an image-to-3D animatable face model generation tool currently in its beta phase. This tool utilizes a single image to generate a highly detailed mesh and texture of the face. However, due to compatibility issues as of November 2023, we opted not to use it in the final project.
https://hyperhuman.deemos.com/imageto3d
Model Generation using HyperHuman
Model inside Blender
"FaceGen" is an AI-powered plugin developed by Keen Tools for Blender. This plugin facilitates the creation of face model mesh and UV maps from images. The mesh generated through this plugin was employed for defining the facial features of the NPC character in our project.
https://keentools.io/products/facebuilder-for-blender
Modelling using Facegen