DYNAMIC REAL-TIME GENERATION OF THREE-DIMENSIONAL AVATAR MODELS OF USERS BASED ON LIVE VISUAL INPUT OF USERS' APPEARANCE AND COMPUTER SYSTEMS AND COMPUTER-IMPLEMENTED METHODS DIRECTED TO THEREOF

摘要

In some embodiments, the present invention provides for a computer system that may include a camera component configured to acquire a visual content, where the visual content includes a plurality of frames having a visual representation of a person's face; and a processor configured to: train a face detection regressor with a synthetic face model database to obtain a face detection trained regressor; apply, for each frame, the face detection trained regressor to detect or to track the face based on facial features, local features, and a pre-defined hyperparameter; construct an intermediate multi-dimensional face model; apply machine learning to determine features of an intermediate multi-dimensional head model; construct a multi-dimensional avatar; and utilize the multi-dimensional avatar to perform an activity associated with the person.