# US 2021/0279933 A1 · Method and system to provide a computer-modified visualization of the desired face of a person > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0279933 A1 - Document ID: US20210279933A1 - Status: Published application - Kind: A1 - Application number: 17/331,121 - Filed: 2021-05-26 - Published: 2021-09-09 - Earliest claimed: 2019-12-11 - Assignees: Quantiface GmbH - Applicants: QuantiFace GmbH - Inventors: Heike BENDITTE-KLEPETKO - Web page: https://patentgrep.com/patent/US20210279933A1 ## CPC - A61B 5/004: {adapted for image acquisition of a particular organ or body part (A61B5/0082 takes precedence; arrangements for optical scanning A61B5/0062)} - A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens} - A61B 5/167: {Personality evaluation} - A61B 5/7267: {involving training the classification device} - G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting - G06N 5/00: Computing arrangements using knowledge-based models - G06N 7/00: Computing arrangements based on specific mathematical models - G06N 20/00: Machine learning - G06T 7/0012: {Biomedical image inspection} - G06T 11/60: Creating or editing images; Combining images with text - G06V 40/169: {Holistic features and representations, i.e. based on the facial image taken as a whole} - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10148: Varying focus - G06T 2207/20081: Training; Learning - G06T 2207/30201: Face - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A data set of visuals of faces and extracted face property data are generated and linked to face characteristics data provided by a representative set of humans that rate the visuals of these faces with respect to their face characteristics. Further face property data of these visuals of faces is extracted and together with the generated data set used to train an artificial intelligence. The artificial intelligence is used to analyse a visual of the person's face and generate a data set of modifications based on a selected desired characteristic(s) and modifications achievable by at least one cosmetic and/or medical treatment. The visual of the face of the person is modified based on the data set of modifications and the computer-modified visual of the desired face of the person with the modification of the face achievable by the least one proposed cosmetic and/or medical treatment is generated and displayed. ## Claims ### Claim 1 A method for providing a computer-modified visual of a desired face of a person, comprising the steps of: generating a data set of visuals of faces and extracted face property data thereof linked to face characteristics data provided by a representative set of humans that rate the visuals of these faces about their face characteristics and store the data set in a database; extracting further face property data of these visuals of faces and use these extracted face property data together with the generated data set for training of an artificial intelligence to enable the artificial intelligence to provide an automated rating of the characteristics of the visuals of faces; generating a data set of visual modifications of a face achievable by cosmetic and/or medical treatments and store the data set in a database; taking a standardized visual of the face of the person; inputting at least one desired characteristic of the face of the person to be changed; using the artificial intelligence to analyse the visual of the person's face and to generate a data set of modifications based on the selected desired characteristic(s) and modifications achievable by at least one cosmetic and/or medical treatment; modifying the visual of the face of the person based on the data set of modifications and generate the computer-modified visual of the desired face of the person with the modification of the face achievable by the least one proposed cosmetic and/or medical treatment; and displaying the computer-modified visual of the desired face of the person. ### Claim 2 (depends on 1) The method according to claim 1, further comprising the steps of: using a toggle mode to alternatively show the taken standardized visual of the face of the person and the computer-modified visual of the desired face of the person, or using a marking mode to mark the areas of the face of the person modified by the data set of modifications as an overlay to the displayed computer-modified visual of the desired face of the person. ### Claim 3 (depends on 1) The method according to claim 1, further comprising the steps of: displaying all cosmetic and/or medical treatments stored in the data set; selecting only one or more of the cosmetic and/or medical treatments displayed; and using only selected cosmetic and/or medical treatments for the generation of the data set of modifications. ### Claim 4 (depends on 1) The method according to claim 1, further comprising the steps of: displaying all characteristics stored in the database; and selecting two or more of the characteristics displayed as desired characteristic to be used by the artificial intelligence to generate the data set of modifications. ### Claim 5 (depends on 1) The method according to claim 1, further comprising the step of: displaying those cosmetic and/or medical treatments which, were selected by the artificial intelligence to be used to generate the data set of modifications. ### Claim 6 (depends on 1) The method according to claim 1, further comprising the steps of: using the artificial intelligence to analyse the visual of the person's face to provide an automated rating of the characteristics of the visual of the person's face; and displaying the characteristics of the visual of the person's face. ### Claim 7 (depends on 1) The method according to claim 1, further comprising the step of: using the artificial intelligence to automatically identify an area with wrinkles in the visual of the person's face and to automatically soft focus this identified area in case the data set of modifications includes such information to modify the visual of the face of the person to generate the computer-modified visual of the desired face of the person. ### Claim 8 (depends on 1) A system for displaying a computer-modified visual of a desired face of a person with a mobile device, which mobile device comprises a display and a camera and input means to input a characteristic, which mobile device is connected to a remote server which generates a data set of modifications, wherein: the remote server comprises a deep learning based application to process the steps of the method according to claim 1 to generate a database with data sets of visuals of faces and extracted face property data thereof linked to face characteristics and to generate a database with a data set of visual modifications of a face achievable by cosmetic and/or medical treatments and the deep learning based application is built to generate the data set of modifications for at least one region of the face of the person to achieve the desired change in the characteristic of the face based on the generated databases; and the remote server or the mobile device comprises visual data modification means to modify the visual data of the face of the person with the data set of modifications achievable by the at least one cosmetic and/or medical treatment, which modified visual data of the face are displayed with the mobile device. ### Claim 9 A computer program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the following steps to provide a computer-modified visualization of a desired face of a person: generating a data set of visuals of faces and extracted face property data thereof linked to face characteristics data provided by a representative set of humans that rate the visuals of these faces about their face characteristics and store the data set in a database; extracting further face property data of these visuals of faces and use these extracted face property data together with the generated data set for training of an artificial intelligence to enable the artificial intelligence to provide an automated rating of the characteristics of the visuals of faces; generating a data set of visual modifications of a face achievable by cosmetic and/or medical treatments and store the data set in a database; receiving a standardized visual of the face of the person from a mobile device; receiving at least one desired characteristic of the face of the person to be changed input by the person with mobile device; using the artificial intelligence to analyse the visual of the person's face and to generate a data set of modifications based on the selected desired characteristic(s) and modifications achievable by at least one cosmetic and/or medical treatment; modifying the visual of the face of the person based on the data set of modifications and generate the computer-modified visual of the face of the person with the modification of the face achievable by the at least one proposed cosmetic and/or medical treatment; and transmitting the computer-modified visual of the desired face of the person to mobile device to display the computer-modified visual.