Information processing system, data accumulation apparatus, data generation apparatus, information processing method, data accumulation method, data generation method, recording medium and database

The information processing system according to claim wherein

• the information processing system further comprises an image processing apparatus,
• the image processing apparatus comprises at least one third processor configured to execute instructions to;
• detects, based on a second face image in which a face of a second human is included, a landmark of the face of the second human as a third landmark;
• and
• determine at least one of an action unit relating to a motion of at least one of a plurality of facial parts that constitute the face of the second human that is included in the second face image, an emotion of the second human that is included in the second face image and a physical condition of the second human that is included in the second face image based on the third landmark and a learning model that is learned by using the face data.

An information processing method comprising:

• detecting, based on a first face image in which a face of a first human is included, a landmark of the face of the first human as a first landmark;
• obtaining a state information indicating a state of the first human that includes at least one of an action relating to a motion of at least one of a plurality of facial parts that constitute the face of the first human that is included in the first face image, an emotion of the first human that is included in the first face image and a physical condition of the first human that is included in the first face image;
• generating a landmark database that includes a plurality of first landmarks with each of which the state information is associated and which are categorized by a type of each of the plurality of facial parts:
• selecting at least one first landmark with which the state information that indicates that the state is a desired state is associated for each of the plurality of facial parts as a second landmark from the landmark database;
• and
• generating a face data that represents a characteristic of a face of a virtual human by using a plurality of second landmarks by combining the plurality of selected second landmarks that correspond to the plurality of facial parts, respectively.

A non-transitory recording medium on which a computer program that allows a computer to execute an information processing method is recorded,

• the information processing method comprising:
• detecting, based on a first face image in which a face of a first human is included, a landmark of the face of the first human as a first landmark;
• obtaining a state information indicating a state of the first human that includes at least one of an action relating to a motion of at least one of a plurality of facial parts that constitute the face of the first human that is included in the first face image, an emotion of the first human that is included in the first face image and a physical condition of the first human that is included in the first face image;
• generating a landmark database that includes a plurality of first landmarks with each of which the state information is associated and which are categorized by a type of each of the plurality of facial parts;
• selecting at least one first landmark with which the state information that indicates that the state is a desired state is associated for each of the plurality of facial parts as a second landmark from the landmark database;
• and
• generating a face data that represents a characteristic of a face of a virtual human by using a plurality of second landmarks by combining the plurality of selected second landmarks that correspond to the plurality of facial parts, respectively.