Coordinate input processing apparatus, emotion estimation apparatus, emotion estimation system, and building apparatus for building emotion estimation-oriented database

An emotion estimation apparatus comprising:

• a communication circuit which, in operation, receives coordinates corresponding to a position pointed to by an electronic pen and pen state information acquired by a position detection apparatus in an emotional state estimation request having a format that includes a plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and information regarding an emotional state of the person holding the electronic pen;
• an emotion estimation-oriented information storage device which, in operation, stores information regarding the emotional state of the person holding the electronic pen and range information regarding a range of values that may be taken by the coordinates corresponding to the position pointed to by the electronic pen and the pen state information regarding a state of the electronic pen held by the person at a time of being in the emotional state, the information regarding the emotional state and the range information being associated with one another;
• and
• a processor which, upon receipt of the emotional state estimation request from a coordinate input processing apparatus, estimates the emotional state of the person holding the electronic pen having transmitted the emotional state estimation request by referencing the emotion estimation-oriented information storage device, and generates an emotional state estimation response including the information regarding the estimated emotional state of the person holding the electronic pen, the emotional state estimation response having the format that includes the plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and the information regarding the emotional state of the person holding the electronic pen.

An emotion estimation system comprising:

• a coordinate input processing apparatus;
• and
• an emotion estimation apparatus connected with the coordinate input processing apparatus via a communication network,
• wherein the coordinate input processing apparatus includes:
• an electronic pen;
• a position detection apparatus that includes a sensor which, in operation, detects a position pointed to by the electronic pen, and circuitry, which in operation, acquires pen state information regarding a state of the electronic pen held by a person;
• and
• a communication circuit which, in operation, receives coordinates corresponding to the position pointed to by the electronic pen and the pen state information, and transmits to the emotion estimation apparatus coordinates corresponding to the position pointed to by the electronic pen and the pen state information in an emotional state estimation request having a format that includes a plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and information regarding an emotional state of the person holding the electronic pen;
• and
• wherein the emotion estimation apparatus includes:
• a receiver which, in operation, receives the coordinates corresponding to the position pointed to by the electronic pen and the pen state information in the format that includes the plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information acquired by the position detection apparatus, and the information regarding the emotional state of the person holding the electronic pen;
• an emotion estimation-oriented information storage device which, in operation, stores information regarding to an emotional state of the person holding the electronic pen and range information regarding a range of values that may be taken by the coordinates corresponding to the position pointed to by the electronic pen and the pen state information regarding the state of the electronic pen held by the person at the time of being in the emotional state, the information regarding to the emotional state and the range information being associated with one another;
• and
• a processor which, in operation, upon receipt of an emotional state estimation request, estimates the emotional state of a person holding the electronic pen having transmitted the emotional state estimation request by referencing the emotion estimation-oriented information storage device, and generates an emotional state estimation response including the coordinates corresponding to the position pointed to by the electronic pen, the pen state information acquired by the position detection apparatus, and the information corresponding to the estimated emotional state, in the format that includes the plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information acquired by the position detection apparatus, and the information regarding the emotional state of the person holding the electronic pen.

A building apparatus that builds an emotion estimation-oriented information storage device, the building apparatus comprising:

• at least one processor;
• and
• at least one storage device storing processor-readable instructions that, when executed by the at least one processor, cause the building apparatus to:
• acquire biological information regarding a person performing pointing input using an electronic pen;
• acquire pen state information regarding the state of the electronic pen held by the person performing the pointing input and associated with the acquired biological information;
• discriminate an emotional state of the person holding the electronic pen based on the biological information;
• obtain range information regarding a range of values that may be taken by the coordinates corresponding to the position pointed to by the electronic pen and the pen state information at a time of the emotional state from the acquired pen state information, wherein the range information includes a first range of coordinates corresponding to a plurality of positions pointed to by the electronic pen while a sensor is in contact with the electronic pen and a second range of coordinates corresponding to a plurality of positions pointed to by the electronic pen while the sensor is not in contact with the electronic pen;
• store information regarding the emotional state and the range information regarding the range of values that may be taken by the coordinates corresponding to the position pointed to by the electronic pen and the pen state information into the emotion estimation-oriented information storage device, the information regarding the emotional state and the range information being associated with one another;
• receive an emotional state estimation request;
• and
• generate an emotional state estimation response including the information regarding the emotional state.

An emotion estimation system comprising:

• a coordinate input processing apparatus including an electronic pen, a sensor which, in operation, detects a position pointed by the electronic pen, circuitry which, in operation, acquires pen state information regarding the electronic pen held by a person, and a communication circuit which, in operation, transmits coordinates corresponding to the position pointed to by the electronic pen and the pen state information in an emotional state estimation request having a format that includes a plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and information regarding an emotional state the person holding the electronic pen;
• and
• an emotion estimation apparatus including at least one processor, and at least one storage device storing processor-readable instructions that, when executed by the at least one processor, cause the emotion estimation apparatus to acquire the coordinates corresponding to the position pointed to by the electronic pen and pen state information from the emotional state estimation request transmitted by the coordinate input processing apparatus and to acquire biological information, and an emotion estimation-oriented information storage device which, in operation, stores information regarding an emotional state of the person holding the electronic pen and range information regarding a range of values that may be taken by the coordinates corresponding to the position pointed to by the electronic pen and the pen state information, the information regarding the emotional state and the range information being associated with one another;
• wherein the communication circuit of the coordinate input processing apparatus, in operation:
• receives information that identifies either the biological information or the emotional state discriminated from the biological information;
• and
• transmits to the emotion estimation apparatus an emotional state estimation request including the coordinates corresponding to the position pointed to by the electronic pen and the pen state information acquired by the coordinate input processing apparatus;
• and
• wherein the at least one storage device stores processor-readable instructions, when executed by the at least one processor, causes the emotion estimation apparatus to:
• upon receipt of a data building request from the coordinate input processing apparatus, store into the emotion estimation-oriented information storage device the information regarding the emotional state of the person holding the electronic pen and the range information regarding the range of values that may be taken by the pen state information regarding the state of the electronic pen held by the person at the time of being in the emotional state, the information regarding the emotional state and the range information being associated with one another;
• and
• upon receipt of the emotion estimation request from the coordinate input processing apparatus, estimate the emotional state of the person holding the electronic pen having transmitted the emotional state estimation request by referencing the emotion estimation-oriented information storage device by use of the received pen state information, generates an emotional state estimation response including the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and information corresponding to the emotional state, and return the generated information to the coordinate input processing apparatus having made the emotional state estimation request, the emotional state estimation response having the format that includes the plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and the information regarding the emotional state of the person holding the electronic pen.

An emotion estimation apparatus comprising:

• a communication circuit which, in operation, receives coordinates corresponding to a position pointed to by an electronic pen and pen state information acquired by a position detection apparatus in an emotional state estimation request having a format that includes a plurality of fields configured to respectively store the coordinates corresponding to a position pointed to by the electronic pen and the pen state information, information regarding an emotional state of the person holding the electronic pen;
• at least one processor;
• and
• at least one storage device storing processor-readable instructions that, when executed by the at least one processor, cause the emotion estimation apparatus to:
• store information regarding an emotional state of a person holding the electronic pen and pen state information regarding the state of the electronic pen held by the person at a time of being in the emotional state, the information regarding the emotional state and the pen state information being associated with one another;
• generate trained data by performing machine learning using the pen state information acquired by the position detection apparatus and biological information detected by a biological information detection apparatus worn by the person holding the electronic pen;
• upon receipt of an emotional state estimation request including the pen state information regarding the electronic pen, using the trained data to estimate the emotional state of the person holding the electronic pen having transmitted the request information based on the received pen state information;
• and
• generate an emotional state estimation response including the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and the information regarding the emotional state of the person holding the electronic pen, the emotional state estimation response having the format that includes the plurality of fields configured to respectively store the coordinates corresponding to the position pointed to by the electronic pen, the pen state information, and the information regarding the emotional state of the person holding the electronic pen.