# US 2021/0330248 A1 · Robot for simulating posture of user and real-time posture monitoring system including the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0330248 A1
- Document ID: US20210330248A1
- Status: Published application
- Kind: A1
- Application number: 17/339,321
- Filed: 2021-06-04
- Published: 2021-10-28
- Earliest claimed: 2018-12-05
- Assignees: Morethings Co., Ltd.
- Applicants: Morethings Co., Ltd.
- Inventors: Jae Kyung KWAK; Kwang Dek AN; Ji Won OH; Hwan Il PARK; Jeong Min HAN
- Web page: https://patentgrep.com/patent/US20210330248A1

## CPC

- A61B 5/0064: {Body surface scanning}
- A61B 5/4561: {Evaluating static posture, e.g. undesirable back curvature (A61B5/1116 takes precedence)}
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/02416: {using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence)}
- A61B 5/0261: {using optical means, e.g. infrared light}
- A61B 5/1116: {Determining posture transitions}
- A61B 5/7203: {for noise prevention, reduction or removal}
- A61B 5/725: {using specific filters therefor, e.g. Kalman or adaptive filters (specific diagnostics methods using using bioelectric or biomagnetic signals A61B5/316)}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/743: {Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots}
- B25J 11/008: {Manipulators for service tasks}
- A61B 2560/04: Constructional details of apparatus
- B25J 9/102: {Gears specially adapted therefor, e.g. reduction gears (gearings in general F16H)}
- B25J 9/126: {Rotary actuators}
- B25J 9/1697: {Vision controlled systems}
- B25J 11/0005: {Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

Disclosed are a robot that may allow a user to monitor a state and a posture of the user in real time to perceive a state of health and the posture and receive useful contents that are helpful, and effectively help the health and correction of the posture of the user, and a real-time posture monitoring method.

## Claims

### Claim 1

A robot for mimicking a posture of a user, the robot comprising:
a case;
a camera disposed in the case, and configured to photograph the user and generate a captured image;
a display disposed in the case and configured to reproduce a display image; and
an electronic control unit configured to communicate with the camera and the display,
wherein the electronic control unit derives heart rate information from the captured image, and changes the display image such that the display image corresponds to the heart rate information.

### Claim 2 (depends on 1)

The robot of claim 1, wherein the camera acquires light of an infrared ray wavelength band and generates the captured image, and
wherein the electronic control unit derives a blood flow change signal of at least one of a face portion and a neck portion of the user from the captured image, derives a heart rate signal by classifying the blood flow change signal according to a frequency thereof and filtering out a noise signal, and derives the heart rate information from the heart rate signal by using a maximum point extraction algorithm.

### Claim 3 (depends on 1)

The robot of claim 1, wherein the display image includes at least one of a background image, a letter, a number, a symbol, a graph, and an emoji corresponding to the heart rate information,
wherein the electronic control unit classifies a state of the user into any one of a normal heart rate state, a low heart rate state, and a high heart rate state, by using the heart rate information, and
wherein the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji corresponding to the heart rate information is differently expressed according to the state of the user.

### Claim 4 (depends on 1)

The robot of claim 1, wherein the electronic control unit communicates with a pad that senses a magnitude and a distribution of pressures applied by both feet of the user to generate posture information from a pressure signal, and changes the display image such that the display image corresponds to the posture information,
wherein the display image includes at least one of a background image, a letter, a number, a symbol, a graph, and an emoji, which correspond to the heart rate information, and at least one of a background image, a letter, a number, a symbol, a graph, and an emoji, which correspond to the posture information, and
wherein the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji, which correspond to the heart rate information, and the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji, which correspond to the posture information are reproduced at the same time or alternately.

### Claim 5 (depends on 4)

The robot of claim 4, wherein the electronic control unit classifies the posture of the user into any one of a correct posture, a poor upper body posture, and a posture with crossed legs,
wherein the poor upper body posture includes at least one of a first posture, in which an upper body or a neck of the user is bent to any one of an upper side, a lower side, a left side, and a right side, and a second posture, in which a body of the user is leaned or supported by any one of both legs of user, and
wherein the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji corresponding to the posture information is differently expressed according to the posture of the user.

### Claim 6 (depends on 5)

The robot of claim 5, further comprising:
a first leg and a second leg driven to correspond to the posture information in the posture with the crossed legs, and
a first driver configured to drive the first leg and the second leg,
wherein the first driver includes:
a first motor;
a rack gear configured to move to one side and an opposite side by the first motor;
a first driven gear disposed in the first leg; and
a second driven gear disposed in the second leg,
wherein the rack gear moves to the one side to be enmeshed with the first driven gear through forward rotation driving of the first motor to rotate the first driven gear,
wherein the rack gear moves to the opposite side to be enmeshed with the second driven gear through reverse rotation driving of the first motor to rotate the second driven gear, and
wherein axes of rotation of the first driven gear and the second driven gear are parallel to each other and rotational directions of the first driven gear and the second driven gear are opposite to each other.

### Claim 7 (depends on 5)

The robot of claim 5, wherein the case includes:
an upper case tilted to correspond to the posture information in the poor upper body posture, and
a lower case disposed on a lower side of the upper case, and
wherein the robot further includes:
a second driver configured to tilt the upper case in at least one of a forward/rearward direction and a leftward/rightward direction.

### Claim 8 (depends on 7)

The robot of claim 7, wherein the second driver includes:
a first bracket;
a (2-1)-th motor configured to rotate the first bracket;
a second bracket; and
a (2-2)-th motor configured to rotate the first bracket,
wherein one side of the first bracket is fixed to the upper case, and an opposite side of the first bracket interworks with a shaft of the (2-1)-th motor and is hinge-coupled to the second bracket, and
wherein one side of the second bracket is fixed to the upper case, and an opposite side of the second bracket interworks with a shaft of the (2-2)-th motor.

### Claim 9 (depends on 8)

The robot of claim 8, wherein the first bracket rotates such that the upper case is tilted forwards, through forward rotation driving of the (2-1)-th motor,
wherein the first bracket rotates such that the upper case is tilted rearwards, through reverse rotation driving of the (2-1)-th motor,
wherein the second bracket rotates such that the upper case is tilted leftwards, through forward rotation driving of the (2-2)-th motor, and
wherein the second bracket rotates such that the upper case is tilted rightwards, through reverse rotation driving of the (2-2)-th motor.

### Claim 10

A method for monitoring a posture of a user by using a robot, the method comprising:
generating an image captured by photographing a user, through a camera disposed in a case of the robot;
reproducing a display image, on a display disposed in the case;
deriving heart rate information from the captured image; and
changing the display image such that the display image corresponds to the heart rate information.

### Claim 11 (depends on 10)

The method of claim 10, wherein the camera acquires light of an infrared ray wavelength band and generates the captured image, and
wherein the deriving of the heart rate information includes:
deriving a blood flow change signal of at least one of a face portion and a neck portion of the user, from the captured image;
deriving a heart rate signal by classifying the blood flow change signal according to a frequency thereof and filtering out a noise signal; and
deriving the heart rate information from the heart rate signal by using a maximum point extraction algorithm.

### Claim 12 (depends on 10)

The method of claim 10, wherein the display image includes at least one of a background image, a letter, a number, a symbol, a graph, and an emoji corresponding to the heart rate information,
wherein a state of the user is classified into any one of a normal heart rate state, a low heart rate state, and a high heart rate state, based on the heart rate information, and
wherein the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji corresponding to the heart rate information is differently expressed according to the state of the user.

### Claim 13 (depends on 10)

The method of claim 10, wherein the robot includes a pad that senses a magnitude and a distribution of pressures applied by both feet of the user to generate posture information from a pressure signal,
wherein the method is further comprising the steps of:
receiving the pressure signal from the pad;
generating posture information from the received pressure signal; and
changing the display image such that the display image corresponds to the posture information,
wherein the display image includes at least one of a background image, a letter, a number, a symbol, a graph, and an emoji, which correspond to the heart rate information, and at least one of a background image, a letter, a number, a symbol, a graph, and an emoji, which correspond to the posture information, and
wherein the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji, which correspond to the heart rate information, and the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji, which correspond to the posture information are reproduced at the same time or alternately.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
classifying the posture of the user into any one of a correct posture, a poor upper body posture, and a posture with crossed legs by using the posture information,
wherein the poor upper body posture includes at least one of a first posture, in which an upper body or a neck of the user is bent to any one of an upper side, a lower side, a left side, and a right side, and a second posture, in which a body of the user is leaned or supported by any one of both legs of user, and
wherein the at least one of the background image, the letter, the number, the symbol, the graph, and the emoji corresponding to the posture information is differently expressed according to the posture of the user.

### Claim 15 (depends on 14)

The method of claim 14, wherein the robot further includes:
a first leg and a second leg driven to correspond to the posture information in the posture with the crossed legs, and
a first driver configured to drive the first leg and the second leg,
wherein the first driver includes:
a first motor;
a rack gear configured to move to one side and an opposite side by the first motor;
a first driven gear disposed in the first leg; and
a second driven gear disposed in the second leg,
wherein the rack gear moves to the one side to be enmeshed with the first driven gear through forward rotation driving of the first motor to rotate the first driven gear,
wherein the rack gear moves to the opposite side to be enmeshed with the second driven gear through reverse rotation driving of the first motor to rotate the second driven gear, and
wherein rotary shafts of the first driven gear and the second driven gear are parallel to each other and rotational directions of the first driven gear and the second driven gear are opposite to each other.

### Claim 16 (depends on 14)

The method of claim 14, wherein the case includes:
an upper case tilted to correspond to the posture information in the poor upper body posture, and
a lower case disposed on a lower side of the upper case, and
wherein the robot further includes:
a second driver configured to tilt the upper case in at least one of a forward/rearward direction and a leftward/rightward direction.

### Claim 17 (depends on 16)

The method of claim 16, wherein the second driver includes:
a first bracket;
a (2-1)-th motor configured to rotate the first bracket;
a second bracket; and
a (2-2)-th motor configured to rotate the first bracket,
wherein one side of the first bracket is fixed to the upper case, and an opposite side of the first bracket interworks with a shaft of the (2-1)-th motor and is hinge-coupled to the second bracket, and
wherein one side of the second bracket is fixed to the upper case, and an opposite side of the second bracket interworks with a shaft of the (2-2)-th motor.

### Claim 18 (depends on 17)

The method of claim 17, wherein the first bracket rotates such that the upper case is tilted forwards, through forward rotation driving of the (2-1)-th motor,
wherein the first bracket rotates such that the upper case is tilted rearwards, through reverse rotation driving of the (2-1)-th motor,
wherein the second bracket rotates such that the upper case is tilted leftwards, through forward rotation driving of the (2-2)-th motor, and
wherein the second bracket rotates such that the upper case is tilted rightwards, through reverse rotation driving of the (2-2)-th motor.

### Claim 19 (depends on 1)

A posture monitoring system comprising the robot of claim 1.

### Claim 20 (depends on 10)

A recording medium coupled to a computer that is hardware, and in which a program for executing the method of claim 10 is stored.
