# US 2019/0318500 A1 · Method for estimating body orientation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0318500 A1 - Document ID: US20190318500A1 - Status: Published application - Kind: A1 - Application number: 16/373,586 - Filed: 2019-04-02 - Published: 2019-10-17 - Earliest claimed: 2018-04-17 - Assignees: Fujitsu Limited - Applicants: Fujitsu Limited - Inventors: SHANSHAN YU; Norihiro Kakuko; Takeshi OTANI - Web page: https://patentgrep.com/patent/US20190318500A1 ## CPC - G06T 7/73: using feature-based methods - G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G06T 2207/30196: Human being; Person - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method for estimating body orientation includes: executing extraction processing for extracting a person region from images; executing an identification processing for identifying a left site and a right site in the person region; executing calculation processing for calculating a left moving amount and a right moving amount; and executing estimation processing for estimating body orientation in the person region based on a first difference and relation information, the first difference being a difference between the left moving amount and the right moving amount, the relation information including first and second relation information, the first relation information indicating a relationship between the first difference and a change amount when the left moving amount is larger than the right moving amount, and the second relation information indicating a relationship between the first difference and the change amount when the right moving amount is larger than the left moving amount. ## Claims ### Claim 1 A method for estimating body orientation, the method comprising: executing a region extraction processing that includes extracting a person region from a plurality of images, the person region corresponding to a region of a person, the plurality of images including an image taken at a first time and an image taken at a second time after the first time; executing an identification processing that includes identifying a left site and a right site in the person region from each image at the first time and the second time, the left site indicating the left site in the person region, and the right site indicating the right site in the person region; executing a calculation processing that includes calculating a left moving amount and a right moving amount, the left moving amount indicating a moving amount between the left site at the first time and the left site at the second time, the right moving amount indicating a moving amount between the right site at the first time and the right site at the second time; and executing an estimation processing that includes estimating body orientation of the person in the person region at the second time based on a first difference and relation information, the first difference being a difference between the left moving amount and the right moving amount, the relation information including first relation information and second relation information, the first relation information indicating a relationship between the first difference and a first change amount when the left moving amount is larger than the right moving amount, the first change amount being a body orientation change amount of the person in the person region, and the second relation information indicating a relationship between the first difference and the first change amount when the right moving amount is larger than the left moving amount. ### Claim 2 (depends on 1) The method according to claim 1, wherein the relation information has a relation between the first difference and the first change amount for each body orientation at the first time, the estimation processing is configured to: identify the relation corresponding to the estimated body orientation at the first time from the relation information; and estimate the body orientation at the second time based on the difference between the left moving amount and the right moving amount, and the identified relation. ### Claim 3 (depends on 1) The method according to claim 1, wherein the identification processing is configured to use feature amounts at a plurality of feature points extracted from the person region in order to identify the left site and the right site. ### Claim 4 (depends on 3) The method according to claim 3, further comprising: storing the position at a second feature point as the positions of the feature points in the left site and the right site, the sites being identified from the person region at the first time, the second feature points being the feature points in the left site and the right site, the sites being identified from the person region at the second time; and storing the estimated body orientation at the second time as the body orientation at the first time. ### Claim 5 (depends on 1) The method according to claim 1, wherein the region extraction processing is configured to extract a plurality of person regions in an image, the identification processing is configured to identify the right site in the person region and the left site in the person region for each of the plurality of person regions, the calculation processing is configured to calculate the left moving amount and the right moving amount for each of the plurality of person regions, and the estimation processing is configured to estimate the body orientation of the person in the person region at the second time for each of the plurality of person regions. ### Claim 6 An apparatus for estimating body orientation, the apparatus comprising: a memory; a processor coupled to the memory, the processor being configured to execute a region extraction processing that includes extracting a person region from a plurality of images, the person region corresponding to a region of a person, the plurality of images including an image taken at a first time and an image taken at a second time after the first time; execute an identification processing that includes identifying a left site and a right site in the person region from each image at the first time and the second time, the left site indicating the left site in the person region, and the right site indicating the right site in the person region; execute a calculation processing that includes calculating a left moving amount and a right moving amount, the left moving amount indicating a moving amount between the left site at the first time and the left site at the second time, the right moving amount indicating a moving amount between the right site at the first time and the right site at the second time; and execute an estimation processing that includes estimating body orientation of the person in the person region at the second time based on a first difference and relation information, the first difference being a difference between the left moving amount and the right moving amount, the relation information including first relation information and second relation information, the first relation information indicating a relationship between the first difference and a first change amount when the left moving amount is larger than the right moving amount, the first change amount being a body orientation change amount of the person in the person region, and the second relation information indicating a relationship between the first difference and the first change amount when the right moving amount is larger than the left moving amount. ### Claim 7 (depends on 6) The apparatus according to claim 6, wherein the relation information has a relation between the first difference and the first change amount for each body orientation at the first time, the estimation processing is configured to: identify the relation corresponding to the estimated body orientation at the first time from the relation information; and estimate the body orientation at the second time based on the difference between the left moving amount and the right moving amount, and the identified relation. ### Claim 8 (depends on 6) The apparatus according to claim 6, wherein the identification processing is configured to use feature amounts at a plurality of feature points extracted from the person region in order to identify the left site and the right site. ### Claim 9 (depends on 8) The apparatus according to claim 8, wherein the processor is configured to store the position at a second feature point as the positions of the feature points in the left site and the right site, the sites being identified from the person region at the first time, the second feature points being the feature points in the left site and the right site, the sites being identified from the person region at the second time; and store the estimated body orientation at the second time as the body orientation at the first time. ### Claim 10 (depends on 6) The method according to claim 6, wherein the region extraction processing is configured to extract a plurality of person regions in an image, wherein the identification processing is configured to identify the right site in the person region and the left site in the person region for each of the plurality of person regions, wherein the calculation processing is configured to calculate the left moving amount and the right moving amount for each of the plurality of person regions, and wherein the estimation processing is configured to estimate the body orientation of the person in the person region at the second time for each of the plurality of person regions. ### Claim 11 A non-transitory computer-readable storage medium for storing a program which causes a processor to perform processing for estimating body orientation, the processing comprising: executing a region extraction processing that includes extracting a person region from a plurality of images, the person region corresponding to a region of a person, the plurality of images including an image taken at a first time and an image taken at a second time after the first time; executing an identification processing that includes identifying a left site and a right site in the person region from each image at the first time and the second time, the left site indicating the left site in the person region, and the right site indicating the right site in the person region; executing a calculation processing that includes calculating a left moving amount and a right moving amount, the left moving amount indicating a moving amount between the left site at the first time and the left site at the second time, the right moving amount indicating a moving amount between the right site at the first time and the right site at the second time; and executing an estimation processing that includes estimating body orientation of the person in the person region at the second time based on a first difference and relation information, the first difference being a difference between the left moving amount and the right moving amount, the relation information including first relation information and second relation information, the first relation information indicating a relationship between the first difference and a first change amount when the left moving amount is larger than the right moving amount, the first change amount being a body orientation change amount of the person in the person region, and the second relation information indicating a relationship between the first difference and the first change amount when the right moving amount is larger than the left moving amount. ### Claim 12 (depends on 11) The non-transitory computer-readable storage medium according to claim 11, wherein the relation information has a relation between the first difference and the first change amount for each body orientation at the first time, the estimation processing is configured to: identify the relation corresponding to the estimated body orientation at the first time from the relation information; and estimate the body orientation at the second time based on the difference between the left moving amount and the right moving amount, and the identified relation. ### Claim 13 (depends on 11) The non-transitory computer-readable storage medium according to claim 11, wherein the identification processing is configured to use feature amounts at a plurality of feature points extracted from the person region in order to identify the left site and the right site. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the processing further includes storing the position at a second feature point as the positions of the feature points in the left site and the right site, the sites being identified from the person region at the first time, the second feature points being the feature points in the left site and the right site, the sites being identified from the person region at the second time; and storing the estimated body orientation at the second time as the body orientation at the first time. ### Claim 15 (depends on 11) The non-transitory computer-readable storage medium according to claim 11, wherein the region extraction processing is configured to extract a plurality of person regions in an image, wherein the identification processing is configured to identify the right site in the person region and the left site in the person region for each of the plurality of person regions, wherein the calculation processing is configured to calculate the left moving amount and the right moving amount for each of the plurality of person regions, and wherein the estimation processing is configured to estimate the body orientation of the person in the person region at the second time for each of the plurality of person regions.