# US 10,321,008 B2 · Presentation control device for controlling presentation corresponding to recognized target > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,321,008 B2 - Document ID: US10321008B2 - Status: Granted - Kind: B2 - Application number: 14/609,763 - Filed: 2015-01-30 - Published: 2015-08-13 - Granted: 2019-06-11 - Earliest claimed: 2014-02-10 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Yuhei Taki; Hikotatsu Chin; Yusuke Nakagawa - Web page: https://patentgrep.com/patent/US10321008B2 ## CPC - H04N 1/32112: {in a separate computer file, document page or paper sheet, e.g. a fax cover sheet (H04N1/32122 takes precedence)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - H04M 1/724: User interfaces specially adapted for cordless or mobile telephones - H04M 2250/52: including functional features of a camera - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract There is provided a presentation control device including a determination section configured to determine whether a condition corresponding to a recognition target to be recognized on the basis of a photographed image is satisfied, and a presentation control section configured to allow presentation associated with the recognition target to be performed in a case where it is determined that the condition corresponding to the recognition target is satisfied. The condition corresponding to the recognition target includes a condition related to a state of a target user to whom a content of the presentation is to be transmitted. ## Claims ### Claim 1 A presentation control device, comprising: a determination section configured to: determine that a first condition is satisfied, wherein the first condition corresponds to a first user action from a plurality of estimated user actions; recognize a recognition target based on a photographed image; and determine that a second condition is satisfied, based on the determination that the first condition is satisfied, wherein the second condition corresponds to the recognition target, wherein the second condition includes a third condition related to a user action history, wherein the user action history includes history information corresponding to at least one of the first user action or a second user action from the plurality of estimated user actions, and wherein the first user action and the second user action are recognized, based on the photographed image; and a presentation control section configured to allow a presentation associated with the recognition target, based on the determination that both of the first condition and the second condition are satisfied. ### Claim 2 (depends on 1) The presentation control device according to claim 1, wherein the third condition is further related to a lack of possession of an article by a user of a user-wearable presentation device, wherein the first user action and the second user action are actions of the user of the user-wearable presentation device, and wherein the determination section is further configured to: determine that the third condition is satisfied, based on a detection of the lack of possession of the article by the user, wherein the detection of the lack of possession of the article by the user is based on the history information related to the user action history and the photographed image; determine that the first condition is satisfied, based on the determination that the third condition is satisfied; and determine that the second condition is satisfied, based on the determination that the first condition is satisfied. ### Claim 3 (depends on 1) The presentation control device according to claim 1, wherein the third condition is further related to a lack of the second user action, and wherein the determination section is further configured to: determine that the third condition is satisfied, based on a detection of the lack of the second user action, wherein the detection of the lack of the second user action is based on the history information related to the user action history and the photographed image; determine that the first condition is satisfied, based on the determination that the third condition is satisfied; and determine that the second condition is satisfied, based on the determination that the first condition is satisfied. ### Claim 4 (depends on 2) The presentation control device according to claim 2, wherein the first condition is a fourth condition related to a particular user action, and wherein the determination section is further configured to: estimate the first user action, based on at least one of the photographed image, motion information that represents a user motion, or positional information that represents a user position; and determine that the first condition is satisfied, based on determination that the estimated first user action is the particular user action. ### Claim 5 (depends on 4) The presentation control device according to claim 4, further comprising: a motion detecting sensor configured to detect the user motion. ### Claim 6 (depends on 4) The presentation control device according to claim 4, further comprising: a position detecting device configured to detect the user position. ### Claim 7 (depends on 1) The presentation control device according to claim 1, wherein the second condition includes a fourth condition related to a detection of an object in the photographed image, wherein the first condition is a fifth condition related to the first user action, wherein the first user action is an action related to the detected object, and wherein the determination section is further configured to determine that the second condition is satisfied, based on the detection of the object from the photographed image and the first user action. ### Claim 8 (depends on 7) The presentation control device according to claim 7, wherein the second condition further includes a sixth condition of a circumstance related to the object, and wherein the determination section is further configured to determine that the second condition is satisfied, based on determination that the sixth condition is further satisfied. ### Claim 9 (depends on 1) The presentation control device according to claim 1, wherein the photographed image is a first image that is photographed with a user-wearable imaging device. ### Claim 10 (depends on 9) The presentation control device according to claim 9, wherein the photographed image is a second image that is photographed with at least one of a plurality of user-wearable imaging devices. ### Claim 11 (depends on 1) The presentation control device according to claim 1, wherein the presentation control section is further configured to: compose a three-dimensional space image based on a plurality of photographed images, and allow the presentation associated with the recognition target based on the composed three-dimensional space image. ### Claim 12 (depends on 1) The presentation control device according to claim 1, wherein the presentation control section is further configured to: compose a three-dimensional space image based on a plurality of photographed images, and allow display of a virtual object in the composed three-dimensional space image. ### Claim 13 (depends on 1) The presentation control device according to claim 1, further comprising: a communication unit configured to communicate with an external device, wherein the determination section is further configured to determine the second condition, based on the photographed image received by the communication unit from the external device, is satisfied. ### Claim 14 (depends on 1) The presentation control device according to claim 1, further comprising: a communication unit configured to communicate with an external device, wherein the presentation control section is further configured to allow the external device for the presentation associated with the recognition target. ### Claim 15 (depends on 1) The presentation control device according to claim 1, wherein the presentation control section is further configured to allow the presentation associated with the recognition target by a user-wearable presentation device. ### Claim 16 A method, comprising: in a presentation control device: determining that a first condition is satisfied, wherein the first condition corresponds to a first user action from a plurality of estimated user actions; recognizing a recognition target based on a photographed image; determining that a second condition is satisfied, based on the determination that the first condition is satisfied, wherein the second condition corresponds to the recognition target, wherein the second condition includes a third condition related to a user action history, wherein the user action history includes history information corresponding to at least one of the first user action or a second user action from the plurality of estimated user actions, and wherein the first user action and the second user action are recognized, based on the photographed image; and allowing a presentation associated with the recognition target, based on the determination that both of the first condition and the second condition are satisfied. ### Claim 17 A non-transitory computer-readable medium having stored thereon, computer-executable instructions for causing a computer to execute operations, the operations comprising: determining that a first condition is satisfied, wherein the first condition corresponds to a first user action from a plurality of estimated user actions; recognizing a recognition target based on a photographed image; determining that a second condition is satisfied, based on the determination that the first condition is satisfied, wherein the second condition corresponds to the recognition target, wherein the second condition includes a third condition related to a user action history, wherein the user action history includes history information corresponding to at least one of the first user action or a second user action from the plurality of estimated user actions, and wherein the first user action and the second user action are recognized, based on the photographed image; and allowing a presentation associated with the recognition target, based on the determination that both of the first condition and the second condition are satisfied.