# US 12,010,381 B2 · Orientation control of display device based on content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,381 B2 - Document ID: US12010381B2 - Status: Granted - Kind: B2 - Application number: 17/303,997 - Filed: 2021-06-11 - Published: 2022-12-15 - Granted: 2024-06-11 - Earliest claimed: 2021-06-11 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Thomas Dawson; Steven Richman - Web page: https://patentgrep.com/patent/US12010381B2 ## CPC - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06Q 30/0241: Advertisements - G06T 7/73: using feature-based methods - G06V 40/00: Recognition of biometric, human-related or animal-related patterns in image or video data - G06V 40/176: {Dynamic expression} - G09F 27/005: {Signs associated with a sensor} - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - H04L 67/306: User profiles - H04N 21/252: {Processing of multiple end-users' preferences to derive collaborative data} - H04N 21/25883: {being end-user demographical data, e.g. age, family status or address (arrangements for identifying locations of users in broadcast systems H04H60/52)} - H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)} - H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)} - H04N 21/41415: {involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/44222: {Analytics of user selections, e.g. selection of programmes or purchase activity (monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33)} - H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)} - H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)} - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns - G09G 2320/028: by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction - G09G 2320/068: for control of viewing angle adjustment - H04N 5/655: Construction or mounting of chassis, e.g. for varying the elevation of the tube - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract An electronic device including a display device configured to render first content. The electronic device is communicably coupled to the display device and controls one or more imaging devices to receive one or more images from the one or more imaging devices. The electronic device further determines a first position of one or more living objects within a pre-defined region from the display device, based on the received one or more images and the rendered first content. The electronic device further controls an orientation of the display device towards the determined first position of the one or more living objects. ## Claims ### Claim 1 An electronic device, comprising: a display device configured to render first content; and a processor communicably coupled to the display device, wherein the processor is configured to: control one or more imaging devices to receive one or more images from the one or more imaging devices; select, based on metadata of the rendered first content, one or more living objects from a plurality of living objects present within a pre-defined region from the display device, wherein the one or more living objects are selected from the one or more images received from the one or more imaging devices; retrieve profile information associated with the one or more living objects; compare the retrieved profile information of the one or more living objects with the metadata of the rendered first content; determine a first position of the selected one or more living objects within the pre-defined region based on the received one or more images, and the comparison between the retrieved profile information of the one or more living objects and the metadata of the rendered first content; and control an orientation of the display device towards the determined first position of the one or more living objects. ### Claim 2 (depends on 1) The electronic device according to claim 1, wherein the processor is further configured to: determine demographic information associated with the one or more living objects selected in the received one or more images; compare the demographic information associated with the selected one or more living objects, with the rendered first content; and determine, based on the comparison, the first position of the one or more living objects within the pre-defined region. ### Claim 3 (depends on 2) The electronic device according to claim 2, wherein based on the demographic information, the processor is further configured to: select second content to be rendered to the one or more living objects, wherein the second content is different from the first content; and control the display device to render the selected second content. ### Claim 4 (depends on 3) The electronic device according to claim 3, further comprising a memory configured to store a predefined playlist of content, wherein the processor is further configured to select the second content from the predefined playlist of content. ### Claim 5 (depends on 1) The electronic device according to claim 1, wherein the processor is further configured to: determine a facial expression of the one or more living objects based on the orientation of the display device towards the first position of the one or more living objects; select second content to be rendered to the one or more living objects based on the determined facial expression, wherein the second content is different from the first content; and control the display device to render the selected second content. ### Claim 6 (depends on 1) The electronic device according to claim 1, wherein the processor is further configured to determine the first position of the one or more living objects within the pre-defined region based on the metadata associated with the first content rendered on the display device. ### Claim 7 (depends on 6) The electronic device according to claim 6, wherein the metadata associated with the first content comprises at least one of information associated with a product indicated by the first content, information associated with a genre, or information associated with one or more products indicated in one or more image frames. ### Claim 8 (depends on 1) The electronic device according to claim 1, wherein the processor is further configured to: determine demographic information associated with each of the plurality of living objects selected in the received one or more images; select the one or more living objects from the selected plurality of living objects based on the demographic information and the first content; and control the orientation of the display device towards the first position of the selected one or more living objects. ### Claim 9 (depends on 1) The electronic device according to claim 1, wherein the processor is further configured to: track a change from the first position of the one or more living objects to a second position within the pre-defined region; and control the orientation of the display device towards the second position of the one or more living objects. ### Claim 10 (depends on 1) The electronic device according to claim 1, wherein the processor is further configured to customize the first content for the one or more living objects based on one of demographic information, the profile information, or a facial expression associated with the one or more living objects, and the customization of the first content is based on the orientation of the display device towards the first position of the one or more living objects. ### Claim 11 (depends on 1) The electronic device according to claim 1, further comprising a memory configured to store information about the orientation of the display device. ### Claim 12 A method, comprising: in an electronic device: controlling a display device to render first content; controlling one or more imaging devices for receiving one or more images from the one or more imaging devices; selecting, based on metadata of the rendered first content, one or more living objects from a plurality of living objects present within a pre-defined region from the display device, wherein the one or more living objects are selected from the one or more images received from the one or more imaging devices; retrieving profile information associated with the one or more living objects; comparing the retrieved profile information of the one or more living objects with the metadata of the rendered first content; determining a first position of the selected one or more living objects within the pre-defined region based on the received one or more images, and the comparison of the retrieved profile information of the one or more living objects with the metadata of the rendered first content; and controlling an orientation of the display device towards the determined first position of the one or more living objects. ### Claim 13 (depends on 12) The method according to claim 12, further comprising: determining demographic information associated with the one or more living objects selected in the received one or more images; comparing the demographic information associated with the selected one or more living objects, with the rendered first content; and based on the comparison, determining the first position of the one or more living objects within the pre-defined region. ### Claim 14 (depends on 13) The method according to claim 13, based on the demographic information, further comprising: selecting second content to be rendered to the one or more living objects, wherein the second content is different from the first content; and controlling the display device to render the selected second content. ### Claim 15 (depends on 12) The method according to claim 12, further comprising: determining a facial expression of the one or more living objects based on the orientation of the display device towards the first position of the one or more living objects; selecting second content to be rendered to the one or more living objects based on the determined facial expression, wherein the second content is different from the first content; and controlling the display device to render the selected second content. ### Claim 16 (depends on 12) The method according to claim 12, further comprising determining the first position of the one or more living objects within the pre-defined region based on the metadata associated with the first content rendered on the display device. ### Claim 17 A non-transitory computer-readable medium having stored thereon, computer-executable instructions that when executed by an electronic device, causes the electronic device to execute operations, the operations comprising: controlling a display device to render first content; controlling one or more imaging devices for receiving one or more images from the one or more imaging devices; selecting, based on metadata of the rendered first content, one or more living objects from a plurality of living objects present within a pre-defined region from the display device, wherein the one or more living objects are selected from the one or more images received from the one or more imaging devices; retrieving profile information associated with the one or more living objects; comparing the retrieved profile information of the one or more living objects with the metadata of the rendered first content; determining a first position of the selected one or more living objects within the pre-defined region based on the received one or more images, and the comparison of the retrieved profile information of the one or more living objects with the metadata of the rendered first content; and controlling an orientation of the display device towards the determined first position of the one or more living objects. ### Claim 18 (depends on 17) The non-transitory computer-readable medium according to claim 17, further comprising determining demographic information associated with the one or more living objects selected in the received one or more images; comparing the demographic information associated with the selected one or more living objects, with the rendered first content; and based on the comparison, determining the first position of the one or more living objects within the pre-defined region. ### Claim 19 (depends on 18) The non-transitory computer-readable medium according to claim 18, based on the demographic information, further comprising: selecting second content to be rendered to the one or more living objects, wherein the second content is different from the first content; and controlling the display device to render the selected second content. ### Claim 20 (depends on 17) The non-transitory computer-readable medium according to claim 17, further comprising determining the first position of the one or more living objects within the pre-defined region based on the metadata associated with the first content rendered on the display device.