# US 10,769,207 B2 · Multimedia focalization > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,207 B2 - Document ID: US10769207B2 - Status: Granted - Kind: B2 - Application number: 15/679,673 - Filed: 2017-08-17 - Published: 2019-02-21 - Granted: 2020-09-08 - Earliest claimed: 2017-08-17 - Assignees: OpenTV, Inc. - Applicants: OpenTV, Inc. - Inventors: Eunsook An - Web page: https://patentgrep.com/patent/US10769207B2 ## CPC - G06F 16/7335: {Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate (end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728)} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 16/434: {using image data, e.g. images, photos, pictures taken by a user} - G06F 16/743: {a collection of video files or sequences} - G06V 40/169: {Holistic features and representations, i.e. based on the facial image taken as a whole} - G06V 40/179: {metadata assisted face recognition} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Example implementations are directed to methods and systems for individualized multimedia navigation and control including receiving metadata for a piece of digital content, where the metadata comprises a primary image and text that is used to describes the digital content; analyzing the primary image to detect one or more objects; selecting one or more secondary images corresponding to each detected object; and generating a data structure for the digital content comprising the one or more secondary images, where the digital content is described by a preferred secondary image. ## Claims ### Claim 1 A method comprising: receiving metadata for a piece of digital content, wherein the metadata comprises at least a primary image that is a representation of the piece of digital content; analyzing the primary image using at least facial recognition to detect at least a first face and a second face; determining that a first size of the first face in the primary image is larger than a second size of the second face in the primary image; selecting a first secondary image in the primary image corresponding to the first face; selecting a second secondary image in the primary image corresponding to the second face; and identifying the first secondary image as a preferred secondary image based at least on the first size of the first face being larger than the second size of the second face. ### Claim 2 (depends on 1) The method of claim 1, further comprising: identifying the second secondary image as the preferred secondary image based on at least a user preference. ### Claim 3 (depends on 1) The method of claim 1, further comprising: generating a data structure for the piece of digital content, the data structure comprising at least position information corresponding to positions of the first secondary image and the second secondary image in the primary image; and determining a label for the second secondary image based at least on text information that describes the piece of digital content, wherein the data structure further includes the label, wherein the second secondary image is identified as the preferred secondary image based on at least a user preference and the label. ### Claim 4 (depends on 3) The method of claim 3, further comprising: receiving a request to describe the piece of digital content; receiving user information that includes the user preference; determining that the label corresponds to the user preference; and causing presentation of the second secondary image to describe the piece of digital content. ### Claim 5 (depends on 3) The method of claim 3, further comprising: determining the label for the second secondary image based on matching a recognized face with a name in the text information. ### Claim 6 (depends on 3) The method of claim 3, further comprising: calculating a confidence score for a relation of the second secondary image to a portion of the text information. ### Claim 7 (depends on 1) The method of claim 1, further comprising: identifying a set of secondary image coordinates as the position information; and storing the position information in a data structure. ### Claim 8 (depends on 7) The method of claim 7, further comprising: searching the primary image for the first secondary image based on the set of secondary image coordinates; and causing presentation of a portion of the primary image corresponding to the set of secondary image coordinates. ### Claim 9 (depends on 1) The method of claim 1, further comprising: identifying a portion of the primary image corresponding to the first face and the second face; and storing the identified portion of the primary image in a data structure. ### Claim 10 (depends on 1) The method of claim 1, wherein the piece of digital content is at least one of a television show, a movie, a podcast, or a sporting event, the first secondary image including a face of a person featured in the piece of digital content; and wherein the piece of digital content is described by the preferred secondary image as part of a menu to navigate a library of digital content. ### Claim 11 A system comprising: a memory; one or more processors coupled to the memory comprising instructions that when executed cause the one or more processors to perform operations to: receive a request to describe a piece of digital content; receive a set of user information that includes a user preference; receive metadata for the piece of digital content, wherein the metadata comprises an image that represents the piece of digital content; analyze the image using at least facial recognition to detect at least a first face and a second face; determine that a first size of the first face in the image is larger than a second size of the second face in the image; select a first secondary image in the image corresponding to the first face; select a second secondary image in the image corresponding to the second face; determine position information corresponding to positions of the first secondary image and the second secondary image in the image; and responsive to a user request and using at least the position information, cause presentation of the first secondary image as a preferred secondary image based at least on the first size of the first face being larger than the second size of the second face. ### Claim 12 (depends on 11) The system of claim 11, wherein the second secondary image is identified as the preferred secondary image based on at least a heuristic. ### Claim 13 (depends on 11) The system of claim 11, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to perform operations to: determine a label for the second secondary image based at least on text information that describes the piece of digital content; and determine the preferred secondary image based on at least the label determined for the second-secondary image. ### Claim 14 (depends on 13) The system of claim 13, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to perform operations to: determine the label for the second-secondary image based on matching a recognized face with a name in the text information. ### Claim 15 (depends on 11) The system of claim 11, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to perform operations to: identify a portion of the image corresponding to the first secondary image; and store the identified portion of the image in a data structure. ### Claim 16 A non-transitory computer readable medium, comprising instructions that when executed by one or more processors, cause the one or more processors to perform operations to: receive metadata for a piece of digital content, wherein the metadata comprises at least a primary image that is used to describe the piece of digital content; analyze the primary image using at least facial recognition to detect at least a first face and a second face; determine that a first size of the first face in the primary image is larger than a second size of the second face in the primary image; select a first secondary image in the primary image corresponding to the first face; select a second secondary image in the primary image corresponding to the second face; and, wherein, in response to a user request, identify the first secondary image as a preferred secondary image based at least on the first size of the first face being larger than the second size of the second face. ### Claim 17 (depends on 16) The non-transitory computer readable medium of claim 16, wherein the instructions when executed by the one or more processors, further cause the one or more processors to perform operations to: identify a set of secondary image coordinates as position information; and store the position information in a data structure. ### Claim 18 (depends on 16) The non-transitory computer readable medium of claim 16, wherein the instructions when executed by the one or more processors, further cause the one or more processors to perform operations to: identify the second secondary image as the preferred secondary image based on at least a user preference.