# US 12,010,403 B2 · Information processing apparatus, information processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,403 B2 - Document ID: US12010403B2 - Status: Granted - Kind: B2 - Application number: 17/778,678 - Filed: 2020-11-13 - Published: 2022-12-29 - Granted: 2024-06-11 - Earliest claimed: 2019-12-20 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Manabu Kamo - Web page: https://patentgrep.com/patent/US12010403B2 ## CPC - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 21/854: Content authoring - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components - G06V 10/761: {Proximity, similarity or dissimilarity measures} - H04N 21/234: Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs - H04N 21/25875: {involving end-user authentication (restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06)} - H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering - H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)} - G06T 2207/20221: Image fusion; Image merging - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract For example, in a competition, such as a race competition, in which comparison with others is important, there is a demand for viewing a relationship between a motion of the entire competition and a motion of each player at once. For this purpose, an information processing apparatus includes: a content generation unit that generates display content by combining a first image captured by a first imaging device and a second image captured by the first imaging device or another imaging device and having a part of subjects in the first image as a subject. ## Claims ### Claim 1 An information processing apparatus, comprising: processing circuitry configured to obtain a first image of a sporting event captured by an imaging device, the first image having a first subject and a second subject both participating in the sporting event when the first image was captured; extract a region of the first image containing the first subject, the region not containing the second subject; enlarge the extracted region to generate a second image; obtain a third image of an electronic scoreboard displayed during the sporting event; generate display content by combining the first image, the second image, and superimposition information including comparison information indicating a result of the first subject participating in the sporting event, which is obtained by performing image analysis on the third image of the electronic scoreboard; and control transmission of the generated display content. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to perform a synchronization process of synchronizing the first image and the second image. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the superimposition information included in the display content generated by the processing circuitry is explanatory information on the first image or the second image. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the comparison information includes information indicating a performance result of a person other than the first subject of the second image. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to perform image analysis on the first subject of the second image and extract a characteristic amount which affects a result of the first subject of the second image, wherein the superimposition information includes information regarding the characteristic amount. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to: perform user authentication based on received user information, and control selection and transmission of the display content based on an authentication result. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to set a disclosure range for the display content. ### Claim 8 (depends on 7) The information processing apparatus according to claim 7, wherein the processing circuitry is further configured to perform user authentication based on received user information, and control the transmission of the display content based on an authentication result and the disclosure range. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein, in the synchronization process, the processing circuitry is further configured to perform comparison of image content between the first image and the second image. ### Claim 10 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to perform streaming distribution of the display content. ### Claim 11 An information processing method executed by an information processing apparatus, the method comprising: obtaining a first image of a sporting event captured by an imaging device, the first image having a first subject and a second subject, both participating in the sporting event when the first image was captured; extracting a region of the first image containing the first subject, the region not containing the second subject; enlarging the extracted region to generate a second image; obtaining a third image of an electronic scoreboard displayed during the sporting event; generating display content by combining the first image, the second image, and superimposition information including comparison information indicating a result of the first subject participating in the sporting event, which is obtained by performing image analysis on the third image of the electronic scoreboard; and controlling transmission of the generated display content. ### Claim 12 A non-transitory computer-readable medium storing a program for causing an information processing apparatus to execute a method, comprising: obtaining a first image of a sporting event captured by an imaging device, the first image having a first subject and a second subject, both participating in the sporting event when the first image was captured; extracting a region of the first image containing the first subject, the region not containing the second subject; enlarging the extracted region to generate a second image; obtaining a third image of an electronic scoreboard displayed during the sporting event; generating display content by combining the first image, the second image, and superimposition information including comparison information indicating a result of the first subject participating in the sporting event, which is obtained by performing image analysis on the third image of the electronic scoreboard; and controlling transmission of the generated display content.