# US 12,602,869 B2 · Apparatus, systems and methods for processing images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,869 B2 - Document ID: US12602869B2 - Status: Granted - Kind: B2 - Application number: 18/311,947 - Filed: 2023-05-04 - Published: 2023-11-16 - Granted: 2026-04-14 - Earliest claimed: 2022-05-11 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment Inc. - Inventors: Paul Terence Mulligan - Web page: https://patentgrep.com/patent/US12602869B2 ## CPC - A63F 13/655: by importing photos, e.g. of the player - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - A63F 13/214: for locating contacts on a surface, e.g. floor mats or touch pads - A63F 13/73: Authorising game programs or game devices, e.g. checking authenticity - G06T 7/40: Analysis of texture (depth or shape recovery from texture G06T7/529) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 2207/20164: Salient point detection; Corner detection - G06V 2201/07: Target detection - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A data processing apparatus includes receiving circuitry to receive one or more first images comprising a plurality of real-world objects, processing circuitry to detect one or more respective real-world objects in one or more of the first images where, for each detected real-world object, the processing circuitry is configured to generate a respective texture in dependence upon pixel data for the detected real-world object and to associate the respective texture with predefined mesh data to create a respective game asset for the detected real-world object, storage circuitry to store one or more respective game assets for one or more of the detected real-world objects and rendering circuitry to generate one or more images for display including one or more of the respective game assets. ## Claims ### Claim 1 A method, comprising: receiving one or more first images comprising a plurality of real world objects; detecting one or more respective real world objects in one or more of the first images by detecting a plurality of corners for each real world object in the one or more first images; for each detected real world object: extracting pixel data from within a geometric region bounded by the plurality of detected corners associated with the detected real world object in a corresponding first image; generating a respective texture based upon the extracted pixel data for the detected real world object; associating the respective texture with predefined mesh data to create a respective game asset for the detected real world object; storing one or more respective game assets for one or more of the detected real world objects; and generating one or more images for display including one or more of the respective game assets. ### Claim 2 (depends on 1) The method of claim 1, wherein detecting one or more respective real world objects in one or more of the first images by detecting a plurality of corners for each real world object in the one or more first images comprises executing one or more contour detection algorithms to identify the plurality of corners for each real world object. ### Claim 3 (depends on 1) The method of claim 1, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises generating the respective texture according to at least one of a predetermined aspect ratio or a predetermined size. ### Claim 4 (depends on 1) The method of claim 1, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises applying a geometric warping operation to the extracted pixel data to meet at least one of a predetermined aspect ratio or a predetermined size. ### Claim 5 (depends on 1) The method of claim 1, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises applying an image interpolation operation to the extracted pixel data to meet at least one of a predetermined aspect ratio or a predetermined size. ### Claim 6 (depends on 1) The method of claim 1, wherein associating the respective texture with predefined mesh data to create a respective game asset for the detected real world object comprises mapping one or more corners of the respective texture with one or more vertices of the predefined mesh data. ### Claim 7 (depends on 1) The method of claim 1, further comprising: detecting an optically detectable marker associated with each real world object of the plurality of real world objects; and verifying that each optically detectable marker associated with each real world object is unique. ### Claim 8 (depends on 7) The method of claim 7, further comprising: detecting an optically detectable marker associated with a first real world object matches to a previously detected optically detectable marker associated with a prior real world object; and in response, preventing creation of a game asset associated with the first real world object. ### Claim 9 (depends on 7) The method of claim 7, wherein the optically detectable marker comprises at least one of a barcode or a QR code. ### Claim 10 A system comprising: one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising: receiving one or more first images comprising a plurality of real world objects; detecting one or more respective real world objects in one or more of the first images by detecting a plurality of corners for each real world object in the one or more first images; for each detected real world object: extracting pixel data from within a geometric region bounded by the plurality of detected corners associated with the detected real world object in a corresponding first image; generating a respective texture based upon the extracted pixel data for the detected real world object; associating the respective texture with predefined mesh data to create a respective game asset for the detected real world object; storing one or more respective game assets for one or more of the detected real world objects; and generating one or more images for display including one or more of the respective game assets. ### Claim 11 (depends on 10) The system of claim 10, wherein detecting one or more respective real world objects in one or more of the first images by detecting a plurality of corners for each real world object in the one or more first images comprises executing one or more contour detection algorithms to identify the plurality of corners for each real world object. ### Claim 12 (depends on 10) The system of claim 10, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises generating the respective texture according to at least one of a predetermined aspect ratio or a predetermined size. ### Claim 13 (depends on 10) The system of claim 10, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises applying a geometric warping operation to the extracted pixel data to meet at least one of a predetermined aspect ratio or a predetermined size. ### Claim 14 (depends on 10) The system of claim 10, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises applying an image interpolation operation to the extracted pixel data to meet at least one of a predetermined aspect ratio or a predetermined size. ### Claim 15 (depends on 10) The system of claim 10, wherein associating the respective texture with predefined mesh data to create a respective game asset for the detected real world object comprises mapping one or more corners of the respective texture with one or more vertices of the predefined mesh data. ### Claim 16 (depends on 10) The system of claim 10, further comprising: detecting an optically detectable marker associated with each real world object of the plurality of real world objects; and verifying that each optically detectable marker associated with each real world object is unique. ### Claim 17 (depends on 10) The system of claim 10, further comprising: detecting an optically detectable marker associated with a first real world object matches to a previously detected optically detectable marker associated with a prior real world object; and in response, preventing creation of a game asset associated with the first real world object. ### Claim 18 One or more non-transitory computer storage media encoded with computer program instructions that when executed by one or more computers cause the one or more computers to perform operations comprising: receiving one or more first images comprising a plurality of real world objects; detecting one or more respective real world objects in one or more of the first images by detecting a plurality of corners for each real world object in the one or more first images; for each detected real world object: extracting pixel data from within a geometric region bounded by the plurality of detected corners associated with the detected real world object in a corresponding first image; generating a respective texture based upon the extracted pixel data for the detected real world object; associating the respective texture with predefined mesh data to create a respective game asset for the detected real world object; storing one or more respective game assets for one or more of the detected real world objects; and generating one or more images for display including one or more of the respective game assets. ### Claim 19 (depends on 18) The one or more non-transitory computer storage media according to claim 18, wherein detecting one or more respective real world objects in one or more of the first images by detecting a plurality of corners for each real world object in the one or more first images comprises executing one or more contour detection algorithms to identify the plurality of corners for each real world object. ### Claim 20 (depends on 18) The one or more non-transitory computer storage media according to claim 18, wherein generating a respective texture based upon the extracted pixel data for the detected real world object comprises generating the respective texture according to at least one of a predetermined aspect ratio or a predetermined size.