# US 10,311,333 B2 · Terminal device, information processing device, object identifying method, program, and object identifying system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,333 B2 - Document ID: US10311333B2 - Status: Granted - Kind: B2 - Application number: 15/926,367 - Filed: 2018-03-20 - Published: 2018-07-26 - Granted: 2019-06-04 - Earliest claimed: 2011-03-25 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Takayuki Yoshigahara; Masaki Fukuchi - Web page: https://patentgrep.com/patent/US10311333B2 ## CPC - G06V 20/20: in augmented reality scenes - G06F 18/2115: by evaluating different subsets according to an optimisation criterion, e.g. class separability, forward selection or backward elimination - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60) - G06V 10/17: {using hand-held instruments} - G06V 10/40: Extraction of image or video features - G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching} - G06V 30/142: using hand-held instruments; Constructional details of the instruments - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A device, apparatus, and method provide logic for processing information. In one implementation, a device may include an image acquisition unit configured to acquire an image, and a transmission unit configured to transmit information associated with the image to an information processing apparatus, such as a server. The server may be associated with a first feature quantity dictionary. The device also may include a receiving unit configured to receive a second feature quantity dictionary from the server in response to the transmission. The second feature quantity dictionary may include less information than the first feature quantity dictionary, and the server may generate the second feature quantity dictionary based on the image information and the first feature quantity dictionary. The device may include an identification unit configured to identify an object within the image using the second feature quantity dictionary. ## Claims ### Claim 1 An image processing method, the method being executed via at least one processor, and comprising: acquiring a first image including a first real object; transmitting, to a server, a first information associated with the first image; acquiring, from the server and based on the first information associated with the first image, a data set that includes a second augmented reality (AR) content associated with a second real object; recognizing the second real object based on the data set; and controlling a display to display, based on the data set, the second augmented reality (AR) content related to the second real object, wherein the second real object is different from the first real object, wherein the second real object is not included in the first image, and wherein the second real object is predicted to appear in one or more subsequent acquired images. ### Claim 2 (depends on 1) The image processing method according to claim 1, wherein the data set includes a first augmented reality (AR) associated with the first real object. ### Claim 3 (depends on 1) The image processing method according to claim 1, wherein the data set includes feature data associated with the second real object. ### Claim 4 (depends on 1) The image processing method according to claim 1, further comprising: transmitting, to the server, the first information in response to a detected trigger event. ### Claim 5 (depends on 4) The image processing method according to claim 4, wherein the detected trigger event is a user instruction. ### Claim 6 (depends on 1) The image processing method according to claim 1, wherein the first information includes a position information of an apparatus which executes the image processing method. ### Claim 7 (depends on 1) The image processing method according to claim 1, wherein the first information includes a time information. ### Claim 8 (depends on 1) The image processing method according to claim 1, wherein the first information includes capability information of an apparatus which executes the image processing method. ### Claim 9 (depends on 8) The image processing method according to claim 8, wherein the capability information of the apparatus indicates at least one of a number of pieces of data processable by the apparatus, a number of processor cores of the apparatus, and a memory capacity of the apparatus. ### Claim 10 (depends on 1) The image processing method according to claim 1, wherein the data set comprises only selected feature data having highest relations to the first information associated with the first image and satisfying a threshold criteria. ### Claim 11 (depends on 10) The image processing method according to claim 10, wherein the feature data of the data set comprises (i) a real object predicted to fall within the first image or (ii) a real object predicted to fall within one or more second images acquired subsequent to the first image. ### Claim 12 (depends on 10) The image processing method according to claim 10, further comprising: extracting at least one feature quantity from the first image; determining whether the extracted feature quantity corresponds to at least one of the feature data of the data set; and identifying the second real object within the first image, based on at least the determination. ### Claim 13 (depends on 12) The image processing method according to claim 12, further comprising: obtaining, based on the data set, an object identifier associated with the corresponding feature data; and identifying the second real object within the first image, based on the obtained object identifier. ### Claim 14 A device, comprising: circuitry configured to: acquire a first image including a first real object; transmit, to a server, a first information associated with the first image; acquire, from the server and based on the first information associated with the first image, a data set that includes a second augmented reality (AR) content associated with a second real object; recognize the second real object based on the data set; and control a display to display, based on the data set, the second augmented reality (AR) content related to the second real object, wherein the second real object is different from the first real object, wherein the second real object is not included in the first image, and wherein the second real object is predicted to appear in one or more subsequent acquired images. ### Claim 15 A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising: acquiring a first image including a first real object; transmitting, to a server, a first information associated with the first image; acquiring, from the server and based on the first information associated with the first image, a data set that includes a second augmented reality (AR) content associated with a second real object; recognizing the second real object based on the data set; and controlling a display to display, based on the data set, the second augmented reality (AR) content related to the second real object, wherein the second real object is different from the first real object, wherein the second real object is not included in the first image, and wherein the second real object is predicted to appear in one or more subsequent acquired images.