# US 12,001,669 B2 · Searching for write information corresponding to a feature of an image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,669 B2 - Document ID: US12001669B2 - Status: Granted - Kind: B2 - Application number: 17/439,101 - Filed: 2020-03-17 - Published: 2022-05-12 - Granted: 2024-06-04 - Earliest claimed: 2019-03-29 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Gakuya Kondo; Chao Ma - Web page: https://patentgrep.com/patent/US12001669B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06V 10/7788: {the supervisor being a human, e.g. interactive learning with a human teacher} - G06F 16/538: Presentation of query results - G06F 16/54: Browsing; Visualisation therefor - G06V 10/46: Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features (colour feature extraction G06V10/56) - G06V 10/757: {Matching configurations of points or features} - G06V 30/10: Character recognition - G06F 40/169: Annotation, e.g. comment data or footnotes - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An image processing device and method for more easily performing a write operation on an image. Write information corresponding to a feature of an image of processing target is searched for based on relevant information that associates the write information with the feature of the image. For example, it is furthermore possible to search for write information corresponding to the feature of an image of the processing target based on the learning result of the user's behavior. The present invention can be applied to, for example, an information processing device, an image processing device, electronic equipment, an image processing method, a program, or the like. ## Claims ### Claim 1 An image processing device, comprising: processing circuitry configured to display, on a display, an image of a sequence of maces, the image having a first feature; compare stored data of the first feature with features of an immediately preceding image in the sequence of images; in response to determining that the first feature of the image does not match any of the features of the immediately preceding image, search for first write information corresponding to the first feature, based on stored relevant information that associates write information with a corresponding feature; and display, on the display together with the image, the first write information corresponding to the first feature when the first write information is obtained from the search. ### Claim 2 (depends on 1) The image processing device according to claim 1, wherein the processing device is further configured to: learn a behavior of a user with respect to a search result of the search, and search for the first write information corresponding to the first feature of the image based on a learning result of the behavior of the user. ### Claim 3 (depends on 2) The image processing device according to claim 2, wherein the behavior of the user includes a behavior of erasing write information displayed together with the image based on a result of the search, and a behavior of adding write information on the image. ### Claim 4 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry is further configured to perform a process on at least any one of the image to be output and the first write information. ### Claim 5 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry is further configured to perform processing related to display control of the first write information superimposed on the image. ### Claim 6 (depends on 5) The image processing device according to claim 5, wherein, as the processing related to the display control, when the first feature of the image does not match any features of the immediately preceding image, the processing circuitry is further configured to perform control so as to erase second write information corresponding to a second feature of the immediately preceding image. ### Claim 7 (depends on 5) The image processing device according to claim 5, wherein, as the processing related to the display control, the processing circuitry is further configured to correct the first write information. ### Claim 8 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry is further configured to associate certain write information to the output together with a certain image with a feature of the certain image to generate the relevant information; and memory that stores the generated relevant information. ### Claim 9 (depends on 8) The image processing device according to claim 8, wherein the processing circuitry is further configured to generate the relevant information for each image of the sequence of images. ### Claim 10 (depends on 8) The image processing device according to claim 8, wherein the memory stores a difference of the relevant information from a previous image. ### Claim 11 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry is further configured to compare the first feature with the features of the immediately preceding image based on a histogram and a feature point of the image. ### Claim 12 (depends on 11) The image processing device according to claim 11, wherein the processing circuitry is further configured to compare the image with the immediately preceding image based on a recognition result of a character included in the image. ### Claim 13 (depends on 1) The image processing device according to claim 1, wherein the processing circuitry is further configured to set an entirety or a part of the image as a comparison target ramie, and a compare the first feature, which is in the comparison target range, with the immediately preceding image. ### Claim 14 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry is further configured to set the comparison target range based on a layout of the image. ### Claim 15 (depends on 13) The image processing device according to claim 13, wherein the processing circuitry is further configured to set the comparison target range based on a learning result of an impartment position of write information. ### Claim 16 (depends on 1) The image processing de-ice according to claim 1, wherein the processing circuitry is further configured to: analyze the image and extract the first feature of the image, compare the extracted first feature of the image with the features of the immediately preceding image, and search for the write information corresponding to the first feature of the image. ### Claim 17 An image processing method, comprising: displaying on a display, an image of a sequence of images, the image having a first feature; comparing stored data of the first feature with features of an immediately preceding image in the sequence of images; in response to determining that the first feature of the image does not match any of the features of the immediately preceding image, searching for first write information corresponding to the first feature, based on stored relevant information that associates write information with a corresponding feature; and displaying, on the display together with the image, the first write information corresponding to the first feature when the first write information is obtained from the search. ### Claim 18 A non-transitory computer-readable medium storing a program that causes a computer to perform a method, comprising: displaying, on a display, an image of a sequence of images, the image having a first feature; comparing stored data of the first feature with features of an immediately preceding image in the sequence of images; in response to determining that the first feature of the image does not match any of the features of the immediately preceding image, searching for first write information corresponding to the first feature, based on stored relevant information that associates write information with a corresponding feature; and displaying, on the display together with the image, the first write information corresponding to the first feature when the first write information is obtained from the search.