# US 12,008,682 B2 · Information processor, information processing method, and program image to determine a region of an operation target in a moving image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,682 B2 - Document ID: US12008682B2 - Status: Granted - Kind: B2 - Application number: 17/695,398 - Filed: 2022-03-15 - Published: 2022-06-30 - Granted: 2024-06-11 - Earliest claimed: 2017-12-22 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Shogo Takanashi - Web page: https://patentgrep.com/patent/US12008682B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06T 11/00: Two-dimensional [2D] image generation - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/0354: with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 3/048: Interaction techniques based on graphical user interfaces [GUI] - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 16/783: using metadata automatically derived from the content - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip - G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) - H04N 5/91: Television signal processing therefor - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A mechanism that makes it possible to efficiently specify an important region of a moving image including a dynamic content. An information processor including a control unit that recognizes a motion of an operator with respect to an operation target in a moving image and specifies an important region of the operation target in the moving image on a basis of an operation position of the operator. ## Claims ### Claim 1 An information processing apparatus comprising: processing circuitry configured to: determine an important region of an operation target in a moving image on a basis of an operation position of an operator with respect to the operation target in the moving image, wherein the processing circuitry is further configured to determine the important region by being configured to: specify the important region based on an accumulated value of a time in which the operation position remains for each region of the operation target appearing in the moving image, wherein the accumulated value is larger than a predetermined value, and wherein the processing circuitry is further configured to modify the accumulated value of the time in which the operation position remains for each region of the operation target appearing in the moving image. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to decrease the accumulated value of the region. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the processing circuitry is further configured to decrease the accumulated value in response to the processing circuitry determining that a predetermined change has occurred in the operation target appearing in the moving image. ### Claim 4 (depends on 3) The information processing apparatus according to claim 3, wherein the processing circuitry is further configured to decrease the accumulated value in response to the processing circuitry determining that rewriting or erasure has occurred in the operation target appearing in the moving image. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to calculate, for each region of the operation target appearing in the moving image, the accumulated value of the time in which the operation position remains. ### Claim 6 (depends on 5) The information processing apparatus according to claim 5, wherein the accumulated value of the time in which the operation position remains is calculated by adding each time period in which the operation position occurs in the moving image. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to generate a superimposed image indicating the important region and incorporate the superimposed image into the moving image. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, wherein the operation target is a writing surface. ### Claim 9 An information processing method comprising: determining, using processing circuitry, an important region of an operation target in a moving image on a basis of an operation position of an operator with respect to the operation target in the moving image, wherein the determining further comprises: specifying the important region based on an accumulated value of a time in which the operation position remains for each region of the operation target appearing in the moving image, the accumulated value being larger than a predetermined value, and wherein the determining further comprises modifying the accumulated value of the time in which the operation position remains for each region of the operation target appearing in the moving image. ### Claim 10 (depends on 9) The information processing method according to claim 9, wherein the determining further comprises decreasing the accumulated value of the region. ### Claim 11 (depends on 10) The information processing method according to claim 10, wherein the determining further comprises decreasing the accumulated value in response to determining that a predetermined change has occurred in the operation target appearing in the moving image. ### Claim 12 (depends on 11) The information processing method according to claim 11, wherein the determining further comprises decreasing the accumulated value in response to determining that rewriting or erasure has occurred in the operation target appearing in the moving image. ### Claim 13 (depends on 9) The information processing method according to claim 9, further comprising calculating, for each region of the operation target appearing in the moving image, the accumulated value of the time in which the operation position remains. ### Claim 14 (depends on 13) The information processing method according to claim 13, wherein the accumulated value of the time in which the operation position remains is calculated by adding each time period in which the operation position occurs in the moving image. ### Claim 15 A non-transitory computer readable medium having stored thereon a program that when executed by a computer causes the computer to implement an information processing method comprising: determining, using processing circuitry, an important region of an operation target in a moving image on a basis of an operation position of an operator with respect to the operation target in the moving image, wherein the determining further comprises: specifying the important region based on an accumulated value of a time in which the operation position remains for each region of the operation target appearing in the moving image, the accumulated value being larger than a predetermined value, and wherein the determining further comprises modifying the accumulated value of the time in which the operation position remains for each region of the operation target appearing in the moving image. ### Claim 16 (depends on 15) The non-transitory computer readable medium according to claim 15, wherein the determining further comprises decreasing the accumulated value of the region. ### Claim 17 (depends on 16) The non-transitory computer readable medium according to claim 16, wherein the determining further comprises decreasing the accumulated value in response to determining that a predetermined change has occurred in the operation target appearing in the moving image. ### Claim 18 (depends on 16) The non-transitory computer readable medium according to claim 16, wherein the determining further comprises decreasing the accumulated value in response to determining that rewriting or erasure has occurred in the operation target appearing in the moving image. ### Claim 19 (depends on 15) The non-transitory computer readable medium according to claim 15, wherein the method further comprises calculating, for each region of the operation target appearing in the moving image, the accumulated value of the time in which the operation position remains. ### Claim 20 (depends on 19) The non-transitory computer readable medium according to claim 19, wherein the accumulated value of the time in which the operation position remains is calculated by adding each time period in which the operation position occurs in the moving image.