# US 10,121,249 B2 · Enhanced visualization of areas of interest in image data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,249 B2 - Document ID: US10121249B2 - Status: Granted - Kind: B2 - Application number: 15/339,604 - Filed: 2016-10-31 - Published: 2017-10-05 - Granted: 2018-11-06 - Earliest claimed: 2016-04-01 - Assignees: Baja Education, Inc. - Applicants: Baja Education, Inc. - Inventors: Robert Pozos; Jose Agraz; Alicia Leon; Brent Baccetti - Web page: https://patentgrep.com/patent/US10121249B2 ## CPC - G10H 1/0066: {using a MIDI interface} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06T 7/73: using feature-based methods - G06T 11/26: Drawing of charts or graphs - G06T 11/60: Creating or editing images; Combining images with text - G10H 1/0008: {Associated control or indicating means} - G10H 1/38: Chord - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/20072: Graph-based image processing - G10H 2210/391: Automatic tempo adjustment, correction or control - G10H 2220/005: Non-interactive screen display of musical or status data - G10H 2220/126: for graphical editing of individual notes, parts or phrases represented as variable length segments on a 2D or 3D representation, e.g. graphical edition of musical collage, remix files or pianoroll representations of MIDI-like files - G10H 2220/441: Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes - G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method for generating visual enhancement of areas of interest in images includes receiving data representing a plurality of images in a sequence of images; analyzing the plurality images to identify respective three dimensional (3D) locations of one or more areas of interest in the plurality of images; visually enhancing the one or more of the identified areas of interest in the plurality of the images in the sequence of images; and communicating the visually enhanced image data to a display device to be displayed. ## Claims ### Claim 1 A system for generating visual enhancement of one or more areas of interest in a plurality of images of a sequence of images, the system comprising: an image area of interest unit configured to receive area of interest data identifying an area of interest and a three dimensional (3D) location in one of the plurality of images; an image analysis unit configured to analyze the plurality of images to identify respective 3D locations of the one or more areas of interest in other ones of the plurality of images different than the one of the plurality of images, wherein the image analysis unit is configured to identify Z coordinates of the respective 3D locations of the identified area of interest in the other ones of the plurality of images by identifying changes in the size of the one or more areas of interest moving in a direction perpendicular to the plurality of images; and an image enhancement unit configured to visually enhance the one or more of the identified areas of interest of the plurality of the images in the sequence of images. ### Claim 2 (depends on 1) The system of claim 1, wherein the sequence of images is video and the plurality of images includes frames of the video. ### Claim 3 (depends on 1) The system of claim 1, wherein the image area of interest unit receives the area of interest data from an input device configured to enable identification of the area of interest by drawing a shape around the area of interest. ### Claim 4 (depends on 1) The system of claim 1, wherein the image enhancement unit visually enhances the one or more of the identified areas of interest by performing at least one of masking, highlighting, magnifying, tracing or motion tracking. ### Claim 5 (depends on 1) The system of claim 1, wherein the image analysis unit is configured to identify X and Y coordinates of the respective 3D locations of the one or more of the areas of interest in the other ones of the plurality of images by measuring pixel distances from left and top sides, respectively, of each image of the sequence of images. ### Claim 6 (depends on 1) The system of claim 1, wherein the sequence of images depicts a 3D graph comprising one or more traces, wherein the areas of interest comprise different portions of the one or more traces, and wherein the image enhancement unit visually enhances the one or more of the identified areas of interest by highlighting the different portions of the one or more traces. ### Claim 7 A method of generating visual enhancement of one or more areas of interest in a plurality of images of a sequence of images, the method comprising: receiving area of interest data identifying an area of interest and a three dimensional (3D) location in one of the plurality of images; analyzing the plurality of images to identify respective 3D locations of the one or more areas of interest in other ones of the plurality of images different than the one of the plurality of images; visually enhancing the one or more of the identified areas of interest of the plurality of the images in the sequence of images; and identifying Z coordinates of the respective 3D locations of the identified area of interest in the other ones of the plurality of images by identifying changes in the size of the one or more areas of interest moving in a direction perpendicular to the plurality of images. ### Claim 8 (depends on 7) The method of claim 7, wherein the sequence of images is video and the plurality of images includes frames of the video. ### Claim 9 (depends on 7) The method of claim 7, wherein the area of interest is identified with an input device by drawing a shape around the area of interest. ### Claim 10 (depends on 7) The method of claim 7, wherein the one or more of the identified areas of interest is visually enhanced by performing at least one of masking, highlighting, magnifying, tracing or motion tracking. ### Claim 11 (depends on 7) The method of claim 7, further comprising identifying X and Y coordinates of the respective 3D locations of the one or more of the areas of interest in the other ones of the plurality of images by measuring pixel distances from left and top sides, respectively, of each image of the sequence of images. ### Claim 12 (depends on 7) The method of claim 7, wherein the sequence of images depicts a 3D graph comprising one or more traces, wherein the areas of interest comprise different portions of the one or more traces, and the method further comprising visually enhancing the one or more of the identified areas of interest by highlighting the different portions of the one or more traces. ### Claim 13 A non-transitory computer readable medium storing a computer program to generate visual enhancement of one or more areas of interest in a plurality of images of a sequence of images, the computer program comprising executable instructions that cause a computer to: receive area of interest data identifying an area of interest and a three dimensional (3D) location in one of the plurality of images; analyze the plurality of images to identify respective 3D locations of the one or more areas of interest in other ones of the plurality of images different than the one of the plurality of images; visually enhance the one or more of the identified areas of interest of the plurality of the images in the sequence of images; and identify Z coordinates of the respective 3D locations of the identified area of interest in the other ones of the plurality of images by identifying changes in the size of the one or more areas of interest moving in a direction perpendicular to the plurality of images. ### Claim 14 (depends on 13) The non-transitory computer readable medium of claim 13, wherein the sequence of images is video and the plurality of images includes frames of the video. ### Claim 15 (depends on 13) The non-transitory computer readable medium of claim 13, further comprising executable instructions that cause the computer to identify X and Y coordinates of the respective 3D locations of the one or more of the area of interest in the other ones of the plurality of images by measuring pixel distances from left and top sides, respectively, of each image of the sequence of images. ### Claim 16 (depends on 13) The non-transitory computer readable medium of claim 13, wherein the one or more of the identified areas of interest is visually enhanced by performing at least one of masking, highlighting, magnifying, tracing or motion tracking. ### Claim 17 (depends on 13) The non-transitory computer readable medium of claim 13, wherein the sequence of images depicts a 3D graph comprising one or more traces, wherein the areas of interest comprise different portions of the one or more traces, and further comprising executable instructions that cause the computer to visually enhance the one or more of the identified areas of interest by highlighting the different portions of the one or more traces.