# US 12,217,520 B1 · Apparatus and method for detecting content of interest on a slide using machine learning > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,520 B1 - Document ID: US12217520B1 - Status: Granted - Kind: B1 - Application number: 18/736,818 - Filed: 2024-06-07 - Granted: 2025-02-04 - Earliest claimed: 2024-06-07 - Assignees: Pramana, Inc. - Applicants: Pramana, Inc. - Inventors: Parveen Shaik Gangirevula; Prasanth Perugupalli; Raghubansh Bahadur Gupta; Sai Pranav Varada Raghunath; Venkata Veera Lokesh Kumar Puvvada; Manish Shiralkar - Web page: https://patentgrep.com/patent/US12217520B1 ## CPC - G06V 20/693: {Acquisition} - G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)} - G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI] - G06V 10/82: using neural networks - G06V 20/698: {Matching; Classification} - G06V 2201/03: Recognition of patterns in medical or anatomical images - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract An apparatus and method for detecting content of interest on a slide using machine learning. The apparatus includes at least a processor and a memory communicatively connected to the at least a processor. The memory instructs the processor to receive a first image, comprising a macro image, identify areas of interest associated with the grids of the first image, receive a second image comprising a high magnification image associated with the areas of interest of the first image, classify, using at least a probed point, the grids of the first image, wherein classifying the grids of the first image includes classifying the grids into accepted grids of the grids and rejected grids of the grids, scan, using the image capturing device, the accepted grids to generate an output image, and display, using a display device, the output image. ## Claims ### Claim 1 An apparatus for detecting content of interest on a slide, wherein the apparatus comprises: an image capturing device, wherein the image capturing device is configured to capture at least an image of a received slide; at least a computing device, wherein the computing device comprises: a memory; and at least a processor communicatively connected to the memory, wherein the memory contains instructions configuring the at least a processor to: receive a first image of the at least an image from the image capturing device, wherein the first image comprises a macro image; identify one or more areas of interest associated with one or more grids of the first image; receive a second image of the at least an image from the image capturing device, wherein the second image comprises a high magnification image associated with the one or more areas of interest of the first image, classify, using at least a probed point, the one or more grids of the first image, wherein classifying the one or more grids of the first image comprises classifying the one or more grids into accepted grids of the one or more grids and rejected grids of the one or more grids; scan, using the image capturing device, the accepted grids to generate an output image; display, using a display device, the output image; and a grid extension model configured to scan the one or more grids of an area of interest, wherein scanning the one or more grids comprises: identifying a border row and a border column of the one or more grids; and conditionally extending the grid row and the grid column of the area of interest as a function of whether the border row and the border column comprises content of interest. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the image capturing device is further configured to capture, using a macro imaging setup, the macro image of the at least an image of the received slide and capture, using a high magnification imaging setup, the high magnification image of the at least an image of the received slide. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the memory contains instructions further configuring the at least a processor to utilize a classifier model, wherein the classifier model is configured to classify, using the at least a probe point from the macro image and the high magnification image, a content of interest of the one or more areas of interest into the accepted grids or the rejected grids. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the apparatus comprises a machine learning model, wherein the machine learning model is trained using a training set comprising labeled high magnification images. ### Claim 5 (depends on 4) The apparatus of claim 4, wherein the machine learning model comprises a neural network. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the apparatus comprises a Z-plane extrapolation model, wherein the Z-plane extrapolation model is configured to scan the accepted grids, wherein scanning the accepted grids comprises: scanning, using a predetermined sequence, each grid of the accepted grids; estimating a first grid Z-plane of a first grid; extrapolating, using the first grid Z-plane, a second-grid Z-plane of a second grid; computing, using the first grid Z-plane and the second grid Z-plane, a Z-plane differential; and re-classifying, using the Z-plane differential, the second grid as the accepted grids or the rejected grids using a predefined Z-plane differential threshold. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the memory contains instructions further configuring the at least a processor to conditionally re-scan the accepted grids if the content of interest is detected in the border column or the border row. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the output image comprises a whole slide image, wherein the whole slide image comprises one or more content of interest. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the one or more content of interest of output image comprises a complete visual of the content of interest. ### Claim 10 A method for detecting content of interest on a slide, wherein the method comprises: receiving, by at least a processor, a first image from an image capturing device, wherein the first image comprises a macro image; identifying, by the at least a processor, one or more areas of interest associated with one or more grids of the first image; receiving, by the at least a processor, a second image of the at least an image from the image capturing device, wherein the second image comprises a high magnification image associated with the one or more areas of interest of the first image, classifying, by the at least a processor, using at least a probed point, the one or more grids of the first image, wherein classifying the one or more grids of the first image comprises classifying the one or more grids into accepted grids of the one or more grids and rejected grids of the one or more grids; scanning, using a grid extension model, the one or more grids of an area of interest, wherein scanning the one or more grids comprises: identifying a border row and a border column of the one or more grids; and conditionally extending the grid row and the grid column of the area of interest as a function of whether the border row and the border column comprises content of interest; scanning, using the image capturing device, the accepted grids to generate an output image; and displaying, using a display device, the output image. ### Claim 11 (depends on 10) The method of claim 10, further comprising: capturing, using a macro imaging setup of the image capturing device, the macro image of the at least an image of the received slide; and capturing, using a high magnification imaging setup of the image capturing device, the high magnification image of the at least an image of the received slide. ### Claim 12 (depends on 10) The method of claim 10, further comprising utilizing, by the at least a processor, a classifier model, wherein the classifier model is configured to classify, using the at least a probe point from the macro image and the high magnification image, a content of interest of the one or more areas of interest into the accepted grids or the rejected grids. ### Claim 13 (depends on 10) The method of claim 10, further comprising training, using the at least a processor, a machine learning model, wherein the machine learning model is trained using a training set comprising labeled high magnification images. ### Claim 14 (depends on 13) The method of claim 13, wherein the machine learning model comprises a neural network. ### Claim 15 (depends on 10) The method of claim 10, further comprising scanning the accepted grids, wherein scanning the accepted grids comprises: scanning, using a predetermined sequence, each grid of the accepted grids; estimating a first grid Z-plane of a first grid; extrapolating, using the first grid Z-plane, a second-grid Z-plane of a second grid; computing, using the first grid Z-plane and the second grid Z-plane, a Z-plane differential; and re-classifying, using the Z-plane differential, the second grid as the accepted grids or the rejected grids using a predefined Z-plane differential threshold. ### Claim 16 (depends on 10) The method of claim 10, further comprising conditionally re-scanning the accepted grids if the content of interest is detected in the border column or the border row. ### Claim 17 (depends on 10) The method of claim 10, wherein the output image comprises a whole slide image, wherein the whole slide image comprises one or more content of interest. ### Claim 18 (depends on 17) The method of claim 17, wherein the one or more content of interest of output image comprises a complete visual of the content of interest.