Text extraction from graphical user interface content
AssigneeInternational Business Machines Corporation
InventorsAmir Geva, Mattias Marder
Life of this patent
Estimating the term…
Abstract
Systems and methods for extracting text from images rendered on a display screen, the method comprising capturing a color image rendered on a display screen; and transforming the color image to binary color image, preserving text-like graphic components and filtering out non-text-like graphical components. The transforming comprises scanning one or more areas of the color image; and detecting continuous bi-tonal regions in the scanned one or more areas, wherein the continuous bi-tonal regions have large variances.
Claims8
A method for extracting text from images rendered on a display screen, the method comprising:
- capturing a color image rendered on a display screen;
- and
- transforming the color image to binary color image, preserving textual graphic components and filtering out non-textual graphical components, said transforming comprises:
- scanning one or more areas of the color image;
- detecting continuous regions in the scanned one or more areas, the continuous regions having two distinguishable shades, wherein a first shade represents the foreground and a second shade represents the background, and wherein the continuous regions comprise multiple components;
- representing a set having a component from the continuous regions;
- and
- extracting the component as text component, wherein the component is recognized based on switches between runs where a single color part of the run comprises a lower number of pixels than all other single color parts of the run.
A system for extracting text from images rendered on a display screen, the system comprising:
- a logic unit for capturing a color image rendered on a display screen;
- and
- a logic unit for transforming the color image to binary color image, preserving textual graphic components and filtering out non-textual graphical components, wherein the transforming comprises:
- scanning one or more areas of the color image;
- detecting continuous regions in the scanned one or more areas, the continuous regions having two distinguishable shades, wherein a first shade represents the foreground and a second shade represents the background, and wherein the continuous regions comprise multiple components;
- representing a set having a component from the one or more continuous regions;
- and
- extracting the component as text component, wherein the component is recognized based on switches between runs where a single color part of the run comprises a lower number of pixels than all other single color parts of the run.
A computer program product comprising a non-transitory computer readable storage medium having a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
- capture a color image rendered on a display screen;
- and
- transform the color image to binary color image, preserving textual graphic components and filtering out non-textual graphical components, wherein the transforming comprises:
- scanning one or more areas of the color image;
- detecting continuous regions in the scanned one or more areas, the continuous regions having two distinguishable shades, wherein a first shade represents the foreground and a second shade represents the background wherein the continuous regions comprise multiple components;
- representing a set having a component from the one or more continuous regions;
- and
- extracting the component as text component, wherein the component is recognized based on switches between runs where a single color part of the run comprises a lower number of pixels than all other single color parts of the run.
Dependencies are inferred from the claim text.