# US 2015/0146982 A1 · Methods and apparatus relating to text items in images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146982 A1
- Document ID: US20150146982A1
- Status: Published application
- Kind: A1
- Application number: 14/091,195
- Filed: 2013-11-26
- Published: 2015-05-28
- Earliest claimed: 2013-11-26
- Assignees: BlackBerry Limited
- Applicants: Blackberry Limited
- Inventors: Wade TSAI; David Michael SUTTON; Jean-Francois DESGAGNES; Ryan William JOSAL
- Web page: https://patentgrep.com/patent/US20150146982A1

## CPC

- G06V 30/1456: {based on user interactions}
- G06V 30/148: Segmentation of character regions
- G06V 30/153: {using recognition of characters or words}
- G06V 30/10: Character recognition
- H04M 1/2755: by optical scanning
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A method and an electronic device are provided for obtaining an image or a video frame, including applying to the image or the video frame, at least one image processing technique, scanning the image or the video frame, to identify a text item, determining an item type for the identified text item, and determining an action, corresponding to the item type.

## Claims

### Claim 1

A method performed by an electronic device, comprising:
obtaining an image;
applying to the image at least one image processing technique;
scanning the image to identify a text item;
determining an item type for the identified text item; and
determining an action, corresponding to the item type,

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
displaying a user interface element, corresponding to the action;
receiving a selection of the user interface element; and
performing the action.

### Claim 3 (depends on 1)

The method of claim 1, wherein the at least one image processing technique comprises:
boosting contrast in the image, to bring out potential text items; and
drawing rectangles around the potential text items.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one image processing technique comprises:
performing thresholding on the image, to bring out potential text items; and
drawing rectangles around the potential text items.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
determining boundaries for each of the rectangles; and
combining overlapping rectangles, to form larger rectangles.

### Claim 6 (depends on 3)

The method of claim 3, wherein the scanning of the image, comprises scanning the rectangles for any text items.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
assigning a confidence score to each scan; and
discarding any scans with a low confidence score.

### Claim 8 (depends on 7)

The method of claim 7, further comprising correcting any misspellings in the text items.

### Claim 9 (depends on 7)

The method of claim 7, further comprising discarding any text items that do not meet at least one predetermined criterion.

### Claim 10 (depends on 1)

The method of claim 1, wherein the image is obtained from a frame of a video.

### Claim 11

An electronic device to perform an action based on scanned text, comprising:
a display; and
a processor configured to:
obtain an image;
apply to the image at least one image processing technique;
scan the image to identify a text item;
determine an item type for the identified text item; and
determine an action, corresponding to the item type,

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein the processor is further configured to:
display a user interface element, corresponding to the action;
receive a selection of the user interface element; and
perform the action.

### Claim 13 (depends on 11)

The electronic device of claim 11, wherein the at least one image processing technique comprises:
boosting contrast in the image, to bring out potential text items; and
drawing rectangles around the potential text items.

### Claim 14 (depends on 11)

The electronic device of claim 11, wherein the at least one image processing technique comprises:
performing thresholding on the image, to bring out potential text items; and
drawing rectangles around the potential text items.

### Claim 15 (depends on 13)

The electronic device of claim 13, wherein the processor is further configured to:
determine boundaries for each of the rectangles; and
combine overlapping rectangles, to form larger rectangles.

### Claim 16 (depends on 13)

The electronic device of claim 13, wherein the scanning of the image, comprises scanning the rectangles for any text items.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the processor is further configured to:
assign a confidence score to each scan; and
discard any scans with a low confidence score.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein the processor is further configured to correct any misspellings in the text items.

### Claim 19 (depends on 16)

The electronic device of claim 16, wherein the processor is further configured to discard any text items that do not meet at least one predetermined criterion.

### Claim 20 (depends on 11)

The electronic device of claim 11, wherein the image is obtained from a frame of a video.

### Claim 21

A computer readable storage medium comprising computer executable instructions to perform an action based on scanned text, comprising:
obtaining an image;
applying to the image at least one image processing technique;
scanning the image to identify a text item;
determining an item type for the identified text item; and
determining an action, corresponding to the item type.
