# US 10,504,162 B2 · Processing techniques for text capture from a rendered document

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,504,162 B2
- Document ID: US10504162B2
- Status: Granted
- Kind: B2
- Application number: 15/594,932
- Filed: 2017-05-15
- Published: 2017-08-31
- Granted: 2019-12-10
- Earliest claimed: 2004-05-17
- Assignees: Google Inc.
- Applicants: Google LLC; Cheryl Grunbock
- Inventors: Martin T. King; Dale L. Grover; Clifford A. Kushler; James Q. Stafford-Fraser
- Web page: https://patentgrep.com/patent/US10504162B2

## CPC

- G06Q 30/06: Buying, selling or leasing transactions
- G06K 7/1404: {Methods for optical code recognition}
- G06Q 10/40: Business processes related to social networking or social networking services
- G06Q 30/0222: {During e-commerce, i.e. online transactions}
- G06Q 30/0255: {based on user history}
- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G06V 30/1456: {based on user interactions}
- G06V 30/224: of printed characters having additional code marks or containing code marks
- G06V 30/2247: {Characters composed of bars, e.g. CMC-7}
- G06V 30/32: Digital ink
- G06V 30/413: Classification of content, e.g. text, photographs or tables
- G06V 30/418: Document matching, e.g. of document images
- G08G 1/0175: {by photographing vehicles, e.g. when violating traffic rules}
- H04N 1/00331: {with an apparatus performing optical character recognition (character recognition G06V30/10)}
- G06V 20/625: {License plates}
- G06V 30/10: Character recognition
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A facility for initiating a purchase is described. The facility receives a text sequence captured by a user from a rendered document using a handheld text capture device. The facility identifies in the received text sequence a reference to a distinguished product. In response to identifying the reference, the facility presents to the user an opportunity to place an order for the established product. If the user accepts the presented opportunity to order the distinct product, the facility orders the distinct product on behalf of the user.

## Claims

### Claim 1

A method implemented by data processing apparatus, the method comprising:
receiving, by a server system, from a wireless device including a camera, an image of text captured by the camera from a rendered document;
performing, by the server system, an optical character recognition process on the image of text, and generating, by the optical character recognition process, a corresponding representation of the text;
determining, by the server system, that the representation of the text generated by the optical character recognition process is insufficient for recognition of the rendered document; and
providing, by the server system and for receipt by the wireless device, an indication that a more expansive or different image of text is required for recognition of the rendered document.

### Claim 2 (depends on 1)

The method of claim 1, wherein the wireless device includes a display, and wherein the method further comprises:
presenting, on the display, the image of the text to be captured by the camera.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
presenting, on the display, information about the quality of the image and its suitability for recognition.

### Claim 4 (depends on 2)

The method of claim 2, further comprising:
in response to the wireless device receiving the indication, presenting, on the display, a visual indication that the more expansive or different image of text is required for recognition of the rendered document.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving, by the server system, from the wireless device including the camera, a subsequent image of text captured by the camera from the rendered document;
performing, by the server system, the optical character recognition process on the subsequent image of text, and generating, by the optical character recognition process, a corresponding subsequent representation of the text;
determining, by the server system, that the subsequent representation of the text generated by the optical character recognition process is sufficient for recognition of the rendered document; and
providing, by the server system and for receipt by the wireless device, a subsequent indication that the subsequent representation of the text is sufficient for recognition of the rendered document.

### Claim 6 (depends on 5)

The method of claim 5, wherein the wireless device includes a display, and wherein the method further comprises:
in response to the wireless device receiving the subsequent indication, presenting, on the display, a subsequent visual indication that the subsequent representation of the text is sufficient for recognition of the rendered document.

### Claim 7 (depends on 5)

The method of claim 5, further comprising:
based on the subsequent representation of the text, retrieving, by the server system, a digital document that matches the rendered document; and
providing, by the server system and for receipt by the wireless device, the digital document that matches the rendered document.

### Claim 8 (depends on 7)

The method of claim 7, wherein the wireless device includes a display, and wherein the method further comprises:
in response to the wireless device receiving the digital document that matches the rendered document, presenting, on the display, a visual notification that the digital document has been received.

### Claim 9 (depends on 7)

The method of claim 7, wherein the wireless device includes a display, and wherein the method further comprises:
after the wireless device is provided with the digital document that matches the rendered document, presenting the digital document on the display.

### Claim 10

A system comprising:
one or more computing devices; and
one or more memory storage apparatus in data communication with the one or more computing devices and storing instructions executable by the one or more computing devices and that upon such execution cause the one or more computing devices to perform operations comprising:
receiving, by a server system, from a wireless device including a camera, an image of text captured by the camera from a rendered document;
performing, by the server system, an optical character recognition process on the image of text, and generating, by the optical character recognition process, a corresponding representation of the text;
determining, by the server system, that the representation of the text generated by the optical character recognition process is insufficient for recognition of the rendered document; and
providing, by the server system and for receipt by the wireless device, an indication that a more expansive or different image of text is required for recognition of the rendered document.

### Claim 11 (depends on 10)

The system of claim 10, wherein the operations further comprise:
receiving, by the server system, from the wireless device including the camera, a subsequent image of text captured by the camera from the rendered document;
performing, by the server system, the optical character recognition process on the subsequent image of text, and generating, by the optical character recognition process, a corresponding subsequent representation of the text;
determining, by the server system, that the subsequent representation of the text generated by the optical character recognition process is sufficient for recognition of the rendered document; and
providing, by the server system and for receipt by the wireless device, a subsequent indication that the subsequent representation of the text is sufficient for recognition of the rendered document.

### Claim 12 (depends on 11)

The system of claim 11, wherein the wireless device includes a display, and wherein the operations further comprise:
in response to the wireless device receiving the subsequent indication, presenting, on the display, a subsequent visual indication that the subsequent representation of the text is sufficient for recognition of the rendered document.

### Claim 13 (depends on 11)

The system of claim 11, wherein the operations further comprise:
based on the subsequent representation of the text, retrieving, by the server system, a digital document that matches the rendered document; and
providing, by the server system and for receipt by the wireless device, the digital document that matches the rendered document.

### Claim 14 (depends on 13)

The system of claim 13, wherein the wireless device includes a display, and wherein the operations further comprise:
in response to the wireless device receiving the digital document that matches the rendered document, presenting, on the display, a visual notification that the digital document has been received.

### Claim 15 (depends on 13)

The system of claim 13, wherein the wireless device includes a display, and wherein the operations further comprise:
after the wireless device is provided with the digital document that matches the rendered document, presenting the digital document on the display.

### Claim 16

A non-transitory computer readable medium storing instructions executable by one or more computing devices and that upon such execution cause the one or more computing devices to perform operations comprising:
receiving, by a server system, from a wireless device including a camera, an image of text captured by the camera from a rendered document;
performing, by the server system, an optical character recognition process on the image of text, and generating, by the optical character recognition process, a corresponding representation of the text;
determining, by the server system, that the representation of the text generated by the optical character recognition process is insufficient for recognition of the rendered document; and
providing, by the server system and for receipt by the wireless device, an indication that a more expansive or different image of text is required for recognition of the rendered document.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein the operations further comprise:
receiving, by the server system, from the wireless device including the camera, a subsequent image of text captured by the camera from the rendered document;
performing, by the server system, the optical character recognition process on the subsequent image of text, and generating, by the optical character recognition process, a corresponding subsequent representation of the text;
determining, by the server system, that the subsequent representation of the text generated by the optical character recognition process is sufficient for recognition of the rendered document; and
providing, by the server system and for receipt by the wireless device, a subsequent indication that the subsequent representation of the text is sufficient for recognition of the rendered document.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the wireless device includes a display, and wherein the operations further comprise:
in response to the wireless device receiving the subsequent indication, presenting, on the display, a subsequent visual indication that the subsequent representation of the text is sufficient for recognition of the rendered document.

### Claim 19 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein the operations further comprise:
based on the subsequent representation of the text, retrieving, by the server system, a digital document that matches the rendered document; and
providing, by the server system and for receipt by the wireless device, the digital document that matches the rendered document.