# US 2014/0278354 A1 · Identifying corresponding positions in different representations of a textual work

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0278354 A1
- Document ID: US20140278354A1
- Status: Published application
- Kind: A1
- Application number: 13/799,876
- Filed: 2013-03-13
- Published: 2014-09-18
- Earliest claimed: 2013-03-13
- Assignees: Nuance Communications, Inc.
- Applicants: Nuance Communications, Inc.
- Inventors: William F. Ganong, III
- Web page: https://patentgrep.com/patent/US20140278354A1

## CPC

- G10L 25/87: Detection of discrete points within a voice signal
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G09G 2380/14: Electronic books and readers
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Described herein are techniques for determining corresponding positions between different representations of a textual work. In some of the techniques, portions of one or more representations may be processed. A determination of a corresponding position may be made in response to a request received from a user, such as a reader that desires to switch between representations. The request may indicate a position in one representation and the representation to which the user would like to switch. In response to receiving the request, one or more portions of one or more representations of a textual work may be processed. In some techniques, a corresponding position between different representations may be determined without processing the entirety of one or more representations of the textual work. For example, a corresponding position may be determined without processing an entire audio representation.

## Claims

### Claim 1

A method for use in identifying a target audio position, in an audio representation of a textual work, that corresponds to a first text position in an electronic representation of the textual work, the method comprising:
estimating a first estimated audio position in the audio representation based at least in part on the first text position in the electronic representation of the textual work;
performing automatic speech recognition (ASR) on a first audio segment appearing in the audio representation at the first estimated audio position to generate a first textual representation of the first audio segment;
identifying at least one second text position in the electronic representation of the textual work by searching the electronic representation of the textual work for text that matches the first textual representation; and
in response to determining that the at least one second text position does not comprise the first text position, estimating a second estimated position in the audio representation based at least in part on the at least one second text position.

### Claim 2 (depends on 1)

The method of claim 1, wherein the estimating the first estimated position in the audio representation comprises:
determining a first relative position for the first text position in the electronic representation, the first relative position indicating the first text position relative to an entirety of the electronic representation; and
determining the first estimated audio position based on the first relative position.

### Claim 3 (depends on 2)

The method of claim 2, wherein the estimating the second estimated audio position in the audio representation comprises:
determining a second relative position for a second text position of the at least one second text position; and
setting the second estimated audio position based at least in part on a difference between the first relative position and the second relative position.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
refining the second estimated position at least in part by:
selecting a refined estimated position,
determining a new text position in the electronic representation that corresponds to the refined estimated position, and
in response to determining that the new text position does not match the first text position, selecting a next refined estimated position based at least in part on a difference between a first relative position of the first text position and a second relative position of the new text position; and
repeating the refining until the new text position in the electronic representation matches the first text position.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining whether the at least one second text position comprises the first text position comprises determining whether a difference between a second text position of the at least one second text position and the first text position is below a threshold.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining the first text position at least in part by identifying a portion of the electronic representation presented to a user and setting the first text position to a position appearing in the portion.

### Claim 7 (depends on 6)

The method of claim 6, wherein the setting the first text position comprises setting the first text position to a position having a predetermined relative position.

### Claim 8 (depends on 1)

The method of claim 1, wherein the searching the electronic representation of the textual work for text that matches the first textual representation comprises searching the electronic representation of the textual work for text exactly matching the first textual representation.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the textual work is a novel;
the electronic representation is an electronic book; and
the audio representation is an audio book.

### Claim 10

At least one computer-readable storage medium having encoded thereon computer-executable instructions that, when executed by at least one computer, cause the at least one computer to carry out a method of identifying a text position in an electronic version of a textual work that corresponds to a first audio position in an audio representation of the textual work, the method comprising:
performing automatic speech recognition (ASR) on a first audio segment appearing in the audio representation at the first audio position to generate a first textual representation of the first audio segment; and
identifying the text position by searching the electronic version of the textual work for text that matches the first textual representation.

### Claim 11 (depends on 10)

The at least one computer-readable storage medium of claim 10, wherein the searching the electronic representation of the textual work for text matching the first textual representation comprises searching the electronic representation of the textual work for text exactly matching the first textual representation.

### Claim 12 (depends on 10)

The at least one computer-readable storage medium of claim 10, wherein the searching the electronic representation of the textual work for text matching the first textual representation comprises searching the electronic representation of the textual work for text having an edit distance, when compared to the first textual representation, below a threshold.

### Claim 13 (depends on 10)

The at least one computer-readable storage medium of claim 10, wherein the method further comprises:
determining whether a mapping of corresponding positions between the audio representation and the electronic representation includes an entry that includes a position matching the first audio position or the text position,
wherein the performing ASR on the first audio segment is performed in response to determining that the mapping does not include an entry that includes a position matching the first audio position or matching the text position.

### Claim 14 (depends on 10)

The at least one computer-readable storage medium of claim 10, further comprising, prior to the performing ASR and the identifying:
identifying at least one word and/or at least one phrase included in the electronic representation of the textual work that is not included in a set of words and/or phrases used by an ASR engine that performs the ASR; and
adding the at least one word and/or the at least one phrase to the set for use by the ASR engine in the performing ASR on one or more segments of the audio representation.

### Claim 15 (depends on 10)

The at least one computer-readable storage medium of claim 10, wherein the performing ASR on the first audio segment is performed in response to receiving a request for the first text position corresponding to the first audio position, the request identifying the first audio position.

### Claim 16

An apparatus comprising:
at least one processor; and
at least one computer-readable storage medium having encoded thereon executable instructions that, when executed by the at least one processor, cause the at least one processor to carry out a method of identifying a digital position in a digital representation of a textual work that corresponds to a hardcopy location in a hardcopy representation of at least a portion of the textual work, the method comprising:
performing a character recognition process on at least a portion of the hardcopy representation to generate a recognized textual representation; and
searching the digital representation for text matching at least some of the recognized textual representation to identify the digital position in the digital representation.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the method further comprises:
receiving an image of at least the portion of the hardcopy representation, the image comprising image data representing the at least the portion of the hardcopy representation.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein:
the receiving the image comprises receiving the image from a device that generated the image, the device including a camera; and
the method further comprises transmitting, to the device, an indication of the digital position.

### Claim 19 (depends on 16)

The apparatus of claim 16, wherein the searching the digital representation for text matching at least some of the textual representation comprises searching an electronic textual representation for text exactly matching the at least some of the textual representation.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein:
the digital position in the digital representation is an audio position in an audio representation;
the searching the digital representation for text matching the at least some of the recognized textual representation comprises:
determining a text position at which text matching the at least some of the recognized textual representation appears in the electronic textual representation; and
determining an audio position in the audio representation corresponding to the text position at which the text appears.
