# US 10,871,930 B2 · Display method and display apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,871,930 B2
- Document ID: US10871930B2
- Status: Granted
- Kind: B2
- Application number: 16/083,738
- Filed: 2016-09-09
- Published: 2019-03-07
- Granted: 2020-12-22
- Earliest claimed: 2016-03-10
- Assignees: Shenzhen Skyworth-Rgb Electronic Co., Ltd.
- Applicants: Shenzhen Skyworth-Rgb Electronic Co., Ltd.
- Inventors: Ge Yan
- Web page: https://patentgrep.com/patent/US10871930B2

## CPC

- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 16/334: Query execution (filtering based on additional data G06F16/335)
- G06F 16/338: Presentation of query results
- G06F 16/433: {using audio data}
- G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Disclosed is a display method that includes: controlling a recording device to perform a real-time recording operation on a current environment when a preset type of display data is displayed on a first display interface; and performing character recognition on audio information obtained by the recording operation to obtain text information, and displaying the obtained text information on a second display interface. Further disclosed is a display apparatus.

## Claims

### Claim 1

A display method, comprising:
controlling a recording device to perform a real-time recording operation on a current environment when a preset type of display data is displayed on a first display interface, wherein the preset type of display data is a PowerPoint (PPT) file; performing character recognition on audio information obtained by the recording operation, to convert the audio information into text information;
obtaining headings of the PPT file;
searching in the text information for text that matches each of the headings of the PPT file to obtain matched texts; and
respectively displaying each of the obtained matched texts in a display area corresponding to each of the
headings of the PPT file on the first display interface, and displaying remaining texts other than the obtained matched texts in the text information on a second display interface;
wherein subsequent to the operation of displaying the remaining texts other than the obtained matched texts in the text information on a second display interface, the display method further comprises:
displaying the text information on the first display interface when playback of the PPT file ends.

### Claim 2 (depends on 1)

The display method as recited in claim 1, wherein the operation of displaying remaining texts other than the obtained matched texts in the text information on a second display interface comprises:
calculating a number of occurrences of each word or sentence in the text information;
obtaining the word or sentence in the text information that occurs more than a preset number of times; and
displaying the obtained text information on the second display interface, and highlighting the word or sentence that occurs more than the preset number of times.

### Claim 3 (depends on 1)

The display method as recited in claim 1, further comprising:
when the preset type of display data is displayed on the first display interface, adjusting brightness of lighting equipment in the current environment to a preset brightness.

### Claim 4 (depends on 3)

The display method as recited in claim 3, wherein the operation of displaying remaining texts other than the obtained matched texts in the text information on a second display interface comprises:
calculating a number of occurrences of each word or sentence in the text information;
obtaining the word or sentence in the text information that occurs more than a preset number of times; and
displaying the obtained text information on the second display interface, and highlighting the word or sentence that occurs more than the preset number of times.

### Claim 5 (depends on 3)

The display method as recited in claim 3, wherein subsequent to the operation of displaying remaining texts other than the obtained matched texts in the text information on a second display interface, the display method further comprises:
displaying the text information on the first display interface when playback of the PPT file ends.

### Claim 6

A display apparatus, comprising one or more processors and a non-transitory program storage medium storing program code executable by the one or more processors, the program code comprising:
a recording module, configured to control a recording device to perform a real-time recording operation on a current environment when a preset type of display data is displayed on a first display interface, wherein the preset type of display data is a PowerPoint (PPT) file; and
a recognition module, configured to perform character recognition on audio information obtained by the recording operation, to convert the audio information into text information;
the recognition module comprising a second acquisition unit, a searching unit, and a second display unit, wherein:
the second acquisition unit is configured to obtain headings of the PPT file;
the searching unit is configured to search in the text information for text that matches each heading of the PPT file to obtain matched texts; and
the second display unit is configured to respectively display each of the obtained matched texts in a display area corresponding to each of the
headings of the PPT file on the first display interface, and displaying remaining texts other than the obtained matched texts in the text information on a second display interface;
wherein the recognition module further comprises:
a third display unit, configured to display the text information on the first display interface when playback of the PPT file ends.

### Claim 7 (depends on 6)

The display apparatus as recited in claim 6, wherein the recognition module comprises:
a calculation unit, configured to calculate a number of occurrences of each word or sentence in the text information;
a first acquisition unit, configured to obtain the word or sentence in the text information that occurs more than a preset number of times; and
a first display unit, configured to display the obtained text information on the second display interface, and highlight the word or sentence that occurs more than the preset number of times.

### Claim 8 (depends on 6)

The display apparatus as recited in claim 6, wherein the program code further comprises:
an adjustment module, configured to adjust brightness of lighting equipment in the current environment to a preset brightness when the preset type of display data is displayed on the first display interface.

### Claim 9 (depends on 8)

The display apparatus as recited in claim 8, wherein the recognition module comprises:
a calculation unit, configured to calculate a number of occurrences of each word or sentence in the text information;
a first acquisition unit, configured to obtain the word or sentence in the text information that occurs more than a preset number of times; and
a first display unit, configured to display the obtained text information on the second display interface, and highlight the word or sentence that occurs more than the preset number of times.