# US 10,310,657 B2 · Playback method, apparatus and system related to touch information timing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,310,657 B2
- Document ID: US10310657B2
- Status: Granted
- Kind: B2
- Application number: 14/791,737
- Filed: 2015-07-06
- Published: 2015-12-31
- Granted: 2019-06-04
- Earliest claimed: 2014-06-25
- Assignees: Egalax_Empia Technology Inc.
- Applicants: Egalax_Empia Technology Inc.
- Inventors: Po-Chuan Lin; Shun-Lung Ho
- Web page: https://patentgrep.com/patent/US10310657B2

## CPC

- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 2203/04106: Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
- G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present invention provides a recording method of touch information timing. The method comprises receiving a first touch point information, determining whether the first touch point is the beginning point of a trace; and recording a first timing with respect to the receiving of the first touch point information if the first touch point is the beginning point of the trace.

## Claims

### Claim 1

A playback method related to touch information timing, said playback method comprising:
reading a data table including at least one timing and a visual object related to said at least one timing, wherein said data table is stored in an integrated multi-media file or in an independent relation file;
playing an audio information;
displaying a visual information, wherein when the visual information is displayed, said data table is restored from said integrated multi-media file or said independent relation file; and
highlighting said visual object related to said at least one timing in said visual information when said audio information is played to a playing timing related to said at least one timing.

### Claim 2 (depends on 1)

The playback method according to claim 1, wherein said at least one timing and said playing timing are in a range of time error.

### Claim 3 (depends on 1)

The playback method according to claim 1, wherein said playing timing is earlier than said at least one timing.

### Claim 4 (depends on 1)

The playback method according to claim 1, wherein said playing timing relates to a sub-information of said audio information.

### Claim 5 (depends on 1)

The playback method according to claim 1, wherein said visual object includes at least one displaying area.

### Claim 6 (depends on 1)

The playback method according to claim 1, wherein said visual object includes at least one trace.

### Claim 7

A playback method related to touch information timing, said playback method comprising:
reading a data table including at least one timing and at least one visual object related to said at least one timing, wherein said data table is stored in an integrated multi-media file or in an independent relation file;
displaying a visual information including said at least one visual object, wherein when the visual information is displayed, said data table is restored from said integrated multi-media file or said independent relation file; and
starting to play an audio information from a playing timing related to said at least one timing when said at least one visual object is selected.

### Claim 8 (depends on 7)

The playback method according to claim 7, further comprising:
highlighting said at least one visual object when said at least one visual object is selected.

### Claim 9 (depends on 7)

The playback method according to claim 7, wherein said at least one timing and said playing timing are in a range of time error.

### Claim 10 (depends on 7)

The playback method according to claim 7, wherein said playing timing is earlier than said at least one timing.

### Claim 11 (depends on 7)

The playback method according to claim 7, wherein said playing timing relates to a sub-information of said audio information.

### Claim 12 (depends on 7)

The playback method according to claim 7, wherein said visual object includes at least one displaying area.

### Claim 13 (depends on 7)

The playback method according to claim 7, wherein said visual object includes at least one trace.

### Claim 14 (depends on 7)

The playback method according to claim 7, further comprising:
displaying a plurality of timings when said visual object relating to said plurality of timings; and
starting to play said audio information from a playing timing related to one of said plurality of timings when said one of said plurality of timings is selected.

### Claim 15 (depends on 7)

The playback method according to claim 7, further comprising:
starting to play said audio information from a playing timing related to one earliest timing in a plurality of timings when said visual object relating to said plurality of timings.

### Claim 16

A playback apparatus related to touch information timing, said playback apparatus used to perform the steps comprising:
reading a data table from a memory module, wherein said data table includes at least one timing and a visual object related to said at least one timing, wherein said data table is stored in an integrated multi-media file or in an independent relation file;
making an audio playing module play an audio information; and
making a visual displaying module display a visual information, making said visual displaying module highlight said visual object related to said at least one timing in said visual information when said audio playing module playing said audio information to a playing timing related to said at least one timing, wherein when the visual information is displayed, said data table is restored from said integrated multi-media file or said independent relation file.

### Claim 17 (depends on 16)

The playback apparatus according to claim 16, wherein said at least one timing and said playing timing are in a range of time error.

### Claim 18 (depends on 16)

The playback apparatus according to claim 16, wherein said playing timing is earlier than said at least one timing.

### Claim 19 (depends on 16)

The playback apparatus according to claim 16, wherein said playing timing relates to a sub-information of said audio information.

### Claim 20 (depends on 16)

The playback apparatus according to claim 16, wherein said visual object includes at least one displaying area.

### Claim 21 (depends on 16)

The playback apparatus according to claim 16, wherein said visual object includes at least one trace.

### Claim 22

A playback system related to touch information timing, said playback system comprising:
a memory module storing a data table, wherein said data table includes at least one timing and a visual object related to said at least one timing, wherein said data table is stored in an integrated multi-media file or in an independent relation file;
an audio playing module;
a visual displaying module; and
a processing device, reading said data table from said memory module, making said audio playing module play an audio information, making said visual displaying module display a visual information, making said visual displaying module highlight said visual object related to said at least one timing in said visual information when said audio playing module playing said audio information to a playing timing related to said at least one timing, wherein when the visual information is displayed, said data table is restored from said integrated multi-media file or said independent relation file.

### Claim 23

A playback apparatus related to touch information timing, said playback apparatus used to perform the steps comprising:
reading a data table from a memory module, wherein said data table includes at least one timing and a visual object related to said at least one timing, wherein said data table is stored in an integrated multi-media file or in an independent relation file;
making a visual displaying module display a visual information including said at least one visual object, wherein when the visual information is displayed, said data table is restored from said integrated multi-media file or said independent relation file; and
making an audio playing module start to play an audio information from a playing timing related to said at least one timing when said at least one visual object is selected.

### Claim 24 (depends on 23)

The playback apparatus according to claim 23, further used to perform the step comprising:
making said visual displaying module highlight said at least one visual object when said at least one visual object is selected.

### Claim 25 (depends on 23)

The playback apparatus according to claim 23, wherein said at least one timing and said playing timing are in a range of time error.

### Claim 26 (depends on 23)

The playback apparatus according to claim 23, wherein said playing timing is earlier than said at least one timing.

### Claim 27 (depends on 23)

The playback apparatus according to claim 23, wherein said playing timing relates to a sub-information of said audio information.

### Claim 28 (depends on 23)

The playback apparatus according to claim 23, wherein said visual object includes at least one displaying area.

### Claim 29 (depends on 23)

The playback apparatus according to claim 23, wherein said visual object includes at least one trace.

### Claim 30 (depends on 23)

The playback apparatus according to claim 23, further used to perform the steps comprising:
making said visual displaying module display a plurality of timings when said visual object relating to said plurality of timings; and
making said audio playing module start to play said audio information from a playing timing related to one of said plurality of timings when said one of said plurality of timings is selected.

### Claim 31 (depends on 23)

The playback apparatus according to claim 23, further used to perform the step comprising:
making said audio playing module start to play said audio information from a playing timing related to one earliest timing in a plurality of timings when said visual object relating to said plurality of timings.

### Claim 32

A playback system related to touch information timing, said playback system comprising:
a memory module storing a data table, wherein said data table includes at least one timing and a visual object related to said at least one timing, wherein said data table is stored in an integrated multi-media file or in an independent relation file;
an audio playing module;
a visual displaying module; and
a processing device, reading said data table from said memory module, making said visual displaying module display a visual information including said at least one visual object, making an audio playing module start to play an audio information from a playing timing related to said at least one timing when said at least one visual object is selected, wherein when the visual information is displayed, said data table is restored from said integrated multi-media file or said independent relation file.