# US 12,001,803 B2 · System and stroke data processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,803 B2
- Document ID: US12001803B2
- Status: Granted
- Kind: B2
- Application number: 17/529,955
- Filed: 2021-11-18
- Published: 2022-03-10
- Granted: 2024-06-04
- Earliest claimed: 2019-05-20
- Assignees: Wacom Co., Ltd.
- Applicants: Wacom Co., Ltd.
- Inventors: Markus Weber; Philipp Daniel Schongen; Joss Daniel Giffard-Burley; Avinav Khanal
- Web page: https://patentgrep.com/patent/US12001803B2

## CPC

- G06F 40/171: by use of digital ink
- G06F 40/30: Semantic analysis
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 1/1643: {the display being associated to a digitizer, e.g. laptops that can be used as penpads (details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615)}
- G06F 3/03545: {Pens or stylus}
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06V 30/1423: {the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32)}
- G06V 30/262: using context analysis, e.g. lexical, syntactic or semantic context
- G06V 30/32: Digital ink
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04M 1/27457: Management thereof, e.g. manual editing of data
- G10L 17/00: Speaker identification or verification techniques
- G10L 2015/223: {Execution procedure of a spoken command}
- H04M 2250/22: including a touch pad, a touch sensor or a touch detector
- H04M 2250/74: with voice recognition means
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A system and a method are provided to facilitate a search of information indicated by stroke data. A system includes a processor. The processor obtains stroke data generated in response to handwriting input and generates, by performing semantic analysis on the stroke data, semantic metadata including semantic data indicating semantics of the stroke data and purpose data determined based on the semantic data.

## Claims

### Claim 1

A system configured to allow storage and retrieval of handwriting input, comprising:
a processor,
a sensor configured to receive touch input; and
a non-transitory memory including instructions which, when executed by the processor, cause the processor to:
generate stroke data in response to handwriting input received via the sensor,
generate, by performing semantic analysis on the stroke data, semantic metadata including semantic data indicating semantics of the stroke data and purpose data determined based on the semantic data, wherein the purpose data indicates a use purpose of the stroke data,
store the stroke data, the semantic metadata, and a pen identification indicating an electronic pen used to generate the stroke data in association with each other, and
in response to a user prompt indicative of the pen identification, retrieve the stroke data and the semantic metadata corresponding to the pen identification.

### Claim 2 (depends on 1)

The system according to claim 1, further comprising:
a microphone,
wherein, by recognizing speech input through the microphone, the processor selects the stroke data or the semantic data associated with the purpose data corresponding to the recognized speech.

### Claim 3 (depends on 1)

The system according to claim 1, further comprising:
a microphone,
wherein, by recognizing speech input through the microphone, the processor selects the stroke data or the semantic data associated with the purpose data corresponding to the recognized speech, and
the system further includes a loudspeaker configured to output, by speech, the stroke data or the semantic data that has been selected.

### Claim 4 (depends on 1)

The system according to claim 1, comprising:
a microphone,
wherein the processor obtains, by recognizing speech input through the microphone, the pen identification assigned to the electronic pen of a speaker who has uttered the speech and selects the stroke data or the semantic data associated with the obtained pen identification, and
the system is configured to display the stroke data or the semantic data that has been selected.

### Claim 5 (depends on 4)

The system according to claim 4, wherein the processor obtains the pen identification assigned to the electronic pen of the speaker by obtaining the pen identification stored in association with a user identification of the speaker in a user table that stores a user name and the pen identification in association with each other.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the processor groups the stroke data and performs the semantic analysis on the grouped stroke data.

### Claim 7

A stroke data processing method comprising:
generating stroke data in response to handwriting input received via a sensor;
generating, by performing semantic analysis on the generated stroke data, semantic metadata including semantic data indicating semantics of the stroke data and purpose data determined based on the semantic data, wherein the purpose data indicates a use purpose of the ink file;
storing, in a non-transitory memory, the stroke data, the semantic metadata, and a pen identification indicating an electronic pen used to generate the stroke data in association with each other; and
in response to a user prompt indicative of the pen identification, retrieving the stroke data and the semantic metadata corresponding to the pen identification.

### Claim 8 (depends on 7)

The stroke data processing method according to claim 7, further comprising:
recognizing speech input through a microphone; and
displaying the stroke data or the semantic data associated with the purpose data corresponding to the recognized speech on a display.

### Claim 9 (depends on 7)

The stroke data processing method according to claim 7, further comprising:
recognizing speech input through a microphone; and
outputting, by speech, the stroke data or the semantic data associated with the purpose data corresponding to the recognized speech from a loudspeaker.

### Claim 10 (depends on 7)

The stroke data processing method according to claim 7, further comprising:
by recognizing speech input through a microphone, obtaining the pen identification assigned to the electronic pen of a speaker who has uttered the speech; and
displaying the stroke data or the semantic data associated with the obtained pen identification on a display.

### Claim 11 (depends on 10)

The stroke data processing method according to claim 10, further comprising:
obtaining the pen identification assigned to the electronic pen of the speaker by obtaining the pen identification stored in association with a user identification of the speaker in a user table that stores a user name and the pen identification in association with each other.

### Claim 12 (depends on 7)

The stroke data processing method according to claim 7, further comprising:
performing the semantic analysis on the stroke data that has been grouped.