# US 12,118,203 B2 · Ink data generation apparatus, method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,203 B2
- Document ID: US12118203B2
- Status: Granted
- Kind: B2
- Application number: 18/358,775
- Filed: 2023-07-25
- Published: 2023-11-16
- Granted: 2024-10-15
- Earliest claimed: 2018-11-02
- Assignees: Wacom Co., Ltd.
- Applicants: Wacom Co., Ltd.
- Inventors: Markus Weber
- Web page: https://patentgrep.com/patent/US12118203B2

## CPC

- G06F 3/03545: {Pens or stylus}
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/583: using metadata automatically derived from the content
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 30/347: {Sampling; Contour coding; Stroke extraction}
- G06V 30/1423: {the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided are an ink data generation apparatus, an ink data generation method, and an ink data generation program that are capable of improving ease of handling ink data when or after metadata is generated. An ink data generation apparatus performs a determination as to an inclusion relation between a first set and a second set by comparing stroke elements of first set data and stroke elements of second set data using the first set data and the second set data. The ink data generation apparatus generates first metadata for the first set described in a form that varies in accordance with a result of the determination.

## Claims

### Claim 1

An ink data generation apparatus that generates ink data including metadata describing meta-information regarding each of sets of strokes, the ink data generation apparatus comprising:
a first acquisition circuit configured to acquire first set data representing stroke elements belonging to a first set, to which the meta-information has not been assigned yet;
an attribute estimation circuit configured to estimate a semantics attribute to be assigned to the first set, on a basis of mutual relations between positions or shapes of the stroke elements that form the first set;
a user interface circuit configured to be capable of displaying the stroke elements that form the first set and displaying a user control which enables input of a semantics attribute to be assigned to the first set; and
a data generation circuit configured to generate first metadata for the first set indicating the semantics attribute inputted by the user control or estimated by the attribute estimation circuit.

### Claim 2 (depends on 1)

The ink data generation apparatus according to claim 1, wherein the user interface circuit displays the semantic attribute estimated by the attribute estimation circuit as an initial value of the user control.

### Claim 3 (depends on 1)

The ink data generation apparatus according to claim 1, wherein the attribute estimation circuit is configured to include a discriminator that accepts input of feature amounts concerning edge points of the strokes and outputs a label value of the semantics attribute.

### Claim 4 (depends on 1)

The ink data generation apparatus according to claim 1, further comprising:
a second acquisition circuit configured to acquire second set data representing stroke elements belonging to a second set to which the meta-information has already been assigned on a per stroke set basis; and
a set determination circuit configured to perform a determination as to an inclusion relation between the first set and the second set, by comparing the stroke elements of the first set data and the stroke elements of the second set data using the first set data acquired by the first acquisition circuit and the second set data acquired by the second acquisition circuit;
wherein,
the data generation circuit is configured to generate the first metadata for the first set described in a form that varies in accordance with a result of the determination performed by the set determination circuit.

### Claim 5 (depends on 4)

The ink data generation apparatus according to claim 4, wherein, responsive to a determination that there is an inclusion relation between the first set and the second set, the data generation circuit generates the first metadata so as to be dependent on second metadata for the second set that is a superset or a subset of the first set.

### Claim 6

An ink data generation method for generating ink data including metadata describing meta-information regarding each of sets of strokes, the ink data generation method being implemented by one or a plurality of computers and comprising:
acquiring a set data representing stroke elements belonging to a set, to which the meta-information has not been assigned yet;
estimating a semantics attribute to be assigned to the set, on a basis of mutual relations between positions or shapes of the stroke elements that form the set;
displaying the stroke elements that form the set and displaying a user control which enables input of a semantics attribute to be assigned to the set; and
generating metadata for the set indicating the semantics attribute estimated or inputted by the user control.

### Claim 7

An ink data generation program stored in a tangible computer-readable medium for generating ink data including metadata describing meta-information regarding each of sets of strokes, the ink data generation program causing one or a plurality of computers to perform:
acquiring a set data representing stroke elements belonging to a set, to which the meta-information has not been assigned yet;
estimating a semantics attribute to be assigned to the set, on a basis of mutual relations between positions or shapes of the stroke elements that form the set;
displaying the stroke elements that form the set and displaying a user control which enables input of a semantics attribute to be assigned to the se; and
generating metadata for the set indicating the semantics attribute estimated or inputted by the user control.
