# US 11,907,524 B2 · Digital ink processing system, method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,907,524 B2
- Document ID: US11907524B2
- Status: Granted
- Kind: B2
- Application number: 17/674,501
- Filed: 2022-02-17
- Published: 2022-06-02
- Granted: 2024-02-20
- Earliest claimed: 2019-09-13
- Assignees: Wacom Co., Ltd.
- Applicants: Wacom Co., Ltd.
- Inventors: Tsukasa Nomi; Hideki Fujimaki; Seigo Nishiyama
- Web page: https://patentgrep.com/patent/US11907524B2

## CPC

- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/03545: {Pens or stylus}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 16/2428: {Query predicate definition using graphical user interfaces, including menus and forms (G06F16/2423 takes precedence)}
- G06F 16/243: {Natural language query formulation}
- G06F 16/2457: with adaptation to user needs
- G06F 16/90335: {Query processing}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 40/171: by use of digital ink
- G06Q 10/10: Office automation; Time management
- G06Q 30/04: Billing or invoicing
- G06Q 30/06: Buying, selling or leasing transactions
- G06Q 50/20: Education
- G06V 30/347: {Sampling; Contour coding; Stroke extraction}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A digital ink processing system, method, and program are provided that are capable of presenting, to a user, useful and highly relevant information as a search result when a search is performed using digital ink. A processor included in a tablet enables a pointing operation of an electronic pen relative to a stroke or strokes. The processor, after enabling the pointing operation of the electronic pen, performs a search for content related to a semantic attribute of the stroke or strokes pointed at, or requests an external server to perform the search. The processor performs control so as to display the related content retrieved by the search on a display with the stroke or strokes.

## Claims

### Claim 1

A digital ink processing system comprising:
an electronic pen;
a content server that stores multiple pieces of content in association with multiple use IDs; and
a tablet that generates digital ink describing a stroke or strokes according to an input made by the electronic pen through a display, wherein the tablet includes a processor that
enables a pointing operation of the electronic pen relative to the stroke or strokes,
after enabling the pointing operation of the electronic pen relative to the stroke or strokes acquires a semantic attribute of the stroke or strokes pointed at,
transmits data including one of the use IDs and the semantic attribute to the content server to request the content server to perform a search for content based on the data, and
performs control so as to display the content retrieved by the search on the display with the stroke or strokes.

### Claim 2 (depends on 1)

The digital ink processing system according to claim 1, wherein the processor performs control so as to cause the stroke or strokes for which the pointing operation has been enabled to be highlighted on the display as compared to before the enablement.

### Claim 3 (depends on 1)

The digital ink processing system according to claim 1, wherein the processor enables the pointing operation of the electronic pen relative to the stroke or strokes to which the semantic attribute has been assigned.

### Claim 4 (depends on 3)

The digital ink processing system according to claim 3, further comprising:
a digital ink server that analyzes the digital ink transmitted from the tablet and assigns the semantic attribute to the stroke or strokes, wherein
the processor enables the pointing operation of the electronic pen relative to the stroke or strokes for which semantic data representative of the semantic attribute has been acquired from the digital ink server.

### Claim 5 (depends on 1)

The digital ink processing system according to claim 1, wherein the processor enables the pointing operation of the electronic pen relative to the stroke or strokes on which a user operation of adding a mark or an annotation has been performed.

### Claim 6 (depends on 1)

The digital ink processing system according to claim 1,
wherein the content is retrieved when use of the content is permitted.

### Claim 7 (depends on 1)

The digital ink processing system according to claim 1, wherein the processor acquires a different one of the content depending on a degree of occurrence of the semantic attribute based on the same use ID.

### Claim 8 (depends on 1)

The digital ink processing system according to claim 1, wherein the use ID is a pen ID that identifies the electronic pen.

### Claim 9 (depends on 8)

The digital ink processing system according to claim 8, wherein
in a case where the digital ink is generated using a first electronic pen that is assigned a first pen ID, and a second electronic pen is used that is assigned a second pen ID different from the first pen ID,
the processor prohibits or restrict editing of the digital ink by the second electronic pen while accepting the pointing operation by the second electronic pen.

### Claim 10 (depends on 1)

The digital ink processing system according to claim 1, wherein the content server performs a charging process in accordance with usage of the content, for a user of the content and a business entity that provides the content.

### Claim 11

A digital ink processing method executed by a processor configured to generate digital ink describing a stroke or strokes according to an input made by an electronic pen through a display, for use with a content server which stores multiple pieces of content in association with multiple use IDs, the digital ink processing method comprising:
enabling a pointing operation of the electronic pen relative to the stroke or strokes;
after enabling the pointing operation of the electronic pen, acquiring a semantic attribute of the stroke or strokes pointed at,
transmitting data including one of the use IDs and the semantic attribute to the content server to request the content server to perform a search for content based on the data; and
performing control so as to display the content retrieved by the search on the display with the stroke or strokes.

### Claim 12

A non-transitory computer-readable medium including a digital ink processing program, which, when executed by a processor, causes the processor to perform:
generating digital ink describing a stroke or strokes according to an input made by an electronic pen through a display;
enabling a pointing operation of the electronic pen relative to the stroke or strokes;
after enabling the pointing operation of the electronic pen, acquiring a semantic attribute of the stroke or strokes pointed at,
accessing a content server which stores multiple pieces of content in association with multiple use IDs, by transmitting data including one of the use IDs and the semantic attribute to the content server to request the content server to perform a search for content based on the data; and
performing control so as to display the content retrieved by the search on the display with the stroke or strokes.