# US 2015/0177856 A1 · Digital pen system and pen based input method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0177856 A1
- Document ID: US20150177856A1
- Status: Published application
- Kind: A1
- Application number: 14/641,116
- Filed: 2015-03-06
- Published: 2015-06-25
- Earliest claimed: 2009-10-07
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Hiroshi KAJITANI; Junichi Miyamoto
- Web page: https://patentgrep.com/patent/US20150177856A1

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/03545: {Pens or stylus}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/0383: {Signal control means within the pointing device}
- G06F 3/0386: {for light pen}
- G06F 3/043: using propagating acoustic waves
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A digital pen system includes a rod-shaped digital pen that periodically transmits a signal including information about a direction of the digital pen, and a receiving apparatus that detects a position and the direction of the digital pen in three-dimensional space based on the signal, calculates an intersection of an extension line of the digital pen in a longitudinal direction thereof and a display screen of a display apparatus in a case that the digital pen and the display screen are apart from each other, and enables the display apparatus to perform a pen-based input at the intersection on the display screen.

## Claims

### Claim 1

A digital pen system, comprising:
a rod-shaped digital pen that periodically transmits a signal including information about a direction of the digital pen; and
a receiving apparatus that detects a position and the direction of the digital pen in three-dimensional space based on the signal, calculates an intersection of an extension line of the digital pen in a longitudinal direction thereof and a display screen of a display apparatus in a case that the digital pen and the display screen are apart from each other, and enables the display apparatus to perform a pen-based input at the intersection on the display screen.

### Claim 2 (depends on 1)

The digital pen system according to claim 1, wherein the digital pen comprises:
an electromagnetic wave transmitting unit that transmits an electromagnetic wave signal representing a transmission timing;
an ultrasonic wave driving unit that modulates an ultrasonic wave based on a pseudorandom signal having high autocorrelation simultaneously with transmission of the electromagnetic wave signal to generate an ultrasonic wave driving signal; and
an ultrasonic wave transmitting unit that is driven by the ultrasonic wave driving signal and transmits an ultrasonic wave signal having a frequency higher than a fundamental frequency of the ultrasonic wave driving signal.

### Claim 3 (depends on 2)

The digital pen system according to claim 2, wherein the receiving apparatus comprises:
an electromagnetic wave receiving unit that detects the electromagnetic wave signal;
an ultrasonic wave receiving unit that comprises at least three ultrasonic wave detecting units that are not arranged on a single line and receives the ultrasonic wave signal via the at least three ultrasonic wave detecting units; and
a propagation time calculating unit that uses a waveform identical to that of the ultrasonic wave driving signal as a model waveform, calculates correlation values between the received ultrasonic wave signal and the model waveform, detects a main peak value of the calculated correlation values, and calculates an ultrasonic wave propagation time based on a time when the electromagnetic wave signal is detected and a time when the main peak value is detected.

### Claim 4 (depends on 1)

The digital pen system according to claim 1, wherein the digital pen further comprises an angle sensor that determines at least four-axis directions, and the direction of the digital pen is determined based on the angle sensor.

### Claim 5 (depends on 4)

The digital pen system according to claim 4, wherein the angle sensor comprises an acceleration sensor.

### Claim 6 (depends on 5)

The digital pen system according to claim 5, wherein the angle sensor comprises a three-axis acceleration sensor and a two-axis acceleration sensor.

### Claim 7 (depends on 4)

The digital pen system according to claim 4, wherein the angle sensor comprises a gyro sensor.

### Claim 8 (depends on 2)

The digital pen system according to claim 2, wherein the ultrasonic wave transmitting unit comprises a piezoelectric element or a magnetostrictive element.

### Claim 9 (depends on 2)

The digital pen system according to claim 2, wherein the ultrasonic wave transmitting unit includes a transmission surface that is substantially spherical.

### Claim 10 (depends on 3)

The digital pen system according to claim 3, wherein the ultrasonic wave receiving unit comprises a piezoelectric element, a magnetostrictive element, or a microphone.

### Claim 11 (depends on 3)

The digital pen system according to claim 3, wherein at least two of the at least three ultrasonic wave detecting units are fixedly positioned.

### Claim 12 (depends on 3)

The digital pen system according to claim 3, wherein the at least three ultrasonic wave detecting units are provided on the display screen or on an extension surface thereof.

### Claim 13 (depends on 1)

The digital pen system according to claim 1, wherein the digital pen comprises a laser pointer that indicates the intersection.

### Claim 14 (depends on 13)

The digital pen system according to claim 13, wherein generation timings of the laser pointer and an ultrasonic wave signal and/or an electromagnetic wave signal are coordinated, and a track of the laser pointer is displayed on the display screen.

### Claim 15 (depends on 2)

The digital pen system according to claim 2, wherein the pseudorandom signal comprises an M-sequence signal.

### Claim 16

A pen-based input method, comprising:
by a digital pen, periodically transmitting a signal including information about a direction of the digital pen; and
by a receiving apparatus, detecting a position and the direction of the digital pen in a three-dimensional space based on the signal, calculating an intersection of an extension line of the digital pen in a longitudinal direction thereof and a display screen of a display apparatus in a case that the digital pen and the display screen are apart from each other, and enabling the display apparatus to a perform pen-based input at the intersection on the display screen.

### Claim 17 (depends on 16)

The pen-based input method according to claim 16, further comprising:
by the digital pen, transmitting an electromagnetic wave signal representing a transmission timing;
modulating an ultrasonic wave based on a pseudorandom signal having high autocorrelation simultaneously with transmission of the electromagnetic wave signal to generate an ultrasonic wave driving signal; and
being driven by the ultrasonic wave driving signal and transmitting an ultrasonic wave signal having a frequency higher than a fundamental frequency of the ultrasonic wave driving signal.

### Claim 18 (depends on 17)

The pen-based input method according to claim 17, further comprising:
by the receiving apparatus, detecting the electromagnetic wave signal;
receiving the ultrasonic wave signal via at least three ultrasonic wave detecting units that are not arranged on a single line; and
using a waveform identical to that of the ultrasonic wave driving signal as a model waveform, calculating correlation values between the received ultrasonic wave signal and the model waveform, detecting a main peak value of the calculated correlation values, and calculating an ultrasonic wave propagation time based on a time when the electromagnetic wave signal is detected and a time when the main peak value is detected.

### Claim at position 19

19-20. (canceled)

### Claim 21 (depends on 16)

The pen-based input method according to claim 16, further comprising:
determining at least four-axis directions to determine the direction of the digital pen.

### Claim 22

A digital pen system, comprising:
a rod-shaped digital pen that periodically transmits a signal including information about a direction of the digital pen;
a receiving apparatus that detects a position and the direction of the digital pen in three-dimensional space based on the signal, calculates an intersection of an extension line of the digital pen in a longitudinal direction thereof and a display screen of a display apparatus in a case that the digital pen and the display screen are apart from each other, and enables the display apparatus to perform a pen-based input at the intersection on the display screen,
wherein the digital pen comprises:
an electromagnetic wave transmitting unit that transmits an electromagnetic wave signal representing a transmission timing;
an ultrasonic wave driving unit that modulates an ultrasonic wave based on a pseudorandom signal having high autocorrelation simultaneously with transmission of the electromagnetic wave signal to generate an ultrasonic wave driving signal; and
an ultrasonic wave transmitting unit that is driven by the ultrasonic wave driving signal and transmits an ultrasonic wave signal having a frequency higher than a fundamental frequency of the ultrasonic wave driving signal; and
an angle sensor that determines at least four-axis directions, and the direction of the digital pen is determined based on the angle sensor,
wherein the digital pen comprises a laser pointer that indicates the intersection, and
wherein generation timings of the laser pointer, the ultrasonic wave signal, and the electromagnetic wave signal are coordinated, and a track of the laser pointer is displayed on the display screen.
