# US 2010/0259487 A1 · Input detection systems and methods for display panels with embedded photo sensors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0259487 A1
- Document ID: US20100259487A1
- Status: Published application
- Kind: A1
- Application number: 12/420,147
- Filed: 2009-04-08
- Published: 2010-10-14
- Earliest claimed: 2009-04-08
- Assignees: Integrated Digital Technologies, Inc.
- Inventors: Chun-Yuan Lee; Shen-Tai Liaw
- Web page: https://patentgrep.com/patent/US20100259487A1

## CPC

- G06F 3/0412: {Digitisers structurally integrated in a display}
- G06F 3/0308: {comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen}
- G06F 3/03542: {Light pens for emitting or receiving light}
- G06F 3/042: by opto-electronic means
- G09G 5/08: Cursor circuits
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A method of for identifying multiple optical inputs to a display area with embedded photo sensors includes providing a display area with embedded photo sensors configured to display visual information; receiving a first and a second input optically transmitted to a first and a second location on the display area, respectively; processing the first and second inputs to identify at least one of (1) the location of the first and second inputs relative to the display area; and (2) a timing of the first and second inputs; and determining whether the first and second inputs originated from a single source or multiple sources based on at least their (1) wavelengths; (2) flash or pulse frequencies; (3) durations; (4) timings; (5) intensities; (6) modulation schemes; (7) projected input patterns; and (8) at least one estimated trace of the inputs; and providing first and second input information containing at least (1) their locations and (2) their timings.

## Claims

### Claim 1

A method for identifying multiple optical inputs to a display area with embedded photo sensors, the method comprising:
providing a display area with embedded photo sensors configured to display visual information;
receiving a first input optically transmitted to a first location on the display area;
receiving a second input optically transmitted to a second location on the display area;
processing the first and second inputs to identify at least one of (1) the location of the first and second inputs relative to the display area; and (2) a timing of the first and second inputs; and
determining whether the first and second inputs originated from a single source or multiple sources based on at least one of (1) the wavelengths of the first and second inputs; (2) the flash or pulse frequencies of the first and second inputs; (3) the durations of the first and second inputs; (4) the timings of the first and second inputs; (5) the intensities of the first and second inputs; (6) the modulation schemes associated with the first and second inputs; (7) projected input patterns of the first and second inputs; and (8) at least one estimated trace of at least one of the first and second inputs; and
providing first input information and second input information each containing at least one of (1) the location of the respective input relative to the display area; and (2) the timing of the respective input.

### Claim 2 (depends on 1)

The method of claim 1, wherein the display area is a part of a portable digital assistant (PDA), a gaming console, a cell phone, a digital photo frame, a camera, a computer system, a laptop computer, an automatic teller machine (ATM), or a display monitor.

### Claim 3 (depends on 1)

The method of claim 1, wherein the each of the first and second inputs comprises at least one of infrared, laser, invisible light, and visible light.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining whether the first and second inputs originated from a single source or multiple sources based on at least one estimated trace comprises:
determining a first source from which the first input originated;
receiving a plurality of historical inputs from the first source, wherein the historical inputs precede the first input in time;
computing a first trace of inputs based on the first input and at least one of the plurality of historical inputs; and
determining, based on the first trace of inputs, whether the second input originated from the first source.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
computing a second trace of inputs based on at least two of a plurality of historical inputs from a second source, and
determining, based on the first trace of inputs and the second trace of inputs, whether the second input is a portion of the second trace of inputs.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining whether the first and second inputs originated from a single source or multiple sources based on the at least one estimated trace comprises:
receiving a plurality of historical inputs from a first source, wherein the historical inputs precede the first input in time;
computing a first trace of inputs based on the plurality of historical inputs; and
determining, based on the first trace of inputs, whether the first or second input originated from the first source.

### Claim 7 (depends on 6)

The method of claim 6, wherein computing the first trace of inputs includes calculating a projected trace and determining whether the first or second input originated from the first source include comparing the first and second input with the projected trace.

### Claim 8 (depends on 6)

The method of claim 6, wherein computing the first trace of inputs includes identifying at least two vectors based on at least two of the plurality of historical inputs and the first input and determining a difference between the at least two vectors.

### Claim 9 (depends on 5)

The method of claim 5, wherein determining whether the second input is a portion of the first trace of inputs comprises observing at least one of (1) movements of consecutive inputs from a first user, (2) directions of movements of the consecutive inputs from a first user, and (3) a projected location of an input that is a portion of the first trace of inputs based on the first input and at least one of the plurality of historical inputs.

### Claim 10 (depends on 1)

The method as in claim 1 further comprising displaying the visual information on the display area in response to at least one of the first input information and the second input information.

### Claim 11 (depends on 1)

The method as in claim 1, wherein determining whether the first and second inputs came from the single user or the multiple users comprises distinguishing the first input from the second input based on at least one of (1) the wavelengths of light beams from the first and second inputs; (2) the flashing or pulse frequencies of the light beams from the first and second inputs; (3) the elapsed times of the light beams from the first and second inputs; (4) the timings of the first and second inputs; (5) the intensities of the light beams from the first and second inputs; and (6) the modulated signals associated with the first and second inputs.

### Claim 12 (depends on 1)

The method as in claim 1, wherein providing the signals identifying the first input information and the second input information comprises identifying at least the location of the first input and the location of the second input.

### Claim 13 (depends on 1)

The method as in claim 1, wherein receiving the first and second inputs comprises sensing the first and second inputs using a display system including the display area.

### Claim 14 (depends on 1)

The method as in claim 1, wherein software instructions executable by a computer system are used to perform at least a portion of the method.

### Claim 15

A system for identifying multiple optical inputs to a display area with embedded photo sensors, the system comprising:
a display area with embedded photo sensors configured to display visual information;
an input-detection unit for receiving a first and a second input optically transmitted to a first and a second location, respectively, on the display area; and
a processor, wherein the processor:
identifies at least one of (1) the location of the first and second inputs relative to the display area; and (2) a timing of the first and second inputs;
determines whether the first and second inputs originated from a single source or multiple sources based on at least one of (1) the wavelengths of the first and second inputs; (2) the flash or pulse frequencies of the first and second inputs; (3) the durations of the first and second inputs; (4) the timings of the first and second inputs; (5) the intensities of the first and second inputs; (6) the modulation schemes associated with the first and second inputs; (7) projected input patterns of the first and second inputs; and (8) at least one estimated trace of at least one of the first and second inputs; and
provides first input information and second input information each containing at least one of (1) the location of the respective input relative to the display area; and (2) the timing of the respective input.

### Claim 16 (depends on 15)

The system of claim 15, wherein the display area is a part of a portable digital assistant (PDA), a gaming console, a cell phone, a digital photo frame, a camera, a computer system, a laptop computer, an automatic teller machine (ATM), or a display monitor.

### Claim 17 (depends on 15)

The system of claim 15, wherein the each of the first and second inputs comprises at least one of infrared light, laser, invisible light, and visible light.

### Claim 18 (depends on 15)

The system of claim 15, wherein determining whether the first and second inputs originated from a single source or multiple sources based on at least one estimated trace comprises:
determining a first source from which the first input originated;
receiving a plurality of historical inputs from the first source, wherein the historical inputs precede the first input in time;
computing a first trace of inputs based on the first input and at least one of the plurality of historical inputs; and
determining, based on the first trace of inputs, whether the second input originated from the first source.

### Claim 19 (depends on 18)

The system of claim 18, wherein the processor further computes a second trace of inputs based on at least two of a plurality of historical inputs from a second source, and determines, based on the first trace of inputs and the second trace of inputs, whether the second input is a portion of the second trace of inputs.

### Claim 20 (depends on 15)

The system of claim 15, wherein determining whether the first and second inputs originated from a single source or multiple sources based on the at least one estimated trace comprises:
receiving a plurality of historical inputs from a first source, wherein the historical inputs precede the first input in time;
computing a first trace of inputs based on the plurality of historical inputs; and
determining, based on the first trace of inputs, whether the first or second input originated from the first source.

### Claim 21 (depends on 20)

The system of claim 20, wherein computing the first trace of inputs includes calculating a projected trace and determining whether the first or second input originated from the first source include comparing the first and second input with the projected trace.

### Claim 22 (depends on 20)

The system of claim 20, wherein computing the first trace of inputs includes identifying at least two vectors based on at least two of the plurality of historical inputs and the first input and determining a difference between the at least two vectors.

### Claim 23 (depends on 19)

The system of claim 19, wherein determining whether the second input is a portion of the first trace of inputs comprises observing at least one of (1) movements of consecutive inputs from a first user, (2) directions of movements of the consecutive inputs from a first user, and (3) a projected location of an input that is a portion of the first trace of inputs based on the first input and at least one of the plurality of historical inputs.

### Claim 24 (depends on 15)

The system of claim 15, wherein the display area displays visual information in response to at least one of the first input information and the second input information.

### Claim 25 (depends on 15)

The system of claim 15, wherein the processor distinguishes the first input from the second input based on at least one of (1) the wavelengths of light beams from the first and second inputs; (2) the flashing or pulse frequencies of the light beams from the first and second inputs; (3) the elapsed times of the light beams from the first and second inputs; (4) the timings of the first and second inputs; (5) the intensities of the light beams from the first and second inputs; and (6) the modulated signals associated with the first and second inputs.

### Claim 26 (depends on 15)

The system of claim 15, wherein the processor identifies at least the location of the first input and the location of the second input.

### Claim 27 (depends on 15)

The system of claim 15, further comprising a display system which incorporates the display area and the input-detection unit.
