# US 2016/0259483 A1 · Integrated near field sensor for display devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259483 A1
- Document ID: US20160259483A1
- Status: Published application
- Kind: A1
- Application number: 15/061,868
- Filed: 2016-03-04
- Published: 2016-09-08
- Earliest claimed: 2012-03-28
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Leo B. Baldwin
- Web page: https://patentgrep.com/patent/US20160259483A1

## CPC

- G06F 3/0421: {by interrupting or reflecting a light beam, e.g. optical touch-screen}
- G06F 3/0325: {using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image}
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
- G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A transmissive element including a diffractive and/or refractive pattern can be used with a display screen of a computing device to allow the display screen to function as a near field optical sensor (NFOS). The NFOS can be used to detect shadows cast on the display screen, and/or bright objects detected near the display screen, which can be used to determine the relative position of one or more features with respect to the device. These features can be, for example, the fingers or thumbs of a user attempting to provide input to the computing device. The device can support motion or gesture detection using cameras of the device, and touch input using touch screen functionality, but the NFOS can enable the device to also track motion in the dead zone between the field of view of the cameras and the touch screen.

## Claims

### Claim 1

A computing device, comprising:
a processor;
a display screen including a transmissive layer and an active layer, the transmissive layer having a diffractive pattern configured to direct at least a portion of light incident on the display screen to a plurality of light sensors near at least one edge of the transmissive layer; and
memory including instructions that, when executed by the processor, cause the computing device to:
detect an intensity of light incident at each of a plurality of regions of a display screen using the plurality of light sensors
analyze variations in the detected intensity to determine at least one region having a lower intensity value than at least one other region of the display screen, the lower intensity value being indicative of at least one shadow cast on the display screen;
determine, based at least in part upon one or more characteristics of the at least one shadow, a position of a feature with respect to the device.
