US 2015/0062013 A1Published application

Rolling Shutter Synchronization of a Pointing Device in an Interactive Display System

AssigneeInterphase Corporation

InventorsYoram Solomon, Branislav Kisacanin, Michael Louis Zimmerman, Charles Thomas Ferguson

Life of this patent

Estimating the term…

Loading patent…

Abstract

An interactive display system including a wireless pointing device, and positioning circuitry capable of determining absolute and relative positions of the display at which the pointing device is aimed. The pointing device captures images displayed by the computer, using a rolling shutter, the images including one or more human-imperceptible positioning targets. The positioning targets are presented as patterned modulation of the intensity (e.g., variation in pixel intensity) in a display frame of the visual payload, followed by the opposite modulation in a successive frame. At least two captured image frames are subtracted from one another to recover the positioning target in the captured visual data and to remove the displayed image payload. The capturing of images at the pointing device is synchronized with the release of image data to the display, to avoid errors in the positioning operation.

Claims28

Dependent claims

A method of operating a computer system including a handheld human interface device, comprising:

generating visual payload image frame data;
combining at least one positioning target pattern with the visual payload image frame data for display in a sequence of consecutive frames;
periodically releasing the combined visual payload image frame data and positioning target pattern to a display;
periodically capturing, at the handheld human interface device, images representative of at least a portion of the display including the positioning target from which a location of the display at which the device is pointing can be determined, the capturing performed by the device in a scanned manner;
detecting a position of a scan line in one or more captured images, the scan line corresponding to a boundary between consecutive frames released to the display;
determining a phase difference between the periodic capturing of images at the device and the periodic releasing of frame data to the display;
and
adjusting the timing of the periodic capturing of images at the device relative to the periodic releasing of frame data to the display according to the determined phase difference.

5 more elements

An interactive display system, comprising:

a computer for generating display image data comprising visual payload image data combined with at least one positioning target pattern;
graphics output circuitry for periodically releasing frames of the display image data to a display;
a pointing device, comprising:
a hand-held housing;
an image sensor disposed in the housing;
image capture circuitry for periodically capturing, in a scanned manner, image data obtained by the image sensor;
and
scan line detection circuitry for detecting a position of a scan line in one or more captured images, the scan line corresponding to a boundary between consecutive frames released to the display;
positioning circuitry for determining a location at the display at which the pointing device is aimed from the captured image data;
circuitry for determining a phase difference between the periodic capturing of images at the device and the periodic releasing of frame data to the display;
and
circuitry for adjusting the timing of the periodic capturing of images at the device relative to the periodic releasing of frame data to the display according to the determined phase difference.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/473,516Filed 29 Aug 2014
Priority: 29 Aug 2013
Published: 5 Mar 2015
Term ends: Not estimatedThe source records don’t support an estimate.

Classification11 codes

G06F 3/0304
Arrangements for converting the position or the displacement of a member into a coded form: detection arrangements using opto-electronic means
G06F 3/0346
Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor: with detection of the…
G06F 3/03545
With detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D…
G06F 3/037
Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor: using the raster scan of a…