# US 2014/0198079 A1 · Interactive projector system and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0198079 A1 - Document ID: US20140198079A1 - Status: Published application - Kind: A1 - Application number: 14/162,833 - Filed: 2014-01-24 - Published: 2014-07-17 - Earliest claimed: 2007-10-05 - Inventors: Kenneth J. Huebner - Web page: https://patentgrep.com/patent/US20140198079A1 ## CPC - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G03B 17/54: with projector - G03B 21/10: Projectors with built-in or built-on screen - G03B 21/14: Details - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) ## Abstract An interactive image projecting device that projects an image onto a display surface and controls the projected image based upon movement of the image projecting device or the detection of another image. The image projecting device includes a projector that generates an image from a control unit. The device includes a position indicating emitter that generates a position indicator and an image sensor that is operable to detect the position indicator from either the device including the image sensor or a position indicator from another device. Based upon the sensed position indicator from another device, the control unit operates to modify the image projected from the device such that the image from a first device can interact with an image from a second device. The first and second devices each have a wireless transceiver such that the devices can communicate with each other during operation. ## Claims ### Claim at position 1 1-25. (canceled) ### Claim 26 A first image projecting device of handheld size, comprising: a control unit; a projector operable to project a first image; a position indicating emitter operable to project a first position indicator on a display surface; a wireless transceiver operable to transmit a first message; and an image sensor operable to view the display surface and detect a second position indicator from a second image projecting device, wherein the control unit modifies the first image projected by the projector based upon the detected second position indicator from the second image projecting device. ### Claim 27 (depends on 26) The first image projecting device of claim 26, wherein the control unit determines a rotation angle of the detected second position indicator from the second image projecting device, and wherein the control unit modifies the first image projected by the projector based upon the rotation angle of the second position indicator from the second image projecting device. ### Claim 28 (depends on 26) The first image projecting device of claim 26 further comprising a speaker and a sound synthesizer controlled by the control unit, wherein audible sound is generated based upon the detected second position indicator from the second image projecting device. ### Claim 29 (depends on 26) The first image projecting device of claim 26, wherein the first message comprises a device ID having a unique identifier. ### Claim 30 (depends on 26) The first image projecting device of claim 26, wherein the first message comprises image dimensions of the first image. ### Claim 31 (depends on 26) The first image projecting device of claim 26, wherein the message comprises an object type. ### Claim 32 (depends on 26) The first image projecting device of claim 26, wherein the message comprises an object activity. ### Claim 33 (depends on 26) The first image projecting device of claim 26, wherein the first message comprises a description of an object presented in the first image. ### Claim 34 (depends on 26) The first image projecting device of claim 26, wherein the first message comprises a description of a character presented in the first image. ### Claim 35 (depends on 26) The first image projecting device of claim 26, wherein the control unit determines that a second image projected by the second image projecting device is in the vicinity of the first image projected by the first image projecting device, and wherein the control unit modifies the first image based upon the second image being in the vicinity of the first image. ### Claim 36 (depends on 26) The first image projecting device of claim 26, wherein the control unit determines that a second image projected by the second image projecting device has collided with the first image projected by the first image projecting device, and wherein the control unit modifies the first image based upon the collision of the first image and the second image. ### Claim 37 (depends on 26) The first image projecting device of claim 26, wherein the wireless transceiver receives a second message from the second image projecting device, and wherein the control unit modifies the first image based upon the received second message. ### Claim 38 (depends on 37) The first image projecting device of claim 37 wherein the second message comprises a description of an object presented in the second image. ### Claim 39 (depends on 37) The first image projecting device of claim 37, wherein the second message comprises a description of a character presented in the second image. ### Claim 40 A method of integrating the operation of a first image projecting device and a second image projecting device, the method comprising: generating a first image from a first projector of the first image projecting device; generating a position indicator from a position indicating emitter of the first image projecting device; transmitting a message from a first wireless transceiver of the first image projecting device; operating an image sensor of the second image projecting device to detect the position indicator; and modifying a second image from a second projector of the second image projecting device based upon the detected position indicator. ### Claim 41 (depends on 40) The method of claim 40 further comprising: determining the position of the position indicator by the second image projecting device; determining the location of the first image by the second image projecting device based upon the position of the position indicator; and modifying the second image from the second projector of the second image projecting device based upon the determined location of the first image. ### Claim 42 (depends on 40) The method of claim 40 further comprising: determining a collision between the first image and the second image by the second image projecting device; and modifying the second image from the second projector of the second image projecting device based upon the determined collision between the first image and the second image. ### Claim 43 (depends on 40) The method of claim 40 further comprising: receiving the message by a second wireless transceiver of the second image projecting device; modifying the second image from the second projector of the second image projecting device based upon the message received. ### Claim 44 (depends on 43) The method of claim 43, wherein the message comprises a device ID having a unique identifier. ### Claim 45 (depends on 43) The method of claim 43, wherein the message comprises image dimensions of the first image. ### Claim 46 (depends on 43) The method of claim 43, wherein the message comprises a description of an object presented in the first image. ### Claim 47 (depends on 46) The method of claim 46 further comprising: detecting the description of the object presented in the first image by the second image projecting device; and modifying the second image from the second projector of the second image projecting device based upon the description of the object presented in the first image. ### Claim 48 (depends on 43) The method of claim 43, wherein the message comprises an object type. ### Claim 49 (depends on 43) The method of claim 43, wherein the message comprises a description of a character presented in the first image. ### Claim 50 (depends on 49) The method of claim 49 further comprising: detecting the description of the character presented in the first image by the second image projecting device; and modifying the second image from the second projector of the second image projecting device based upon the description of the character presented in the first image. ### Claim 51 A first image projecting device of handheld size, comprising: a control unit; a projector operable to project a first image controlled by the control unit; a position indicating emitter operable to project a first position indicator on a display surface; an image sensor operable to view the display surface and detect a second position indicator from a second image projecting device; and a wireless transceiver operable to receive a message from the second image projecting device, wherein the control unit modifies the first image projected by the projector based upon the detected second position indicator and the message received from the second image projecting device. ### Claim 52 (depends on 51) The first image projecting device of claim 51, wherein the message comprises a device ID having a unique identifier. ### Claim 53 (depends on 51) The first image projecting device of claim 51, wherein the message comprises image dimensions of the first image. ### Claim 54 (depends on 51) The first image projecting device of claim 51, wherein the message comprises an image rotation angle. ### Claim 55 (depends on 51) The first image projecting device of claim 51, wherein the message comprises an object type. ### Claim 56 (depends on 51) The first image projecting device of claim 51, wherein the message comprises an object activity. ### Claim 57 (depends on 51) The first image projecting device of claim 51, wherein the message comprises character attribute information. ### Claim 58 (depends on 51) The first image projecting device of claim 51, wherein the control unit determines the position of the second position indicator from the second image projecting device, and wherein the control unit modifies the first image projected by the projector based upon the position of the second position indicator and the message received from the second image projecting device. ### Claim 59 (depends on 51) The first image projecting device of claim 51, wherein the control unit determines the rotation angle of the second position indicator from the second image projecting device, and wherein the control unit modifies the first image projected by the projector based upon the rotation angle of the second position indicator and the message received from the second image projecting device. ### Claim 60 (depends on 51) The first image projecting device of claim 51 further comprising a speaker and sound synthesizer controlled by the control unit, wherein audible sound is generated based upon the detected second position indicator and the message received from the second image projecting device.