# US 9,438,843 B2 · Operation controlling apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,843 B2 - Document ID: US9438843B2 - Status: Granted - Kind: B2 - Application number: 14/186,471 - Filed: 2014-02-21 - Published: 2014-06-19 - Granted: 2016-09-06 - Earliest claimed: 2010-12-06 - Assignees: Hitachi Maxell, Ltd. - Applicants: Hitachi Maxell, Ltd. - Inventors: Mayumi Nakade; Mayuko Tanaka - Web page: https://patentgrep.com/patent/US9438843B2 ## CPC - G08C 23/04: using light waves, e.g. infrared - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 3/0426: {tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886)} - G08C 17/02: using a radio link - H04N 21/4131: {home appliance, e.g. lighting, air conditioning system, metering devices (home automation data switching networks exchanging configuration information on appliance services H04L12/2807)} - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)} - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - G08C 2201/32: Remote control based on movements, attitude of remote control device - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Operation controlling apparatus executing equipment operation controlling, including: an equipment management portion configured to manage control commands corresponding to plural number of control items; a video producing portion configured to produce videos corresponding to the plural number of control items; a video display portion configured to display video produced by the video producing portion laying on a control surface; a distance detector portion configured to detect distance from the video producing portion to the control surface; and a controller portion configured to control the video display portion, so that a size of the video to be displayed by the video display portion is within a size of the control surface, depending on the distance detected by the distance detector portion, and to make equipment of a control target execute the control command, which is managed by the equipment management portion, when execution of the control item is determined. ## Claims ### Claim 1 An operation controlling apparatus, for executing operation controlling for equipment, comprising: an equipment management portion, which is configured to manage control commands corresponding to a plural number of control items; a video producing portion, which is configured to produce videos corresponding to the plural number of control items; a video display portion, which is configured to display the video produced by the video producing portion laying on a control surface; a distance detector portion, which is configured to detect distance from the video producing portion to the control surface; and a controller portion, which is configured to control the video display portion, so that a size of the video to be displayed by the video display portion is within a size of the control surface, depending on the distance detected by the distance detector portion, and to make an equipment of a control target execute a control command associated with a control item, which is managed by the equipment management portion, when execution of the control item is determined, wherein the controller portion controls the video producing portion, so that the control item is changed depending on the distance detected by the distance detector portion. ### Claim 2 (depends on 1) The operation controlling apparatus, as described in the claim 1, wherein execution of the control item is determined when the distance detected by the distance detector portion changes repetitively. ### Claim 3 (depends on 1) The operation controlling apparatus, as described in the claim 1, further comprising a motion detector portion, which is configured to detect a movement of the operation surface, wherein the controller portion exchanges the equipment to be the control target, when the motion detector portion detects a predetermined movement. ### Claim 4 (depends on 2) The operation controlling apparatus, as described in the claim 2, wherein the execution of the control item is determined when a motion detector portion detects a predetermined movement. ### Claim 5 An operation controlling apparatus, for executing operation controlling for equipment, comprising: an equipment management portion, which is configured to manage control commands corresponding to a plural number of control items; a video producing portion, which is configured to produce videos corresponding to the plural number of control items; a video display portion, which is configured to display the video produced by the video producing portion laying on a control surface; a distance detector portion, which is configured to detect distance from the video producing portion to the control surface; and a controller portion, which is configured to: control the video display portion, so that a size of the video to be displayed by the video display portion is within a size of the control surface, depending on the distance detected by the distance detector portion; make an equipment of a control target execute the control command, which is managed by the equipment management portion, when execution of the control item is determined; and control the video producing portion, so that the control item is changed depending on the distance detected by the distance detector portion. ### Claim 6 (depends on 5) The operation controlling apparatus, as described in the claim 5, wherein execution of the control item is determined when the distance detected by the distance detector portion changes repetitively. ### Claim 7 (depends on 5) The operation controlling apparatus, as described in the claim 5, further comprising a motion detector portion, which is configured to detect a movement of the operation surface, wherein the controller portion exchanges the equipment to be the control target, when the motion detector portion detects a predetermined movement. ### Claim 8 (depends on 6) The operation controlling apparatus, as described in the claim 6, wherein the execution of the control item is determined when a motion detector portion detects a predetermined movement.