Operating environment with gestural control and multiple client devices, displays, and users
AssigneeOblong Industries, Inc.
InventorsKwindla Hultman Kramer, John Underkoffler
Life of this patent
Estimating the term…
Abstract
Embodiments described herein includes a system comprising a processor coupled to display devices, sensors, remote client devices, and computer applications. The computer applications orchestrate content of the remote client devices simultaneously across the display devices and the remote client devices, and allow simultaneous control of the display devices. The simultaneous control includes automatically detecting a gesture of at least one object from gesture data received via the sensors. The detecting comprises identifying the gesture using only the gesture data. The computer applications translate the gesture to a gesture signal, and control the display devices in response to the gesture signal.
Claims18
A system comprising:
- a display processor that is communicatively coupled to a plurality of display devices;
- a first remote client device that is communicatively coupled to the display processor, wherein the first remote client device includes a first input device and a first client application;
- and
- a second remote client device that is communicatively coupled to the display processor, wherein the second remote client device includes a second input device and a second client application,
- wherein the first remote client device is constructed to provide first video data to the display processor, wherein the first video data includes at least display output of the first client application,
- wherein the second remote client device is constructed to provide second video data to the display processor, wherein the second video data includes at least display output of the second client application,
- wherein the first remote client device and the second remote client device are remote to the display processor and the plurality of display devices, and
- wherein the display processor is constructed to:
- integrate the first video data and the second video data in a first application session of the display processor;
- control the plurality of display devices to display rendered data of the first application session;
- responsive to receiving first pointer data from the first input device via the first remote client device, the first pointer data corresponding to the displayed rendered data that corresponds to the second client application, controlling the second client application based on the received first pointer data;
- and
- responsive to receiving second pointer data from the second input device via the second remote client device, the second pointer data corresponding to the displayed rendered data that corresponds to the first client application, controlling the first client application based on the received second pointer data.
A method comprising:
- at a display processor that is communicatively coupled to a plurality of display devices:
- accessing first video data from a first remote client device that is communicatively coupled to the display processor, wherein the first video data includes at least display output of a first client application of the first remote client device;
- integrating the accessed first video data in a first application session of the display processor;
- controlling the plurality of display devices to display rendered data of the first application session;
- receiving pointer data from an input device of a second remote client device, wherein the received pointer data corresponds to the displayed rendered data that corresponds to the first client application;
- and
- controlling the first client application of the first remote client device based on the received pointer data,
- wherein the first remote client device and the second remote client device are remote to the display processor and the plurality of display devices, and
- wherein the first remote client device and the second remote client device are communicatively coupled to the display processor.
Dependencies are inferred from the claim text.