# US 2012/0249806 A1 · Collaborative image control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249806 A1
- Document ID: US20120249806A1
- Status: Published application
- Kind: A1
- Application number: 13/077,372
- Filed: 2011-03-31
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Intel Corporation
- Inventors: Michelle X. Gong; Roy Want; Horst W. Haussecker; Jesse Walker; Sai P. Balasundaram
- Web page: https://patentgrep.com/patent/US20120249806A1

## CPC

- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 23/63: by using electronic viewfinders
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods of conducting collaborative sessions between mobile devices may provide for determining a time delay associated with a set of participating mobile devices, and determining a command execution time based at least in part on a clock of a managing device and the time delay. One or more control messages may be transmitted to the participating mobile devices, wherein the control messages include the command and the command execution time. Upon receiving a control message, each participating mobile device may determine a local execution time based at least in part on the command execution time and an offset of the clock of the managing device relative to a local clock. Execution of the command can therefore be coordinated across the set of participating mobile devices.

## Claims

### Claim 1

A system comprising:
a local clock; and
control logic to,
determine a time delay associated with a set of one or more remote mobile devices,
determine a local execution time for a command based at least in part on the local clock and the time delay,
transmit one or more control messages to the set of one or more remote mobile devices, wherein the one or more control messages are to include the command and the local execution time, and
execute the command in accordance with the local execution time.

### Claim 2 (depends on 1)

The system of claim 1, wherein the control logic is to,
determine an end-to-end delay of the set of one or more remote mobile devices,
determine a clock offset corresponding to the maximum end-to-end delay, and
determine the time delay based at least in part on the maximum end-to-end delay and the clock offset.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more control messages are to further include at least one of a dialog token, an execution delay and one or more identifiers of the set of one or more remote mobile devices.

### Claim 4 (depends on 3)

The system of claim 3, wherein if the one or more control messages are to include a dialog token, the logic is to increment a sequence number, wherein the dialog token is to include the sequence number.

### Claim 5 (depends on 1)

The system of claim 1, wherein the command is to include at least one of a shutter command associated with a collaborative capture session, a focus command associated with the collaborative capture session, and an image display command associated with a collaborative gaming session.

### Claim 6 (depends on 1)

The system of claim 1, further including a user interface, wherein the control logic is to,
detect a presence of one or more available mobile devices,
output an identifier of the one or more available mobile devices via the user interface,
output a user prompt for a selection from the identifiers via the user interface, and
receive user input, wherein the user input is to identify the set of one or more remote mobile devices.

### Claim 7 (depends on 1)

The system of claim 1, wherein the control logic is to select the set of one or more remote mobile devices from one or more available mobile devices based on at least one of signal strength information and location information.

### Claim 8

A non-transitory computer readable storage medium comprising a set of instructions which, if executed by a processor, cause a local mobile device to:
determine a time delay associated with a set of one or more remote mobile devices;
determine a local execution time for a command based at least in part on a local clock and the time delay;
transmit one or more control messages to the set of one or more remote mobile devices, wherein the one or more control messages are to include the command and the local execution time; and
execute the command in accordance with the local execution time.

### Claim 9 (depends on 8)

The medium of claim 8, wherein the instructions, if executed, cause a local mobile device to:
determine an end-to-end delay of the set of one or more remote mobile devices;
determine a clock offset corresponding to the maximum end-to-end delay; and
determine the time delay based at least in part on the maximum end-to-end delay and the clock offset.

### Claim 10 (depends on 8)

The medium of claim 8, wherein the one or more control messages are to further include at least one of a dialog token, an execution delay and one or more identifiers of the set of one or more remote mobile devices.

### Claim 11 (depends on 10)

The medium of claim 10, wherein if the one or more control messages are to include a dialog token, if executed, the instructions cause a local mobile device to increment a sequence number, wherein dialog token is to include the sequence number.

### Claim 12 (depends on 8)

The medium of claim 8, wherein the command is to include at least one of an image capture command associated with a collaborative capture session, and an image display command associated with a collaborative gaming session.

### Claim 13 (depends on 12)

The medium of claim 12, wherein the image capture command is to include at least one of a shutter command and a focus command.

### Claim 14 (depends on 8)

The medium of claim 8, wherein the instructions, if executed, cause a local mobile device to:
detect a presence of one or more available mobile devices;
output an identifier of the one or more available mobile devices via a user interface;
output a user prompt for a selection from the identifiers via the user interface; and
receive user input, wherein the user input is to identify the set of one or more remote mobile devices.

### Claim 15 (depends on 8)

The medium of claim 8, wherein the instructions, if executed, cause a local mobile device to select the set of one or more remote mobile devices from one or more available mobile devices based on at least one of signal strength information and location information.

### Claim 16

A system comprising:
a local clock; and
control logic to,
receive a control message from a remote mobile device, wherein the control message is to include a command and a remote execution time,
determine a local execution time based at least in part on the remote execution time and an offset of a remote clock of the remote mobile device relative to the local clock, and
execute the command in accordance with the local execution time.

### Claim 17 (depends on 16)

The system of claim 16, wherein the control logic is to add the offset of the remote clock to the remote execution time to obtain the local execution time.

### Claim 18 (depends on 16)

The system of claim 16, wherein if the control message is to include a dialog token, the control logic is to,
compare a sequence number of the dialog token to a stored sequence number of a previous dialog token from the remote mobile device,
ignore the control message if the sequence number is less than or equal to the stored sequence number, and
overwrite the stored sequence number with the sequence number of the dialog token if the sequence number is greater than the stored sequence number.

### Claim 19 (depends on 16)

The system of claim 16, wherein if the control message is to include an execution delay, the control logic is to determine the local execution time further based on the execution delay.

### Claim 20 (depends on 16)

The system of claim 16, wherein if the control message is to include one or more identifiers of a set of participating mobile devices, the control logic is to change a status of the set of participating mobile devices to unavailable.

### Claim 21 (depends on 16)

The system of claim 16, wherein the control logic is to execute at least one of an image capture command and an image display command in accordance with the local execution time.

### Claim 22 (depends on 16)

The system of claim 16, wherein the control logic is to,
establish a connection with the remote mobile device,
store a profile of the remote mobile device if the connection is a persistent connection, and
authenticate the control message if the connection is a secure connection.

### Claim 23

A non-transitory computer readable storage medium comprising a set of instructions which, if executed by a processor, cause a local mobile device to:
receive a control message from a remote mobile device, the control message to include a command and a remote execution time;
determine a local execution time based at least in part on the remote execution time and an offset of a remote clock of the remote mobile device relative to a local clock; and
execute the command in accordance with the local execution time.

### Claim 24 (depends on 23)

The medium of claim 23, wherein the instructions, if executed, cause a local mobile device to add the offset of the remote clock to the remote execution time to obtain the local execution time.

### Claim 25 (depends on 23)

The medium of claim 23, wherein if the control message is to include a dialog token, the instructions, if executed, cause a local mobile device to:
compare a sequence number of the dialog token to a stored sequence number of a previous dialog token; and
ignore the control message if the sequence number of the dialog token is less than or equal to the stored sequence number.

### Claim 26 (depends on 25)

The medium of claim 25, wherein the instructions, if executed, cause a local mobile device to overwrite the stored sequence number with the sequence number of the dialog token if the sequence number of the dialog token is greater than the stored sequence number.

### Claim 27 (depends on 23)

The medium of claim 23, wherein if the control message is to include an execution delay, the instructions, if execution, are to cause a local mobile device to determine the local execution time further based on the execution delay.

### Claim 28 (depends on 23)

The medium of claim 23, wherein if the control message is to include one or more identifiers of a set of participating mobile devices, the instructions, if executed, cause a local mobile device to change a status of the set of participating mobile devices to unavailable for a period of time.

### Claim 29 (depends on 23)

The medium of claim 23, wherein the instructions, if executed, cause a local mobile device to execute at least one of an image capture command and an image display command in accordance with the local execution time.

### Claim 30 (depends on 23)

The medium of claim 23, wherein the instructions, if executed, cause a local mobile device to:
establish a connection with the remote mobile device;
store a profile of the remote mobile device if the connection is a persistent connection; and
authenticate the control message if the connection is a secure connection.

### Claim 31

A system comprising:
control logic to,
determine a local execution time for an image capture command, and
synchronize the local execution time with a remote execution time of a remote mobile device; and
an image capture module to execute the image capture command in accordance with the local execution time.

### Claim 32 (depends on 31)

The system of claim 31, wherein the control logic is to,
determine a time delay associated with a set of one or more remote mobile devices,
determine the local execution time for the image capture command based at least in part on a local clock and the time delay, and
transmit one or more control messages to the set of one or more remote mobile devices.

### Claim 33 (depends on 32)

The system of claim 32, wherein the control logic is to,
determine an end-to-end delay of the set of one or more remote mobile devices,
determine a clock offset corresponding to the end-to-end delay, and
determine the time delay based at least in part on the end-to-end delay and the clock offset.

### Claim 34 (depends on 31)

The system of claim 31, wherein the control logic is to,
receive a control message from the remote mobile device, wherein the control message is to include a command and the remote execution time, and
determine the local execution time based at least in part on the remote execution time and an offset of a remote clock of the remote mobile device relative to a local clock.

### Claim 35 (depends on 31)

The system of claim 31, wherein the image capture command is to include at least one of a shutter command and a focus command.

### Claim 36

A non-transitory computer readable storage medium comprising a set of instructions which, if executed by a processor, cause a local mobile device to:
determine a local execution time for an image capture command;
synchronize the local execution time with a remote execution time of a remote mobile device; and
execute the image capture command in accordance with the local execution time.

### Claim 37 (depends on 36)

The medium of claim 36, wherein the instructions, if executed, cause a local mobile device to:
determine a time delay associated with a set of one or more remote mobile devices;
determine the local execution time for the image capture command based at least in part on a local clock and the time delay; and
transmit one or more control messages to the set of one or more remote mobile devices.

### Claim 38 (depends on 37)

The medium of claim 37, wherein the instructions, if executed, cause a local mobile device to:
determine an end-to-end delay of the set of one or more remote mobile devices,
determine a clock offset corresponding to the end-to-end delay; and
determine the time delay based at least in part on the end-to-end delay and the clock offset.

### Claim 39 (depends on 36)

The medium of claim 36, wherein the instructions, if executed, cause a local mobile device to:
receive a control message from the remote mobile device, wherein the control message is to include a command and the remote execution time; and
determine the local execution time based at least in part on the remote execution time and an offset of a remote clock of the remote mobile device relative to a local clock.

### Claim 40 (depends on 36)

The medium of claim 36, wherein the image capture command is to include at least one of a shutter command and a focus command.
