# US 2013/0076908 A1 · Apparatus and method for video display and control for portable device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0076908 A1
- Document ID: US20130076908A1
- Status: Published application
- Kind: A1
- Application number: 13/679,166
- Filed: 2012-11-16
- Published: 2013-03-28
- Earliest claimed: 2009-05-26
- Assignees: Lextech Labs LLC
- Inventors: Raymond Alex Bratton; Nathan Robbins Petersen
- Web page: https://patentgrep.com/patent/US20130076908A1

## CPC

- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/4227: {Providing} Remote input by a user located remotely from the client device, e.g. at work
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04M 1/72415: for remote control of appliances
- H04M 2250/22: including a touch pad, a touch sensor or a touch detector
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

An apparatus and method for display and control of video data on a mobile device provides simultaneous multiple video data display of groups of video sources and selection of video data for single, larger viewing. Control of the camera source of the video data is provided for the mobile device user, such as by manipulation of a multi-touch sensitive screen to pan, tilt and zoom. Image capture from the video screen and marking of the captured image is provided. Activation of video data streams and groups of video data streams for display on the mobile device is provided by transfer of activation information to the mobile device via email. Notification of events monitored by the video source or by other sensors is sent to users of the mobile devices.

## Claims

### Claim 1

An apparatus for display and control of video data, comprising:
a mobile client having a touch sensitive display, said mobile client being operable to connect to a wireless network and receive video data from a plurality of video sources over the wireless network; and
non-transitory computer readable storage media in said mobile client having stored thereon a video command application,
said video command application being operable to simultaneously display on said touch sensitive display at least a portion of the video data from a predetermined number of said plurality of video sources, said plurality of video sources exceeding said predetermined number of displayed video sources, wherein said plurality of video sources that are not currently displayed on said touch sensitive display are off-screen video sources that are periodically updated with current video data,
said video command application being operable to simultaneously display video data from multiple video sources having multiple differing video formats,
said video command application being operable to display video data from a single video source on said touch sensitive display, and
said video command application being operable to generate command instructions from user contact with said touch sensitive display to change a characteristic of said single video source, and thereby change the video data being generated by the video source, in accordance with the user contact.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein said video command application is operable to monitor a latency of said wireless network to which said mobile client is connected, and send a command to at least one of said plurality of video sources to reduce the network bandwidth usage by the video sources, thereby reducing the latency of said network connection, if the latency exceeds a predetermined threshold.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein said single video source is a video camera and said video data includes live video images generated by said video camera.

### Claim 4 (depends on 3)

An apparatus as claimed in claim 3, wherein said characteristic is at least one of camera direction, camera elevation, or camera zoom level.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein said touch sensitive display is a multi-touch sensitive display, and wherein double-tap contact with said multi-touch sensitive display, at a location in said displayed video data, triggers said video command application to generate a re-center command transmitted to the single video source to cause the single video source to re-center the displayed video data at the location of the video data that was double-tapped on the multi-touch sensitive display.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein said touch sensitive display is a multi-touch sensitive display, and wherein contacting said multi-touch display at two separate locations and increasing the distance between said contact locations while maintaining contact with said display triggers said video command application to generate a zoom-in command instruction transmitted to said video camera to cause said video camera to zoom-in to a location in the camera's view centered between said contact locations.

### Claim 7 (depends on 3)

The apparatus of claim 3, wherein said touch sensitive display is a multi-touch sensitive display, and wherein contacting said multi-touch display at two separate locations and decreasing the distance between said contact locations while maintaining contact with said display triggers said video command application to generate a zoom-out command instruction transmitted to said video camera to cause said video camera to zoom-out at a location in the camera's view centered between said contact locations.

### Claim 8 (depends on 3)

The apparatus of claim 3, wherein said touch sensitive display is a multi-touch sensitive display, and wherein tapping said multi-touch display with two points of contact at a first location triggers said video command application to generate a zoom-in command instruction transmitted to said video camera to cause said video camera to zoom-in a pre-set zoom level for each time said first location is contacted by the two points of contact, and wherein tapping said multi-touch display with two points of contact at a second location triggers said video command application to generate a zoom-out command instruction transmitted to said video camera to cause said video source to zoom-out the pre-set zoom level for each time said second location is contacted by the two points of contact.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein said first location is an area located at an upper end of said multi-touch display screen and said second location is an area located at a lower end of said multi-touch display screen.

### Claim 10 (depends on 3)

The apparatus of claim 3, wherein said user contact is a dragging movement on said displayed video image on said touch-sensitive display, said dragging movement having a drag direction, and wherein said dragging movement triggers said video command application to generate a command to cause a said video camera to move in the direction of drag relative to the displayed video image.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein said camera movement continues in the direction of dragging movement until said dragging movement terminates.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein an icon is generated on said touch sensitive display at a last location of said user contact with said display in response to said dragging movement, and wherein said camera movement continues until user contact with said icon terminates.

### Claim 13 (depends on 2)

The apparatus of claim 2, wherein said video data includes at least video images, and wherein said video command application is operable to permit a user to pause, rewind, or fast forward the video images from said single displayed video source, and generate a command to pause, fast forward, or rewind said video images of said off-screen video sources simultaneously and in a time synchronized fashion with said paused, rewound, or fast-forwarded single displayed video source.

### Claim 14 (depends on 2)

The apparatus of claim 2, wherein said video command application groups said plurality of video sources into a plurality of groups, said simultaneous display displaying only video data of a single group.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein said video data includes at least video images, and wherein said video command application is operable to permit a user to pause, rewind, or fast forward the video images from a first displayed video sources in said displayed single group and, and generate a command to pause, fast forward, or rewind said video images of said remaining video sources in said displayed single group simultaneously and in a time synchronized fashion with said paused, rewound, or fast-forwarded first displayed video source.

### Claim 16 (depends on 14)

The apparatus of claim 14, wherein said video command application is operable to flip pages of video data in a group, and wherein said video command application updates non-displayed video fields of the group on a periodic basis.

### Claim 17 (depends on 1)

The apparatus of claim 1, wherein said mobile client is a first mobile client, and further comprising:
a further mobile client having a touch sensitive display and being operable to connect to a wireless network over which is available video data, said further mobile client being operable to transmit video source configuration information to said first mobile client; and
said first mobile client being operable to receive the video source configuration information and to display video data of the video source corresponding to the transmitted video source configuration information.

### Claim 18 (depends on 1)

The apparatus of claim 1, wherein said video command application is operable to display on said touch sensitive display at least one of a real-time frame rate and data rate of the video data for each of the plurality of video sources having video data displayed on said touch sensitive display.

### Claim 19 (depends on 1)

The apparatus of claim 1, wherein said video data includes recorded video images, and wherein said video command application is operable to permit control of playback of said recorded video images by user contact with said touch sensitive display.

### Claim 20

A method of displaying and controlling video data on a mobile client, comprising the steps of:
receiving video data, including at least a video feed, over a network connection from a plurality of video sources;
displaying the video data as a simultaneous display of a plurality of video fields on a display panel of the mobile client;
controlling directional movement and video feed rewind of at least one of the plurality of video sources in response to touch contact of the display panel by a user;
monitoring latency over the network connection, said monitoring being performed by at least one of the mobile client or a server; and
transmitting a command from at least one of the mobile client or the server to a video source to reduce data volume of video data carried over the network if the latency exceeds a predetermined threshold, wherein said command to reduce data volume includes at least one of: reduce resolution of the video signal, increase compression of the video signal, and reduce frame rate of the video signal.

### Claim 21 (depends on 20)

The apparatus of claim 20, further comprising the steps of:
sensing a predetermined condition at a location;
generating a real time alert associated with the predetermined condition;
transmitting the real time alert to a user of a mobile client;
transmitting video source configuration information to the mobile client, the video source configuration information being for video sources providing video data at the location;
activating a video field on the mobile client for the video source at the location; and
displaying the video data of the location on the mobile client.
