# US 2009/0222730 A1 · Caching graphical interface for displaying video and ancillary data from a saved video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0222730 A1
- Document ID: US20090222730A1
- Status: Published application
- Kind: A1
- Application number: 12/426,680
- Filed: 2009-04-20
- Published: 2009-09-03
- Earliest claimed: 2001-06-11
- Assignees: ArrowSight, Inc.
- Inventors: Lambert WIXSON; Mark WAYMAN; Alex GULYANSKY; Jeff ROBERTS; Adam ARONSON; Kassim CHAUDRY; Kate RAFFERTY; Julie SHIMSHACK
- Web page: https://patentgrep.com/patent/US20090222730A1

## CPC

- H04N 7/17318: {Direct or substantially direct transmission and handling of requests}
- H04N 21/4143: {embedded in a} Personal Computer [PC]
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system and a method for attaining a selectable image sequence are provided. The system includes a viewer display component configured to transmit a request from a user's interface component for the selectable image sequence. The request obtains a handle which corresponds to the selectable image sequence, a display description in which the handle is embedded and a reply response containing the handle that corresponds to the selectable image. The viewer display component is also configured to receive the reply response and to render the selectable image sequence on a display screen of the user's interface component.

## Claims

### Claim 1

A method of allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, said method comprising the steps of:
transmitting a request from a first user interface component, wherein the request specifies a time range, a desired spacing, and at least one camera from said multiple cameras, said request causes the stored video data to be processed dynamically to identify a subset of frames recorded from said at least one camera, said subset of frames having time-stamps that span the specified range, and causing a handle to be generated for each frame of said subset of frames, said handle usable to retrieve each frame from said stored video data;
retrieving said set of frames based on said handles and rendering a display interface that displays said set of frames and a second user interface corresponding to each frame in the set of frames, wherein the second user interface presents a set of new user-selectable requests that subdivide the specified time range into a plurality of sub-time ranges, each sub-time range corresponding to a time range between the time-stamps of each frame of said subset of frames; and
drilling down through the subset of frames by selecting a sub-time range of said plurality of sub-time ranges; wherein the transmitting step and rendering step are repeated based on the selected sub-time range.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein each handle comprises a pointer to a memory location of said stored video data corresponding to each frame of said subset of frames, respectively.

### Claim 3 (depends on 1)

The method as recited in claim 1, wherein said transmitting step transmits said request to a server component, which processes said request to generate said handles and transmits said handles to said user interface.

### Claim 4 (depends on 3)

The method as recited in claim 3, wherein the server component comprises a video server which configured to maintain and serve said stored video data.

### Claim 5 (depends on 3)

The method as recited in claim 3, further including a step of caching data in a data cache.

### Claim 6 (depends on 5)

The method as recited in claim 5, wherein the data cache resides on the server component.

### Claim 7 (depends on 5)

The method as recited in claim 5, wherein the data cache resides on a viewer display component.

### Claim 8 (depends on 7)

The method as recited in claim 7, wherein the image retrieval invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the viewer display component.

### Claim 9 (depends on 5)

The method as recited in claim 5, wherein the image retrieval invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the data cache.

### Claim 10 (depends on 5)

The method as recited in claim 5, wherein the image retrieval invokes retrieval of a portion of the data for the subset of frames from the data cache if the user requests multiple selectable image sequences having overlapping time periods and if a portion of the data for any of the selectable image sequences was previously stored in the data cache.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the request further specifies a number of frames in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data.

### Claim 12 (depends on 1)

The method according to claim 1, further comprising a step of providing a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera; and
selecting a business rule request from said number of pre-defined requests;
wherein said transmitting step and said rendering step are performed for said selected business rule request.

### Claim 13 (depends on 12)

The method according to claim 12, wherein each business rule request defines a set of time intervals.

### Claim 14 (depends on 12)

The method according to claim 12, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 15 (depends on 3)

The method as recited in claim 3, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 16 (depends on 3)

The method as recited in claim 3, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.

### Claim 17

A system for allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, the system comprising:
a viewer display component configured to transmit a request from a first user interface component, wherein the request specifies a time range, a desired spacing, and at least one camera from said multiple cameras, said request causes the stored video data to be processed dynamically to identify a subset of frames recorded from said at least one camera, said subset of frames having time-stamps that span the specified range, and causing a handle to be generated for each frame of said subset of frames, said handle usable to retrieve each frame from said stored video data; and
the viewer display component is configured to receive the generated handles and to render a display interface based on said handles that contains said subset of frames and a plurality of second user interfaces, a second user interface corresponding to each frame in the set of frames, wherein the second user interface presents a set of new user-selectable requests that subdivide the specified time range into a plurality of sub-time ranges, each sub-time range corresponding to a time range between the time-stamps of each frame of said subset of frames,
wherein the viewer display component is further configured to allow a drilling-down through the subset of frames by selecting a sub-time range of said plurality of sub-time ranges, transmitting the selected sub-time range and rendering a second subset of frames based on the selected sub-time range.

### Claim 18 (depends on 17)

The system as recited in claim 17, wherein each handle comprises a pointer to a memory location of said stored video data corresponding to each of said subset of frames, respectively.

### Claim 19 (depends on 17)

The system as recited in claim 17, a server component processes said request to generate said handles and transmits said handles to said user interface.

### Claim 20 (depends on 19)

The system as recited in claim 19, wherein the server component comprises a video server which configured to maintain and serve said stored video data.

### Claim 21 (depends on 19)

The system as recited in claim 19, wherein said video display component includes a data cache for caching at least a portion of said subset of frames.

### Claim 22 (depends on 19)

The system as recited in claim 19, wherein said server component includes a data cache for caching at least a portion of said subset of frames.

### Claim 23 (depends on 21)

The system as recited in claim 21, wherein the image retrieval invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the viewer display component.

### Claim 24 (depends on 22)

The system as recited in claim 22, wherein the image retrieval invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the data cache.

### Claim 25 (depends on 19)

The system as recited in claim 19, wherein the image retrieval invokes retrieval of a portion of the data for the subset of frames from the data cache if the user requests multiple sets of frames having overlapping time periods and if a portion of the data for multiple sets of frames was previously stored in the data cache.

### Claim 26 (depends on 17)

The system according to claim 17, wherein the user interface component is configured to generate the request further specifying a number of frames in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data.

### Claim 27 (depends on 17)

The system according to claim 17, wherein said user interface component allows a user to select from a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera, and to transmit the selected business rule request and render the subset of frames based on the selected business rule request.

### Claim 28 (depends on 27)

The system according to claim 27, wherein each business rule request defines a set of time intervals.

### Claim 29 (depends on 27)

The system according to claim 27, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 30 (depends on 19)

The system as recited in claim 19, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 31 (depends on 19)

The system as recited in claim 19, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.

### Claim 32

A system for allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, the system comprising:
a viewer display means for transmitting a request from a first user interface means for providing an interface for a user with said system, wherein the request specifies a time range, a desired spacing, and at least one camera from said multiple cameras, said request obtains a set of generated handles which corresponds to a set of frames of said stored video data, said subset of frames having been recorded from said at least one camera and having time-stamps that span the specified time range, and
the viewer display means also is for receiving the generated handle and rendering a display interface based on said handle that contains said subset of frames and a plurality of second user interfaces, a second user interface corresponding to each frame in the set of frames, wherein the second user interface presents a set of new requests that subdivide the specified time range into a plurality of sub-time ranges, each sub-time range corresponding to a time range between the time-stamps of each frame of said subset of frames,
wherein the viewer display means is further for allowing a drilling-down through the subset of frames by selecting a sub-time range of said plurality of sub-time ranges, transmitting the selected sub-time range and rendering a subset of frames based on the selected sub-time range.

### Claim 33 (depends on 32)

The system as recited in claim 32, wherein the handle comprises a pointer to a memory location of said stored video data corresponding to said set of frames.

### Claim 34 (depends on 32)

The system as recited in claim 32, a server means for processing and serving the stored video data processes said request to generate said handle and transmits said handle to said user interface.

### Claim 35 (depends on 34)

The system as recited in claim 34, wherein the server means comprises a video server which is configured to maintain and serve said stored video data.

### Claim 36 (depends on 34)

The system as recited in claim 34, wherein said video display means includes a data cache means for caching at least a portion of said set of frames.

### Claim 37 (depends on 34)

The system as recited in claim 34, wherein said server means includes a data cache for caching at least a portion of said subset of frames.

### Claim 38 (depends on 36)

The system as recited in claim 36, wherein the image retrieval invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the viewer display means.

### Claim 39 (depends on 37)

The system as recited in claim 37, wherein the image retrieval invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the data cache means.

### Claim 40 (depends on 34)

The system as recited in claim 34, wherein the image retrieval invokes retrieval of a portion of the data for the selectable image sequence from the data cache if the user requests multiple sets of images having overlapping time period and if a portion of the data for multiple sets of images was previously stored in the data cache means.

### Claim 41 (depends on 32)

The system according to claim 32, wherein the user interface means is further for generating the request further specifying a number of images in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data.

### Claim 42 (depends on 32)

The system according to claim 32, wherein said user interface means is further for allowing a user to select from a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera, and to transmit the selected business rule request and render the subset of frames based on the selected business rule request.

### Claim 43 (depends on 42)

The system according to claim 42, wherein each business rule request defines a set of time intervals.

### Claim 44 (depends on 42)

The system according to claim 42, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 45 (depends on 34)

The system as recited in claim 34, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 46 (depends on 34)

The system as recited in claim 34, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.

### Claim 47

A method of allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, said method comprising the steps of:
receiving a request specifying a time range, a desired spacing, and at least one camera from said multiple cameras;
dynamically processing the stored video data to identify a subset of frames recorded from said at least one camera and having time-stamps that span the specified time range at the specified spacing,
generating one handle for each frame, that can be used to retrieve said each frame;
sending a reply response containing the handles;
displaying a set of frames based on the request and a plurality of second user interfaces, a second user interface corresponding to each frame in the set of frames, wherein each second user interface presents a set of new user-selectable requests that sub-divide the specified time range into a plurality of sub-time ranges; and
drilling down through the subset of frames by selecting a sub-time range with said specified time range; wherein the receiving, generating, and sending steps are repeated based on the selected sub-time range.

### Claim 48 (depends on 47)

The method as recited in claim 47, wherein each handle comprises a pointer to a memory location of said stored video data corresponding to said subset of frames, respectively.

### Claim 49 (depends on 47)

The method as recited in claim 47, wherein the step of generating a handle includes a step of querying a database to determine time-stamps of a subset of frames having been recorded from said at least one camera most closely corresponding to the specified time range.

### Claim 50 (depends on 47)

The method according to claim 47 further comprising steps of:
providing a video server configured to record and maintain said stored video data; and
downloading said subset of frames from said video server corresponding to said handles.

### Claim 51 (depends on 50)

The method as recited in claim 50, further including the step of caching at least a portion of data of said subset of frames in a data cache.

### Claim 52 (depends on 51)

The method as recited in claim 51, wherein the data cache resides on a server component.

### Claim 53 (depends on 51)

The method as recited in claim 51, wherein the data cache resides on a viewer display component.

### Claim 54 (depends on 51)

The method as recited in claim 51, wherein the step of downloading said images invokes spatial or temporal reconstruction if signals of the subset of frames are sampled with different sampling rates and if a portion of the data for the subset of frames was previously stored in the data cache.

### Claim 55 (depends on 51)

The method as recited in claim 51, wherein the step of downloading said subset of frames invokes retrieval of a portion of the data for the subset of frames from the data cache if requests for multiple sets of frames having overlapping time periods and if a portion of the data for any sets of frames were previously stored in the data cache.

### Claim 56 (depends on 50)

The method as recited in claim 50, wherein the step of generating the handles comprises retrieving a handle from a handle data cache.

### Claim 57 (depends on 47)

The method according to claim 47, wherein the request further specifies a number of frames in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data.

### Claim 58 (depends on 47)

The method according to claim 47, further comprising a step of providing a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera; and
wherein said request includes a selected a business rule request from said number of pre-defined requests;
wherein the receiving, generating, and sending steps are performed for said selected business rule request.

### Claim 59 (depends on 58)

The method according to claim 58, wherein each business rule request defines a set of time intervals.

### Claim 60 (depends on 58)

The method according to claim 58, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 61 (depends on 50)

The method as recited in claim 50, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 62 (depends on 50)

The method as recited in claim 50, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.

### Claim 63

A system for allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, the system comprising:
a server component configured to receive a request specifying a time range, a desired spacing, and at least one camera from said multiple cameras, to dynamically process the stored video data to identify a subset of frames recorded from said at least one camera and having time-stamps that span the specified time range at the specified spacing, to generate one handle for each frame, that can be used to retrieve said each frame, and to send a reply response containing the generated handles; and
a display component configured to display a set of frames based on the request and a plurality of second user interfaces, a second user interface corresponding to each frame in the set of frames, wherein each second user interface presents a set of new user-selectable requests that sub-divide the specified time range into a plurality of sub-time ranges,
wherein the server component is further configured to allow a drilling-down through the subset of frames by selecting a sub-time range within said specified time range, transmitting the selected sub-time range and rendering a subset of frames based on the selected sub-time range.

### Claim 64 (depends on 63)

The system as recited in claim 63, wherein said server component is coupled with a network and said request is received via said network.

### Claim 65 (depends on 63)

The system as recited in claim 63, wherein the handle comprises a pointer to a memory location of said stored video data corresponding to said subset of frames.

### Claim 66 (depends on 63)

The system as recited in claim 63, further comprising:
a video server component for recording and maintaining said stored video data.

### Claim 67 (depends on 63)

The system as recited in claim 63, wherein the system is configured to cache video data of said subset of frames in a data cache.

### Claim 68 (depends on 67)

The system as recited in claim 67, wherein the data cache resides on said server component.

### Claim 69 (depends on 63)

The system according to claim 63, wherein the request further specifies a number of images in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data,
and said server component is configured to generate a set of handles based on said request.

### Claim 70 (depends on 63)

The system according to claim 63, wherein said server component is further configured to provide a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera, and to generate said handle based on the selected business rule request.

### Claim 71 (depends on 70)

The system according to claim 70, wherein each business rule request defines a set of time intervals.

### Claim 72 (depends on 70)

The system according to claim 70, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 73 (depends on 63)

The system as recited in claim 63, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 74 (depends on 63)

The system as recited in claim 63, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.

### Claim 75

A system for allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, the system comprising:
a server component means for receiving a request specifying a time range, a desired spacing, and at least one camera from said multiple cameras, for dynamically processing the stored video data to identify a subset of frames recorded from said at least one camera and having time-stamps that span the specified time range at the specified spacing, for generating one handle for each frame, that can be used to retrieve said each frame, and for sending a reply response containing the generated handles; and
display component means for displaying a set of frames based on the request and a plurality of second user interfaces, a second user interface corresponding to each frame in the set of frames, wherein each second user interface presents a set of new user-selectable requests that sub-divide the specified time range into a plurality of sub-time ranges,
wherein said server means is for allowing a drilling-down through the subset of frames by selecting a sub-time range of a plurality of sub-time ranges, and transmitting the selected sub-time range and rendering a subset of frames based on the selected sub-time range.

### Claim 76 (depends on 75)

The system as recited in claim 75, wherein said server means is coupled with a network and said request is received via said network.

### Claim 77 (depends on 75)

The system as recited in claim 75, wherein the handle comprises a pointer to a memory location of said stored video data corresponding to said subset of frames.

### Claim 78 (depends on 75)

The system as recited in claim 75, further comprising:
a video server means for recording and maintaining said stored video data.

### Claim 79 (depends on 75)

The system as recited in claim 75, wherein the system is configured to cache video data of said subset of frames in a data cache.

### Claim 80 (depends on 79)

The system as recited in claim 79, wherein the data cache resides on said server means.

### Claim 81 (depends on 75)

The system according to claim 75, wherein the request further specifies a number of images in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data,
and said server means is for generating a set of handles based on said request.

### Claim 82 (depends on 75)

The system according to claim 75, wherein said server means is for providing a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera, and to generate said handle based on the selected business rule request.

### Claim 83 (depends on 82)

The system according to claim 82, wherein each business rule request defines a set of time intervals.

### Claim 84 (depends on 83)

The system according to claim 83, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 85

A system of obtaining selectable image sequences, comprising:
receiving means for receiving a business rule request for the selectable image sequences, wherein the business rule requests a set of selectable image sequences;
handle obtaining means for obtaining handles for each of the selectable image sequences in the set of selectable image sequences based upon the user's business rule request;
display description generating means for generating a display description in which the handles for each of the selectable image sequences are embedded;
reply response generating means for constructing a reply response containing the display description with the embedded handles that correspond to the selectable image sequences;
sending means for sending the reply response containing the display description with the embedded handles; and
display means for displaying a set of frames based on the request and a plurality of second user interfaces, a second user interface corresponding to each frame in the set of frames, wherein each second user interface presents a set of new user-selectable requests that sub-divide the specified time range into a plurality of sub-time ranges,
wherein the display means is further for allowing a drilling-down through the subset of sub-time ranges, transmitting the selected sub-time range and rendering a subset of frames based on the selected sub-time range.

### Claim 86 (depends on 85)

The method as recited in claim 85, wherein the step of rendering the display description renders the selectable image sequence.

### Claim 87 (depends on 85)

The method as recited in claim 85, wherein the business rule request defines a set of video sources.

### Claim 88 (depends on 85)

The method as recited in claim 85, wherein the business rule request defines a set of time intervals.

### Claim 89 (depends on 85)

The method as recited in claim 85, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 90 (depends on 85)

A method as recited in claim 85, wherein the handle generation steps further comprises:
retrieving the subset of frames from the database;
reassembling the subset of frames into a new data format sequences,
storing the new data format sequences in a data cache located on the server component; and
generating a handle for each subset of frames, wherein the handle causes the server component to retrieve each new format sequence.

### Claim 91 (depends on 90)

A method as recited in claim 90, wherein the reassembling step further comprises:
transcoding the subset of frames from a first compression format to another compression format.

### Claim 92 (depends on 90)

A method as recited in claim 90, wherein the reassembling step further comprises:
writing the subset of frames as separate files located outside of a video database.

### Claim 93 (depends on 47)

A method as recited in claim 47, wherein the generating further comprises:
generating a hash code for each subset of frames wherein the hash code causes the server component to retrieve selected image sequence.

### Claim 94

A system for allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, the system comprising:
a user interface component configured to provide a graphic user interface and to render images coupled with a network;
a server component coupled with said network;
a plurality of cameras coupled with a video server component, said video server component being coupled with said server component;
wherein said user interface component is configured to generate a request specifying a time range, a desired spacing, and at least one camera from said plurality of cameras, and transmit said request to said server component,
said server component is configured to receive said request, to dynamically process the stored video data to identify a subset of frames recorded from said at least one camera and having time-stamps that span the specified time range at the specified spacing, to generate one handle for each frame, that can be used to retrieve said each frame, and to send a reply response containing the generated handles to said client interface, and
said user interface component is configured to retrieve and display said subset of frames based upon said handles and to display a plurality of second user interfaces, a second user interface corresponding to each frame in the subset of frames, wherein each second user interface presents a set of new user-selectable requests that sub-divide the specified time range into a plurality of sub-time ranges,
wherein said video display component is further configured to allow a drilling-down through the subset of frames by selecting a sub-time range of a plurality of sub-time ranges, transmitting the selected sub-time range and rendering a second subset of frames based on the selected sub-time range.

### Claim 95 (depends on 94)

The system as recited in claim 94, wherein each handle comprises a pointer to a memory location of said stored video data corresponding to each of said subset of frames, respectively.

### Claim 96 (depends on 94)

The system as recited in claim 94, a server component processes said request to generate said handles and transmits said handles to said user interface.

### Claim 97 (depends on 96)

The system as recited in claim 96, wherein the server component comprises a video server which configured to maintain and serve said stored video data.

### Claim 98 (depends on 96)

The system as recited in claim 96, wherein said video display component includes a data cache for caching at least a portion of said subset of frames.

### Claim 99 (depends on 96)

The system as recited in claim 96, wherein said server component includes a data cache for caching at least a portion of said subset of frames.

### Claim 100 (depends on 98)

The system as recited in claim 98, wherein the request invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the viewer display component.

### Claim 101 (depends on 99)

The system as recited in claim 99, wherein the request invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the data cache.

### Claim 102 (depends on 98)

The system as recited in claim 98, wherein the request invokes retrieval of a portion of the data for the subset of frames from the data cache if the user requests multiple sets of frames having overlapping time periods and if a portion of the data for multiple sets of frames was previously stored in the data cache.

### Claim 103 (depends on 94)

The system according to claim 94, wherein the user interface component is configured to generate the request further specifying a number of frames in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data.

### Claim 104 (depends on 94)

The system according to claim 94, wherein said user interface component allows a user to select from a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera, and to transmit the selected business rule request and render the subset of frames based on the selected business rule request.

### Claim 105 (depends on 104)

The system according to claim 104, wherein each business rule request defines a set of time intervals.

### Claim 106 (depends on 104)

The system according to claim 104, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 107 (depends on 96)

The system as recited in claim 96, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 108 (depends on 96)

The system as recited in claim 96, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.

### Claim 109

A method for allowing a user to select a video sequence from stored video data from multiple cameras, said stored video being time-stamped, the method comprising:
generating a request that specifies a time range, a desired spacing, and at least one camera from said multiple cameras;
processing the stored video data dynamically to identify a subset of frames recorded from said at least one camera, said subset of frames having time-stamps that span the specified range;
generating a handle for each frame of said subset of frames, said handle usable to retrieve each frame from said stored video data which corresponds to a subset of frames of said stored video data;
displaying said subset of frames based on said generated handle and a plurality of second user interfaces, a second user interface corresponding to each frame in the subset of frames, wherein each second user interface presents a set of new user-selectable requests that sub-divide the specified time range into a plurality of sub-time ranges; and
drilling down through the subset of frames by selecting a sub-time range of a plurality of sub-time ranges; wherein the transmitting step and rendering step are repeated based on the selected sub-time range.

### Claim 110 (depends on 109)

The method as recited in claim 109, wherein each handle comprises a pointer to a memory location of said stored video data corresponding to each frame of said subset of frames, respectively.

### Claim 111 (depends on 109)

The method as recited in claim 109, wherein said processing step is executed on a server component.

### Claim 112 (depends on 111)

The method as recited in claim 111, wherein the server component comprises a video server which is configured to maintain and serve said stored video data.

### Claim 113 (depends on 111)

The method as recited in claim 111, further including a step of caching data in a data cache.

### Claim 114 (depends on 113)

The method as recited in claim 113, wherein the data cache resides on the server component.

### Claim 115 (depends on 113)

The method as recited in claim 113, wherein the data cache resides on a viewer display component.

### Claim 116 (depends on 115)

The method as recited in claim 115, wherein the request invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the viewer display component.

### Claim 117 (depends on 113)

The method as recited in claim 113, wherein the request invokes partial transmission of data if a spatial or temporal portion of data for the subset of frames was previously stored in the data cache.

### Claim 118 (depends on 113)

The method as recited in claim 113, wherein the request invokes retrieval of a portion of the data for the subset of frames from the data cache if the user requests multiple selectable image sequences having overlapping time periods and if a portion of the data for any of the selectable image sequences was previously stored in the data cache.

### Claim 119 (depends on 109)

The method according to claim 109, wherein the request further specifies a number of frames in the subset of frames to return as the reply, a resolution parameter specifying the spatial resolution of each image, a video content specification associated with the content of the stored video data, a video activity specification associated with the activity of the stored video data, and a telemetry data specification associated with the stored video data.

### Claim 120 (depends on 109)

The method according to claim 109, further comprising a step of providing a number of pre-defined requests as business rule requests, each of which specify pre-defined criteria including a time range, a desired spacing, and at least one camera; and
selecting a business rule request from said number of pre-defined requests;
wherein said transmitting step and said rendering step are performed for said selected business rule request.

### Claim 121 (depends on 120)

The method according to claim 120, wherein each business rule request defines a set of time intervals.

### Claim 122 (depends on 120)

The method according to claim 120, wherein the business rule request includes at least one criterion of a video content, video motion or telemetry associated with the video source.

### Claim 123 (depends on 111)

The method as recited in claim 111, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a temporary image file generated on the server in response to the request.

### Claim 124 (depends on 111)

The method as recited in claim 111, wherein each handle includes a string, generated by the server, that encodes a filename corresponding to a permanent video file on the server, together with an offset into that file where a frame is located.
