# US 7,196,722 B2 · Multiple camera video system which displays selected images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 7,196,722 B2 - Document ID: US7196722B2 - Status: Granted - Kind: B2 - Application number: 09/860,962 - Filed: 2001-05-18 - Published: 2003-10-23 - Granted: 2007-03-27 - Earliest claimed: 2000-05-18 - Assignees: iMove Inc. - Inventors: Patrick White; Brian Hunt; G. David Ripley - Web page: https://patentgrep.com/patent/US7196722B2 ## CPC - H04N 21/23406: {involving management of server-side video buffer} - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - H04N 7/17318: {Direct or substantially direct transmission and handling of requests} - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 21/2187: Live feed - H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment} - H04N 21/234354: {by altering signal-to-noise ratio parameters, e.g. requantization} - H04N 21/23439: {for generating different versions} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/4314: {for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid} - H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)} - H04N 21/6373: for rate control {, e.g. request to the server to modify its transmission rate (flow control in packet networks H04L47/10)} - H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 23/635: {Region indicators; Field of view indicators} - H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices - H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract Multiple streams of data are streamed to a user's terminal with images from different cameras. Low resolution thumbnail images tell the user what image streams are available. A focus stream provides high resolution images from a selected camera. A user can switch the focus stream to another stream by clicking on the associated thumbnail. The users can also be provided with a thumbnail of panoramic image. Other data streams sent to the user can contain (a) audio data, (b) interactivity markup data which describes regions of the image which provide interactivity opportunities such as hotspots, (c) presentation markup data which defines how data is presented on the user's screen, (d) a telemetry data stream which can be used for various statistical data. One data stream contains a low quality base image for each data stream which can be enhanced to form a high resolution focus image. ## Claims ### Claim 1 A system for displaying to a user a focus stream and a plurality of other video streams, said system comprising, a client system which can display said focus stream, and a composite video containing a thumbnail image of each of said plurality of video streams, each video stream capturing a same scene from a different point of view, said client system displaying said focus stream along with said composite video and a panorama comprising at least two of said plurality of video streams seamed together, a server which receives said composite video stream, and which provides said focus stream and said composite video stream to said client system, and an input device connected to said client system whereby a user can select one of said thumbnails thereby sending a signal to said server indicating which of said plurality of video streams should be sent to said client system as said focus stream. ### Claim 2 (depends on 1) The system recited in claim 1 wherein said server also sends a presentation markup stream to said client machine to control the presentation of images by said client machine. ### Claim 3 (depends on 1) The system recited in claim 1 wherein said server also sends an audio stream to said client machine. ### Claim 4 (depends on 1) The system recited in claim 1 wherein said server also sends an interactivity mark up stream to said client system to describe regions of the presentation that provide additional user interaction with said system. ### Claim 5 (depends on 1) The system recited in claim 1 wherein said server also sends a stream of telemetry data to said client machine. ### Claim 6 (depends on 1) The system recited in claim 1 wherein said server also sends an audio stream, a presentation mark up stream, and an interactive markup stream to said client machine. ### Claim 7 A method of streaming selected data from a plurality of cameras to a client machine comprising the steps of: streaming to said client machine a focus stream containing the images from a particular one of said cameras and a second video stream, each image in which contains a thumbnail of the images from each of said cameras, each video stream capturing a same scene from a different point of view, said client machine displaying said focus stream along with said second video stream and a panorama comprising video streams from at least two of said cameras seamed together, selecting at said client machine one of said thumbnails and responding when a thumbnail from a particular camera is selected by making said focus stream the images from said selected camera. ### Claim 8 (depends on 7) The method recited in claim 7 wherein a presentation mark up stream is sent to said client machine to control the display of images on said client machine. ### Claim 9 (depends on 7) The method recited in claim 7 wherein an audio stream is also sent to said client machine. ### Claim 10 (depends on 7) The method recited in claim 7 wherein an interactivity mark up stream is sent to said client system to describe regions of the presentation that provide additional user interaction with said system. ### Claim 11 (depends on 7) The method recited in claim 7 wherein a stream of telemetry data is also sent to said client machine. ### Claim 12 A method for displaying a plurality of video streams, the method comprising: receiving a focus stream selected from the plurality of video streams, each video stream capturing a same scene from a different point of view; receiving a second stream comprising a thumbnail of at least one of the other video streams, wherein the focus stream has a higher resolution than the thumbnail; displaying the focus stream along with the thumbnail; seaming together at least two of the video streams to form a panorama; and displaying the panorama along with the focus stream and the thumbnail. ### Claim 13 (depends on 12) The method of claim 12 further comprising: sending a signal that the thumbnail has been selected; and as a result of sending said signal, receiving a focus stream comprising the video stream corresponding to the selected thumbnail. ### Claim 14 (depends on 12) The method of claim 12 wherein the second stream comprises a composite video stream comprising thumbnails of at least two of the other video streams. ### Claim 15 (depends on 12) The method of claim 12 wherein the focus stream is a view window into the panorama and the focus stream has a higher resolution than the panorama. ### Claim 16 (depends on 12) The method of claim 12 further comprising: buffering the focus stream in a first buffer; and buffering the second stream in a second buffer. ### Claim 17 (depends on 12) The method of claim 12 further comprising: receiving a background image; and displaying the focus stream and the thumbnail superimposed over the background image. ### Claim 18 (depends on 12) The method of claim 12 wherein display of the focus stream includes hot spots that can be used to activate commands. ### Claim 19 A method for transmitting a plurality of video streams, the method comprising: transmitting to a client a focus stream selected from the plurality of video streams, each video stream capturing a same scene from a different point of view; and transmitting to the client a second stream comprising a thumbnail of at least one of the other video streams, wherein the focus stream has a higher resolution than the thumbnail, and the client displays the focus stream along with the thumbnail and a panorama comprising at least two of the plurality of video streams seamed together. ### Claim 20 A method for displaying a plurality of video streams, the method comprising: receiving a focus stream selected from the plurality of video streams, each video stream capturing a same scene from a different point of view; receiving a second stream comprising a thumbnail of at least one of the other video streams, wherein the focus stream has a higher resolution than the thumbnail; displaying the focus stream along with the thumbnail; seaming together at least two of the video streams to form a panorama; displaying the panorama along with the focus stream and the thumbnail, wherein the focus stream is a view window into the panorama and the focus stream has a higher resolution than the panorama.