# US 10,871,890 B2 · Methods and systems for presenting a camera history

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,871,890 B2
- Document ID: US10871890B2
- Status: Granted
- Kind: B2
- Application number: 16/781,915
- Filed: 2020-02-04
- Published: 2020-06-25
- Granted: 2020-12-22
- Earliest claimed: 2015-06-14
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Melissa McLean; Michael Mizono; Lauren Von Dehsen; Joe Delone Venters; Tracy Kuwatani; Zachery Kennedy; James Edward Stewart
- Web page: https://patentgrep.com/patent/US10871890B2

## CPC

- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0485: Scrolling or panning
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/71: Indexing; Data structures therefor; Storage structures
- G06F 16/7328: {Query by example, e.g. a complete video frame or video sequence (graphical querying G06F16/7335)}
- G06F 16/738: Presentation of query results
- G06F 16/743: {a collection of video files or sequences}
- G06V 10/235: {based on user input or interaction}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G08B 13/196: using television cameras
- G08B 13/19645: {Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over}
- G08B 13/19656: {Network used to communicate with a camera, e.g. WAN, LAN, Internet}
- G08B 13/1966: {Wireless systems, other than telephone systems, used to communicate with a camera}
- G08B 13/19682: {Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system}
- G08B 13/19695: {Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves}
- G11B 27/105: {of operating discs}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 5/77: between a recording apparatus and a television camera
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- G06V 20/44: {Event detection}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.

## Claims

### Claim 1

A method, comprising:
at a client device having a display, one or more processors and memory storing one or more programs for execution by the one or more processors:
displaying a camera event history, wherein the camera event history is presented as a group of event items, each event item corresponding to a set of one or more alert events for which a remote camera has captured an associated video, wherein the event items are chronologically ordered;
for an event item of the group of event items, displaying:
a thumbnail image of the captured video associated with the event item, and
an alert event indicator indicating a type of alert event associated with the event item, wherein the type of alert event associated with the alert event indicator is defined according to a zone in a field of view of the remote camera;
receiving a user selection of at least one of the event items; and
causing the captured video associated with the at least one selected event item to be displayed.

### Claim 2 (depends on 1)

The method of claim 1, wherein the group of event items is a list.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving a user de-selection of the at least one selected event item; and
in response to receiving the user de-selection of the at least one selected event, causing the captured video associated with the at least one selected event item to cease to be displayed.

### Claim 4 (depends on 1)

The method of claim 1, wherein, within the event item, the alert event indicator is visually distinctive from a second alert event indicator.

### Claim 5 (depends on 1)

The method of claim 1, further comprising: displaying, within the event item, information regarding an alert event corresponding to the event item.

### Claim 6 (depends on 1)

The method of claim 1, wherein the event items are chronologically ordered in accordance with a chronology of the associated captured videos.

### Claim 7 (depends on 1)

The method of claim 1, wherein the alert event indicator is chronologically ordered with a second alert event indicator in accordance with a chronology of alert events.

### Claim 8 (depends on 1)

The method of claim 1, wherein:
the alert event is a non-camera event; and
the captured video associated with the event item comprises video captured by the remote camera during the non-camera event.

### Claim 9 (depends on 8)

The method of claim 8, wherein the non-camera event is detected by a non-camera sensor selected from a hazard sensor, a vibration sensor, a motion sensor, and/or a sound sensor.

### Claim 10 (depends on 1)

The method of claim 1, wherein the captured video associated with the event item is contemporaneous with the alert event.

### Claim 11

An electronic device, comprising:
a display;
one or more processors;
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
displaying a camera event history, wherein the camera event history is presented as a group of event items, each event item corresponding to a set of one or more alert events for which a remote camera has captured an associated video, wherein the event items are chronologically ordered;
for an event item of the group of event items, displaying:
a thumbnail image of the captured video associated with the event item, and
an alert event indicator indicating a type of alert event associated with the event item, wherein the type of alert event associated with the alert event indicator is defined according to a zone in a field of view of the remote camera;
receiving a user selection of at least one of the event items; and
causing the captured video associated with the at least one selected event item to be displayed.

### Claim 12 (depends on 11)

The device of claim 11, wherein, within the event item, the alert event indicator is visually distinctive from a second alert event indicator based on color.

### Claim 13 (depends on 11)

The device of claim 11, wherein, within the event item, the alert event indicator is visually distinctive from a second alert event indicator based on shape.

### Claim 14 (depends on 11)

The device of claim 11, further comprising instructions for: displaying, within the event item, information regarding a most recent alert event of the set of one or more alert events corresponding to the event item.

### Claim 15 (depends on 11)

The device of claim 11, wherein the alert event indicator is chronologically ordered with a second alert event indicator in accordance with a chronology of alert events.

### Claim 16

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display and one or more processors, cause the electronic device to perform operations comprising:
displaying a camera event history, wherein the camera event history is presented as a group of event items, each event item corresponding to a set of one or more alert events for which a remote camera has captured an associated video, wherein the event items are chronologically ordered;
for an event item of the group of event items, displaying:
a thumbnail image of the captured video associated with the event item, and
an alert event indicator indicating a type of alert event associated with the event item, wherein the type of alert event associated with the alert event indicator is defined according to a zone in a field of view of the remote camera;
receiving a user selection of at least one of the event items; and
causing the captured video associated with the at least one selected event item to be displayed.

### Claim 17 (depends on 16)

The computer readable storage medium of claim 16, wherein the alert event indicator is selected from a plurality of predefined and visually distinctive alert event indicators.

### Claim 18 (depends on 16)

The computer readable storage medium of claim 16, wherein for the alert event indicator, a corresponding type of alert event associated with the event item is selected from a plurality of predefined types of alert event.

### Claim 19 (depends on 16)

The computer readable storage medium of claim 16, wherein the alert event indicator is displayed with the event item in response to detection of motion inside a zone corresponding to the type of alert event associated with the alert event indicator.

### Claim 20 (depends on 16)

The computer readable storage medium of claim 16, wherein the alert event indicator is displayed with the event item in response to detection of motion outside a zone corresponding to the type of alert event associated with the alert event indicator.
