# US 10,313,627 B2 · Apparatus for playing back recorded video images related to event, and method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,627 B2 - Document ID: US10313627B2 - Status: Granted - Kind: B2 - Application number: 15/210,717 - Filed: 2016-07-14 - Published: 2016-11-03 - Granted: 2019-06-04 - Earliest claimed: 2009-04-23 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takashi Oya - Web page: https://patentgrep.com/patent/US10313627B2 ## CPC - H04N 5/91: Television signal processing therefor - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - H04N 5/76: Television signal recording - H04N 7/185: {from a mobile camera, e.g. for remote control} - H04N 21/2743: Video hosting of uploaded data from client - H04N 21/2747: Remote storage of video programmes received via the downstream path, e.g. from the server - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract An apparatus includes a recording unit configured to record a video image, a generation unit configured to generate, when a first type of event in which a state of an object changes is detected from the video image, an index associating the first type and a second type of event related to the first type in the video image, and a playback unit configured to play back, when the first type is specified, a video image concerning the second type corresponding to the specified first type based on the index. ## Claims ### Claim 1 An apparatus comprising: a recording unit configured to record a video image; a detection unit configured to detect an event in which a state of an object changes from the video image; a generation unit configured to generate, when a first type event and one or more second type event related to the first type event are detected from the video image, an index associating the first type event and the one or more second type event; a display unit configured to display a time line on which a plurality of symbols indicating respective events are arranged, wherein a symbol indicating each of the events is arranged in a position corresponding to a time when each of the events occurred; a specifying unit configured to specify an event in response to a selection of a symbol indicating the event by a user; an identification unit configured to identify, when the event of the first type is specified, one or more second type event related to the specified first type event based on the index; and a playback unit configured to play back a video image concerning the identified one or more second type event. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein the detection unit is configured to detect desertion or taking away of an object as the event. ### Claim 3 (depends on 1) The apparatus according to claim 1, wherein the display control unit is configured to change, when a symbol corresponding to an object event is selected from the time line, display forms of symbols indicating object events related to an object which is a subject of the object event corresponding to the selected symbol so as to be distinguishable from other object events on the time line. ### Claim 4 (depends on 1) The apparatus according to claim 1, wherein the playback unit is configured to start, in response to the selection of the symbol, the playback of the video image. ### Claim 5 (depends on 1) The apparatus according to claim 1, wherein the display unit is configured to change a display form of a symbol indicating the specified event. ### Claim 6 (depends on 1) The apparatus according to claim 1, wherein the display unit is configured to change a display form of a symbol indicating the identified event. ### Claim 7 A method comprising: recording a video image; detecting an event in which a state of an object changes from the video image; generating, when the object of event is detected from the video image, event information associating the object event with an identifier of the object and a time when the object event occurred; generating, when a first type event and one or more second type event related to the first type event are detected from the video image, an index associating the first type event and the one or more second type event; displaying a time line on which a plurality of symbols indicating respective events are arranged, wherein a symbol indicating each of the events is arranged in a position corresponding to a time when each of the events occurred; specifying an event in response to a selection of a symbol indicating the event by a user; identifying, when the event of the first type is specified, one or more second type event related to the specified first type event based on the index; and playing back a video image concerning the identified one or more second type event. ### Claim 8 (depends on 7) The method according to claim 7, wherein the detecting includes detecting desertion or taking away of an object as the event. ### Claim 9 (depends on 7) The method according to claim 7, wherein the displaying includes changing, when a symbol corresponding to an object event is selected from the time line, display forms of symbols indicating object events related to an object which is a subject of the object event corresponding to the selected symbol so as to be distinguishable from other object events on the time line. ### Claim 10 (depends on 7) The method according to claim 7, wherein the playing back includes starting, in response to the selection of the symbol, the playback of the video image. ### Claim 11 (depends on 7) The method according to claim 7, wherein the displaying includes changing a display form of a symbol indicating the specified event. ### Claim 12 (depends on 7) The method according to claim 7, wherein the displaying includes changing a display form of a symbol indicating the identified event. ### Claim 13 A non-transitory computer-readable storage medium storing a program for causing a computer to execute a method comprising: recording a video image; detecting an event in which a state of an object changes from the video image; generating, when the object of event is detected from the video image, event information associating the object event with an identifier of the object and a time when the object event occurred; generating, when a first type event and one or more second type event related to the first type event are detected from the video image, an index associating the first type event and the one or more second type event; displaying a time line on which a plurality of symbols indicating respective events are arranged, wherein a symbol indicating each of the events is arranged in a position corresponding to a time when each of the events occurred; specifying an event in response to a selection of a symbol indicating the event by a user; identifying, when the event of the first type is specified, one or more second type event related to the specified first type event based on the index; and playing back a video image concerning the identified one or more second type event. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the detecting includes detecting desertion or taking away of an object as the event. ### Claim 15 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the displaying includes changing, when a symbol corresponding to an object event is selected from the time line, display forms of symbols indicating object events related to an object which is a subject of the object event corresponding to the selected symbol so as to be distinguishable from other object events on the time line. ### Claim 16 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the playing back includes starting, in response to the selection of the symbol, the playback of the video image. ### Claim 17 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the displaying includes changing a display form of a symbol indicating the specified event. ### Claim 18 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the displaying includes changing a display form of a symbol indicating the identified event.