# US 2016/0366372 A1 · Mobile body system, control apparatus and method for controlling a mobile body > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0366372 A1 - Document ID: US20160366372A1 - Status: Published application - Kind: A1 - Application number: 15/055,675 - Filed: 2016-02-29 - Published: 2016-12-15 - Earliest claimed: 2015-06-12 - Assignees: Sharp Kabushiki Kaisha - Applicants: Sharp Kabushiki Kaisha - Inventors: Tatsuro KURODA - Web page: https://patentgrep.com/patent/US20160366372A1 ## CPC - H04N 7/185: {from a mobile camera, e.g. for remote control} - H04N 5/93: Regeneration of the television signal or of selected parts thereof - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A mobile body photographs an image with a camera while moving, and transmits to a control apparatus image data representing the photographed image and state information indicating the state thereof including the location thereof. The control apparatus displays a map including a moving range of the mobile body on a display unit and overlays a route of the mobile body on the map to display the route. The control apparatus detects an occurrence of an event such as finding of an intruder and the location of the mobile body at the time of the occurrence of the event, based on the received image data and state information, and displays a marker indicating the detected location over the map. Whenever an event occurs, an additional marker is displayed over the map and the history of the past events is recorded on the map. Therefore, it enables to grasp the place where an event occurs to take a preventive measure for the event. ## Claims ### Claim 1 A control apparatus for controlling a mobile body performing photography, comprising: a receiving part for receiving from the mobile body image data representing a photographed image and a state information indicating a state of the mobile body; a display unit for displaying a map including a moving range of the mobile body; an event detecting part for detecting that a specific event occurs to the mobile body, based on the received image data or the received state information; a location detecting part for detecting a location of the mobile body at the time of the occurrence of the event, based on the state information; and a marker displaying part for displaying on the display unit a marker indicating the location detected by the location detecting part on the map. ### Claim 2 (depends on 1) The control apparatus according to claim 1, wherein a route of the mobile body is displayed over the map on the display unit. ### Claim 3 (depends on 1) The control apparatus according to claim 1, wherein the marker displaying part displays a different marker on the display unit according to details of the event. ### Claim 4 (depends on 1) The control apparatus according to claim 1, further comprising a storage unit in which event information including details of the event and the location is stored. ### Claim 5 (depends on 4) The control apparatus according to claim 4, wherein the event information includes a time when the event detecting part has detected the occurrence of the event. ### Claim 6 (depends on 4) The control apparatus according to claim 4, further comprising: an event information for transmitting to outside the event information; an obtaining part for obtaining statistical result of statistical processing executed for the event information; and a statistical result displaying part for displaying the obtained statistical result on the display unit. ### Claim 7 (depends on 4) The control apparatus according to claim 4, further comprising: a statistical processing part for executing statistical processing for the event information; and a statistical result displaying part for displaying statistical result of the statistical processing executed by the statistical processing part on the display unit. ### Claim 8 (depends on 1) The control apparatus according to claim 1, further comprising a display control part for displaying on the display unit the photographed image represented by the image data simultaneously with the map. ### Claim 9 (depends on 8) The control apparatus according to claim 8, wherein the display control part divides a screen on the display unit, displays the map on one part of the divided screen on the display unit and displays the photographed image on another part of the divided screen. ### Claim 10 (depends on 8) The control apparatus according to claim 8, wherein the display control part displays on the display unit the photographed image simultaneously with the map, when the event detecting part detects the occurrence of the event. ### Claim 11 (depends on 1) The control apparatus according to claim 1, wherein the event detecting part detects a change in a state of the mobile body as an event, based on the state information. ### Claim 12 (depends on 1) The control apparatus according to claim 1, further comprising a route generating part for generating a route for detouring around a part of a predetermined route, wherein the event detecting part detects as an event that the mobile body fails to pass a part of a predetermined route, and the route generating part generates a route for detouring around a specific part of the predetermined route, when the number of occurrences of events that the mobile body fails to pass the specific part is a predetermined number or more. ### Claim 13 (depends on 1) The control apparatus according to claim 1, further comprising an event displaying part for displaying on the display unit an image indicating the occurrence of the event, when the event detecting part detects the occurrence of the event. ### Claim 14 A mobile body system, comprising: a mobile body performing photography; and a control apparatus, wherein the mobile body includes a transmitting part for transmitting to the control apparatus image data presenting a photographed image and state information indicating a state of the mobile body, and the control apparatus includes: a receiving part for receiving the image data and the state information; a display unit for displaying a map including a moving range of the mobile body; an event detecting part for detecting that a specific event occurs to the mobile body based on the received image data or state information; a location detecting part for detecting a location of the mobile body at the time of the occurrence of the event, based on the state information; and a marker displaying part for displaying on the display unit a marker indicating the location detected by the location detecting part on the map. ### Claim 15 (depends on 14) The mobile body system according to claim 14, further comprising: a plurality of the control apparatuses; and a storage apparatus for storing event information including details of the event and the location, the event information is related to the plurality of control apparatuses, wherein each of the plurality of control apparatuses controls the mobile body with a different moving range, the storage apparatus includes a statistical processing part for executing statistical processing for the entire event information related to all of the plurality of control apparatuses or for the event information related to each of the control apparatuses, and the control apparatus further includes: an obtaining part for obtaining from the storage apparatus a statistical result of the statistical processing executed by the statistical processing part; and a statistical result displaying part for displaying the obtained statistical result on the display unit. ### Claim 16 A method for controlling a mobile body performing photography, comprising: displaying on a display unit a map including a moving range of the mobile body; detecting that a specific event occurs to the mobile body based on image data presenting a photographed image or on state information indicating a state of the mobile body; detecting a location of the mobile body at the time of the occurrence of the event, based on the state information; and displaying on the display unit a marker indicating the detected location on the map. ### Claim 17 (depends on 16) The method according to claim 16, further comprising displaying a different marker on the display unit according to details of the event. ### Claim 18 (depends on 16) The method according to claim 16, further comprising: storing event information including details of the event and the location; executing statistical processing for the entire event information related to all of a plurality of mobile bodies or for the event information related to each of the mobile bodies; and displaying statistical result of the statistical processing on the display unit. ### Claim 19 (depends on 16) The method according to claim 16, further comprising: dividing a screen on the display unit; displaying the map on one part of the divided screen on the display unit; and displaying the photographed image on another part of the divided screen. ### Claim 20 (depends on 16) The method according to claim 16, further comprising: detecting as an event that the mobile body fails to pass a part of a predetermined route; and generating a route for detouring around a specific part of the predetermined route, when the number of occurrences of events that the mobile body fails to pass the specific part is a predetermined number or more.