# US 2018/0025636 A1 · Systems, apparatuses and methods for detecting driving behavior and triggering actions based on detected driving behavior > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0025636 A1 - Document ID: US20180025636A1 - Status: Published application - Kind: A1 - Application number: 15/722,572 - Filed: 2017-10-02 - Published: 2018-01-25 - Earliest claimed: 2016-05-09 - Assignees: Coban Technologies, Inc. - Applicants: COBAN Technologies, Inc. - Inventors: Terry W. Boykin; Daniel P. Nooner - Web page: https://patentgrep.com/patent/US20180025636A1 ## CPC - H04N 1/2112: {using still video cameras} - B60Q 1/2611: {Indicating devices mounted on the roof of the vehicle} - B60W 40/09: Driving style or behaviour - B60W 40/105: Speed - B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention - G01S 19/42: Determining position - G06V 20/582: {of traffic signs} - G06V 20/584: {of vehicle lights or traffic lights} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)} - G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion} - G08B 13/19621: {Portable camera} - G08B 13/19641: {Multiple cameras having overlapping views on a single scene} - G08B 13/19656: {Network used to communicate with a camera, e.g. WAN, LAN, Internet} - G08B 25/08: using communication transmission lines {(G08B13/19658, G08B21/0286, G08B25/016 take precedence)} - G08G 1/0112: {from the vehicle, e.g. floating car data [FCD]} - G08G 1/052: with provision for determining speed or overspeed {(speed measuring in general G01P)} - G08G 1/096725: {where the received information generates an automatic action on the vehicle control} - G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)} - H04N 7/183: {for receiving images from a single remote source} - H04N 21/2368: Multiplexing of audio and video streams - H04N 21/2743: Video hosting of uploaded data from client - H04N 21/41422: {located in transportation means, e.g. personal vehicle (arrangements specially adapted for transportation systems in broadcast systems H04H20/62)} - H04N 21/4302: {Content synchronisation processes, e.g. decoder synchronisation} - H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/8106: {involving special audio data, e.g. different tracks for different languages} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 23/634: {Warning indications} - H04N 23/635: {Region indicators; Field of view indicators} - H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - B60W 2554/804: Relative longitudinal speed - B60W 2555/60: Traffic rules, e.g. speed limits or right of way - B60W 2556/55: using telemetry - H04R 1/406: {microphones} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract Systems, apparatuses and methods for detecting the presence of certain driving behavior are disclosed. Driving behavior is detected by capturing and characterizing image data and sampling vehicle telemetry data. Real-time characterization techniques include object and shape recognition analytics to detect specifically designated content in captured image data. Actions are triggered based upon such detection. ## Claims ### Claim 1 A system, comprising: a vehicle comprising: at least one camera device configured to capture image data; at least one sensor configured to capture vehicle telemetry data; and a microprocessor linked to the at least one camera device and the at least one sensor, wherein the microprocessor is configured with instructions to detect the occurrence of at least one designated event. ### Claim 2 (depends on 1) The system of claim 1, wherein the at least one sensor configured to capture vehicle telemetry data comprises a GPS device configured to capture location data. ### Claim 3 (depends on 1) The system of claim 1, wherein the at least one sensor configured to capture vehicle telemetry data comprises an accelerometer. ### Claim 4 (depends on 1) The system of claim 1, wherein (i) the at least one designated event comprises aggressive driving, and (ii) the at least one sensor configured to capture vehicle telemetry data comprises an accelerometer. ### Claim 5 (depends on 1) The system of claim 1, wherein (i) the at least one designated event comprises a speed of the vehicle is outside of a speed threshold, and (ii) the at least one sensor configured to capture vehicle telemetry data comprises a speed sensor. ### Claim 6 (depends on 1) The system of claim 1, wherein the at least one designated event comprises at least one of (i) a speed of the vehicle is outside of a speed threshold, (ii) failure to stop at a traffic light, (iii) failure to stop at a stop sign, (iv) a collision, (v) a near collision, (vi) aggressive or reckless driving, and (vii) rollover of the vehicle. ### Claim 7 (depends on 1) The system of claim 1, wherein the at least one designated event comprises acceleration of the vehicle in excess of a predetermined threshold. ### Claim 8 (depends on 1) The system of claim 1, wherein the vehicle further comprises emergency lighting mounted on the vehicle, wherein the action triggered comprises activating the emergency lighting, and wherein the at least one designated event comprises at least one of: (i) a speed of the vehicle is outside of the speed threshold, (ii) an acceleration of the vehicle is in excess of a first predetermined threshold, (iii) the acceleration of the vehicle is in excess of a second predetermined threshold, and (iv) the acceleration of the vehicle is in excess of a third predetermined threshold. ### Claim 9 (depends on 1) The system of claim 1, wherein the microprocessor is further configured with instructions to perform the following: determine a speed of the vehicle from at least one of (i) the image data captured by the at least one camera device, and (ii) the vehicle telemetry data; and determine an applicable speed limit, wherein the at least one designated event comprises the speed of the vehicle is outside of a speed threshold, and wherein the occurrence of the at least one designated event is detected by comparing the determined speed of the vehicle with the determined applicable speed limit. ### Claim 10 (depends on 1) The system of claim 1, wherein the microprocessor is further configured with instructions to trigger an action if the occurrence of at least one designated event is detected. ### Claim 11 (depends on 10) The system of claim 10, wherein the triggered action comprises: recording image data captured by the at least one camera device to internal memory; and bookmarking the at least one designated event in metadata associated with the image data captured by the at least one camera device. ### Claim 12 (depends on 10) The system of claim 10, wherein the triggered action comprises at least one of (i) transmitting an alert to a driver of the vehicle, (ii) activating data recording by the camera device or another device, (iii) transmitting a wireless communication to a remote user, (iv) activating emergency lighting of the vehicle, (v) displaying an image of the at least one designated event, (vi) intervening into driving dynamics of the vehicle, and (vii) bookmarking the at least one designated event in metadata that is associated with the vehicle telemetry data or with the image data captured by the at least one camera device. ### Claim 13 A method, comprising: capturing image data using a camera device, wherein the camera device is mounted to a vehicle; sampling telemetry data from at least one sensor, wherein the at least one sensor is mounted to the vehicle; detecting the occurrence of at least one designated event from at least one of (i) the telemetry data and (ii) the image data. ### Claim 14 (depends on 13) The method of claim 13, wherein the at least one sensor comprises a GPS device configured to capture location data. ### Claim 15 (depends on 13) The method of claim 13, wherein the sampling telemetry data from at least one sensor comprises sampling telemetry data from an accelerometer. ### Claim 16 (depends on 13) The method of claim 13, wherein (i) the at least one designated event comprises aggressive driving, and (ii) the at least one sensor comprises an accelerometer. ### Claim 17 (depends on 13) The method of claim 13, wherein (i) the at least one designated event comprises a speed of the vehicle is outside of a speed threshold, and (ii) the at least one sensor comprises a speed sensor. ### Claim 18 (depends on 13) The method of claim 13, wherein the at least one designated event comprises at least one of (i) a speed of the vehicle is outside of a speed threshold, (ii) failure to stop at a traffic light, (iii) failure to stop at a stop sign, (iv) a collision, (v) a near collision, (vi) aggressive or reckless driving, and (vii) rollover of the vehicle. ### Claim 19 (depends on 13) The method of claim 13, wherein the at least one designated event comprises acceleration in excess of a predetermined threshold. ### Claim 20 (depends on 13) The method of claim 13, further comprising: determining a speed of the vehicle from at least one of (i) the image data, and (ii) the telemetry data; and determining an applicable speed limit, wherein the at least one designated event comprises the speed of the vehicle is outside of a speed threshold, and wherein the occurrence of the at least one designated event is detected also by comparing the determined speed of the vehicle with the determined applicable speed limit. ### Claim 21 (depends on 13) The method of claim 13, wherein the microprocessor is further configured with instructions to trigger an action if the occurrence of the at least one designated event is detected. ### Claim 22 (depends on 21) The method of claim 21, wherein the triggered action comprises: recording the image data captured by the camera device to internal memory; and bookmarking the at least one designated event in metadata associated with the image data captured by the camera device. ### Claim 23 (depends on 21) The method of claim 21, further comprising: wherein the triggered action comprises activating emergency lighting mounted to the vehicle, and wherein the at least one designated event comprises at least one of (i) speed of the vehicle is outside of a speed threshold, (ii) an acceleration of the vehicle exceeds a first predetermined threshold, (iii) the acceleration of the vehicle exceeds a second predetermined threshold, and (iv) the acceleration of the vehicle exceeds a third predetermined threshold. ### Claim 24 (depends on 21) The method of claim 21, wherein the triggered action comprises at least one of (i) transmitting an alert to a driver of the vehicle, (ii) activating data recording by the camera device or another device, (iii) transmitting a wireless communication to a remote user, (iv) activating emergency lighting of the vehicle, (v) displaying an image of the at least one designated event, (vi) intervening into driving dynamics of the vehicle, and (vii) bookmarking the at least one designated event in metadata that is associated with the telemetry data or with the image data captured by the camera device. ### Claim 25 A method comprising: capturing image data using a camera device, wherein the camera device is mounted to a first vehicle; sampling telemetry data from at least one sensor, wherein the at least one sensor is mounted to the first vehicle; determining an applicable speed limit; determining a first speed of the first vehicle using at least one of (i) the image data captured by the camera device mounted to the first vehicle, and (ii) the telemetry data sampled from the at least one sensor mounted on the first vehicle; calculating a relative speed of a second vehicle to the first vehicle using the image data captured by the camera device mounted to the first vehicle; calculating a second speed of the second vehicle by adding together (i) the relative speed of the second vehicle to the first vehicle and (ii) the first speed of the first vehicle; and comparing the second speed of the second vehicle with the applicable speed limit. ### Claim 26 A system comprising: a first vehicle comprising: at least one camera device configured to capture image data; at least one sensor configured to capture vehicle telemetry data; and a microprocessor linked to the at least one camera device and the at least one sensor, wherein the microprocessor is configured with instructions to: determine an applicable speed limit; determine a first speed of the first vehicle using at least one of (i) image data captured by the camera device, and (ii) vehicle telemetry data captured by the at least one sensor, calculate a relative speed of a second vehicle to the first vehicle using the image data captured by the camera device; calculate a second speed of the second vehicle by adding together (i) the relative speed of the second vehicle to the first vehicle and (ii) the first speed of the first vehicle; and compare the second speed of the second vehicle with the applicable speed limit.