# US 10,311,304 B2 · Mobile device accident avoidance system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,304 B2 - Document ID: US10311304B2 - Status: Granted - Kind: B2 - Application number: 15/426,121 - Filed: 2017-02-07 - Published: 2018-08-09 - Granted: 2019-06-04 - Earliest claimed: 2017-02-07 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Michael Bender; Santosh S. Borse; Keith R. Walker - Web page: https://patentgrep.com/patent/US10311304B2 ## CPC - G06V 20/20: in augmented reality scenes - G01S 19/13: Receivers - G01S 19/49: whereby the further system is an inertial position system, e.g. loosely-coupled - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) - G08B 5/36: using visible light sources - G08B 21/02: Alarms for ensuring the safety of persons - G08B 21/24: Reminder alarms, e.g. anti-loss alarms - G08B 25/016: {Personal emergency signalling and security systems (emergency non-personal manually actuated alarm activators G08B25/12)} - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 23/63: by using electronic viewfinders - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A system, method and program product for providing accident avoidance for a mobile device having a camera integrated therein. A system is disclosed that includes: a camera orientation device that is mountable on a mobile device and includes a mechanism to reorient a line of sight of the camera in response to detected position information of the mobile device; and an image feed manager adapted to run on the mobile device, wherein the image feed manager includes: an orientation system that detects position information of the mobile device and communicates the position information to the camera orientation device; an image analysis system that analyzes an image feed from the camera to identify hazards; an overlay system that displays the image feed onto a display area of the mobile device; and a warning system that issues an alert in response to an identified hazard. ## Claims ### Claim 1 An accident avoidance system for a mobile device having a camera, comprising: a camera orientation device that is mountable on a mobile device and includes a mechanism to reorient a line of sight of the camera in response to detected position information of the mobile device, wherein the camera orientation device includes at least one movable mirror that can be oriented by a control mechanism in three dimensions and wherein the line of sight of the camera is continuously reoriented substantially parallel to ground in a direction of travel; and an image feed manager adapted to run on the mobile device, wherein the image feed manager includes: an orientation system that detects position information of the mobile device and communicates the position information to the camera orientation device; an image analysis system that analyzes an image feed from the camera to identify hazards; an overlay system that displays the image feed onto a display area of the mobile device; and a warning system that issues an alert in response to an identified hazard. ### Claim 2 (depends on 1) The accident avoidance system of claim 1, wherein the camera orientation device is integrated into a case adapted to fit onto the mobile device. ### Claim 3 (depends on 1) The accident avoidance system of claim 1, wherein the orientation system detects position information from a gyroscope and direction of travel information from a global positioning system (GPS). ### Claim 4 (depends on 1) The accident avoidance system of claim 1, wherein the overlay system further displays supplemental information that includes at least one of satellite image data, drone image feeds, third party camera feeds, map data, or social network data. ### Claim 5 (depends on 1) The accident avoidance system of claim 1, wherein the image analysis system uses object recognition to identify hazards. ### Claim 6 (depends on 5) The accident avoidance system of claim 5, where in the image analysis system further includes a motion detection system that detects moving objects and determines if a moving object will intersect with a user of the mobile device. ### Claim 7 A computer program product stored on a non-transitory computer readable storage medium, which when executed by a computing system, provides accident avoidance for a mobile device, the program product comprising: program code that detects position information of a mobile device and communicates the position information to an externally affixed camera orientation device to reorient a line sight of a camera, wherein the camera orientation device includes at least one movable mirror that can be oriented by a control mechanism in three dimensions, and wherein the position information causes the line of sight of the camera to be reoriented substantially parallel to ground in a direction of travel; program code that analyzes an image feed from the camera to identify hazards; program code that displays the image feed onto a display area of the mobile device, wherein the image feed is displayed along with an active user application; and program code that issues an alert in response to an identified hazard. ### Claim 8 (depends on 7) The program product of claim 7, wherein the camera orientation device is integrated into a case adapted to fit onto the mobile device. ### Claim 9 (depends on 7) The program product of claim 7, wherein the position information is determined from a gyroscope and a direction of travel information is determined from a GPS. ### Claim 10 (depends on 7) The program product of claim 7, further comprising program code that displays supplemental information that includes at least one of satellite image data, drone image feeds, third party camera feeds, map data, or social network data. ### Claim 11 (depends on 7) The program product of claim 7, wherein hazards are identified using object recognition. ### Claim 12 (depends on 11) The program product of claim 11, where hazards are further identified using motion detection. ### Claim 13 An accident avoidance method for a mobile device having a camera, comprising: detecting position information of a mobile device; communicating the position information to a camera orientation device affixed to the mobile device to reorient a line of sight of the camera; analyzing an image feed from the camera to identify hazards; displaying a text messaging application on a display of the mobile device; displaying the image feed in an overlay window along with the text messaging application on the display only when a hazard is identified; and issuing an alert in response to an identified hazard. ### Claim 14 (depends on 13) The method of claim 13, wherein the line of sight of the camera is continuously reoriented substantially parallel to ground in a direction of travel. ### Claim 15 (depends on 14) The method of claim 14, wherein the position information is detected from a gyroscope and the direction of travel information is determined from a GPS. ### Claim 16 (depends on 15) The method of claim 15, wherein hazards are further identified using motion detection. ### Claim 17 (depends on 14) The method of claim 14, further comprising displaying supplemental information that includes at least one of satellite image data, drone image feeds, third party camera feeds, map data, or social network data. ### Claim 18 (depends on 14) The method of claim 14, wherein hazards are identified using object recognition.