# US 10,769,901 B2 · Three-dimensional holographic visual and haptic object warning based on visual recognition analysis > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,769,901 B2 - Document ID: US10769901B2 - Status: Granted - Kind: B2 - Application number: 16/372,803 - Filed: 2019-04-02 - Published: 2019-07-25 - Granted: 2020-09-08 - Earliest claimed: 2017-02-03 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: James E. Bostick; John M. Ganci, Jr.; Martin G. Keen; Sarbajit K. Rakshit - Web page: https://patentgrep.com/patent/US10769901B2 ## CPC - G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems - F24C 7/083: {on tops, hot plates} - G03H 1/0005: {Adaptation of holography to specific applications (holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042)} - G03H 1/2249: {Holobject properties} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G08B 5/36: using visible light sources - G03H 2001/0061: {in haptic applications when the observer interacts with the holobject} - G03H 2001/226: {Virtual or real} - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - F24C: DOMESTIC STOVES OR RANGES (exclusively for solid fuels F24B); DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION - G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00}) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Presenting a three-dimensional (3D) holographic visual and haptic warning is provided. An indication that a first individual who needs supervision is approaching a situation is received. A three-dimensional (3D) holographic visual and haptic warning is presented to the first individual who needs supervision prior to the first individual reaching the situation. ## Claims ### Claim 1 A computer-implemented method for presenting a three-dimensional (3-D) holographic visual and haptic warning, the computer-implemented method comprising: receiving, by a computer, an indication that a first individual who needs supervision is approaching a situation; and presenting, by the computer responsive to receiving the indication that the first individual who needs supervision is approaching the situation, the 3-D holographic visual and haptic warning of a potentially dangerous situation to the first individual who needs supervision prior to the first individual reaching the situation, wherein the 3-D holographic visual and haptic warning of the potentially dangerous situation is presented spatially-adjacent to a potentially dangerous object. ### Claim 2 (depends on 1) The computer-implemented method of claim 1 further comprising: receiving, by the computer, an indication that a second individual who does not need supervision is approaching the situation; and refraining, by the computer, from presentation of the three-dimensional (3D) holographic visual and haptic warning to the second individual who does not need supervision. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein the situation is one of a group consisting of the potentially dangerous object and a user-designated object with restricted access. ### Claim 4 (depends on 1) The computer-implemented method of claim 1 further comprising: receiving, by the computer, image data of an area surrounding an object from an image capturing device; and performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, wherein the image data is real time streaming image data of the area surrounding the object. ### Claim 6 (depends on 4) The computer-implemented method of claim 4 further comprising: identifying, by the computer, the object, a current status of the object, a set of individuals in the area surrounding the object, age of each individual in the set, activity of each individual in the set, and direction of movement of each individual in the set based on the analysis of the image data. ### Claim 7 (depends on 6) The computer-implemented method of claim 6 further comprising: determining, by the computer, whether generating the three-dimensional (3D) holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object; and responsive to the computer determining that generating the 3D holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object, determining, by the computer, a size and a shape of the 3D holographic visual and haptic warning to generate between the object and one or more individuals in the set of individuals. ### Claim 8 (depends on 7) The computer-implemented method of claim 7 further comprising: generating, by the computer, the 3D holographic visual and haptic warning between the object and the one or more individuals in the set of individuals in accordance with the determined size and shape using an ultrasound transducer array in the area. ### Claim 9 (depends on 8) The computer-implemented method of claim 8 further comprising: determining, by the computer, whether the generating of the 3D holographic visual and haptic warning is still pertinent to the object based on analyzing new image data of the area surrounding the object; and responsive to the computer determining that the generating of the 3D holographic visual and haptic warning is not pertinent to the object based on the analyzing of the new image data of the area surrounding the object, stopping, by the computer, generation of the 3D holographic visual and haptic warning. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein the computer modifies an intensity of the three-dimensional (3D) holographic visual and haptic warning based on the computer determining a level of danger posed to the first individual by the situation. ### Claim 11 A computer system for presenting a three-dimensional (3-D) holographic visual and haptic warning, the computer system comprising: a bus system; a storage device connected to the bus system, wherein the storage device stores program instructions; and a processor connected to the bus system, wherein the processor executes the program instructions to: receive an indication that a first individual who needs supervision is approaching a situation; and responsive to receiving the indication that the first individual who needs supervision is approaching the situation, present the 3-D holographic visual and haptic warning of a potentially dangerous situation to the first individual who needs supervision prior to the first individual reaching the situation, wherein the 3-D holographic visual and haptic warning of the potentially dangerous situation is presented spatially-adjacent to a potentially dangerous object. ### Claim 12 (depends on 11) The computer system of claim 11, wherein the processor further executes the program instructions to: receive an indication that a second individual who does not need supervision is approaching the situation; and refrain from presentation of the three-dimensional (3D) holographic visual and haptic warning to the second individual who does not need supervision. ### Claim 13 A computer program product for presenting a three-dimensional (3-D) holographic visual and haptic warning, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising: receiving, by a computer, an indication that a first individual who needs supervision is approaching a situation; and presenting, by the computer responsive to receiving the indication that the first individual who needs supervision is approaching the situation, the 3-D holographic visual and haptic warning of a potentially dangerous situation to the first individual who needs supervision prior to the first individual reaching the situation, wherein the 3-D holographic visual and haptic warning of the potentially dangerous situation is presented spatially-adjacent to a potentially dangerous object. ### Claim 14 (depends on 13) The computer program product of claim 13 further comprising: receiving, by the computer, an indication that a second individual who does not need supervision is approaching the situation; and refraining, by the computer, from presentation of the three-dimensional (3D) holographic visual and haptic warning to the second individual who does not need supervision. ### Claim 15 (depends on 13) The computer program product of claim 13, wherein the situation is one of a group consisting of the potentially dangerous object and a user-designated object with restricted access. ### Claim 16 (depends on 13) The computer program product of claim 13 further comprising: receiving, by the computer, image data of an area surrounding an object from an image capturing device; and performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer. ### Claim 17 (depends on 16) The computer program product of claim 16, wherein the image data is real time streaming image data of the area surrounding the object. ### Claim 18 (depends on 16) The computer program product of claim 16 further comprising: identifying, by the computer, the object, a current status of the object, a set of individuals in the area surrounding the object, age of each individual in the set, activity of each individual in the set, and direction of movement of each individual in the set based on the analysis of the image data. ### Claim 19 (depends on 18) The computer program product of claim 18 further comprising: determining, by the computer, whether generating the three-dimensional (3D) holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object; and responsive to the computer determining that generating the 3D holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object, determining, by the computer, a size and a shape of the 3D holographic visual and haptic warning to generate between the object and one or more individuals in the set of individuals. ### Claim 20 (depends on 19) The computer program product of claim 19 further comprising: generating, by the computer, the 3D holographic visual and haptic warning between the object and the one or more individuals in the set of individuals in accordance with the determined size and shape using an ultrasound transducer array in the area. ### Claim 21 (depends on 4) The computer-implemented method of claim 4, wherein the object is an inanimate object, and further comprising: determining whether to present the 3D holographic visual and haptic warning based on the analysis of the area surrounding the inanimate object. ### Claim 22 (depends on 11) The computer system of claim 11, further comprising: an ultrasound transducer array comprising a plurality of ultrasound transducers. ### Claim 23 (depends on 4) The computer-implemented method of claim 4, wherein the object is an inanimate object, and further comprising: determining whether to present the 3-D holographic visual and haptic warning based on the analysis of the area surrounding the inanimate object. ### Claim 24 (depends on 23) The computer-implemented method of claim 23, further comprising: accessing a user profile comprising information corresponding to the first individual and an object access rule associated with the inanimate object. ### Claim 25 (depends on 24) The computer-implemented method of claim 24, further comprising: differentiating between different individuals and potentially dangerous and safe situations in the area surrounding the object.