# US 11,310,466 B2 · Device for monitoring vehicle occupant(s) > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,466 B2 - Document ID: US11310466B2 - Status: Granted - Kind: B2 - Application number: 16/691,633 - Filed: 2019-11-22 - Published: 2021-05-27 - Granted: 2022-04-19 - Earliest claimed: 2019-11-22 - Assignees: Guardian Optical Technologies Ltd. - Applicants: Guardian Optical Technologies Ltd. - Inventors: Yotam Amiram; Yoav Zuta; Guy Raz - Web page: https://patentgrep.com/patent/US11310466B2 ## CPC - H04N 7/183: {for receiving images from a single remote source} - G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings - G06V 20/593: {Recognising seat occupancy} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 23/52: Elements optimising image sensor operation, e.g. for electromagnetic interference [EMI] protection or temperature control by heat transfer or cooling elements - H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils - H04N 23/56: provided with illuminating means - H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A device for monitoring occupants of seats in a passenger compartment of a vehicle comprises a heat sink divided into a plurality of sections. Each of the sections comprises a base and cooling fins. The bases extend along a common axis and define a central niche therebetween. Structured light sources are attached to the sections. The structured light sources have an optical element for forming a structured light pattern. The structured light sources are oriented along the common axis and at oblique angles to the central niche, such that the structured light patterns, in combination, are directed such that they would cover occupants of seats of the vehicle. A camera is attached to the niche and configured to capture image patterns resulting from distortion of the plurality of structured light patterns by the occupants of the seats. ## Claims ### Claim 1 A device for monitoring occupants of seats in a passenger compartment of a vehicle, comprising: a heat sink divided into a plurality of sections, each of the sections comprising a base and a plurality of cooling fins, the bases extending along a common axis and defining a central niche therebetween, wherein the central niche is bordered by a cooling fin of each respective section; a plurality of unstructured light sources, each of the plurality of unstructured light sources attached to one of plurality of sections, wherein the fins of the heat sink protrude from the base in a direction opposite attachment points of the plurality of unstructured light sources; a plurality of structured light sources, each of the plurality of structured light sources attached to one of the plurality of sections and having an optical element for forming a structured light pattern, wherein the plurality of structured light sources are oriented along the common axis and at oblique angles to the central niche, such that the plurality of structured light patterns are non-overlapping and in combination, are directed such that they would cover all occupants of seats of the vehicle; and a camera attached to the niche and configured to capture image patterns resulting from distortion of the plurality of structured light patterns by the occupants of the seats, the camera is further configured to capture video images of an interior of said passenger compartment of the vehicle using illumination of said plurality of unstructured light sources; wherein the base of each section of the heat sink and the niche function as an optical bench for the camera and plurality of structured light sources. ### Claim 2 (depends on 1) The device of claim 1, wherein the plurality of structured light sources comprises two structured light sources, and wherein each of the two light sources transmits a structured light pattern onto approximately half of a field of view of the camera. ### Claim 3 (depends on 1) The device of claim 1, wherein each of the plurality of structured light sources is attachable to the base at a plurality of angular orientations. ### Claim 4 (depends on 1) The device of claim 1, wherein the plurality of unstructured light sources are arranged to illuminate an area targeted with the plurality of structured light patterns. ### Claim 5 (depends on 4) The device of claim 4, wherein the camera extends further outward from the heat sink base than each of the plurality of unstructured light sources. ### Claim 6 (depends on 1) The device of claim 1, further comprising processing circuitry configured to analyze changes in the captured image patterns due to movements of the occupants of the seats. ### Claim 7 (depends on 6) The device of claim 6, wherein the processing circuitry includes a processor remotely connected to the camera via serial communication. ### Claim 8 (depends on 1) The device of claim 1, further comprising a control board for controlling operation of the camera, structured light sources, and unstructured light sources. ### Claim 9 (depends on 1) The device of claim 1, wherein the fins of the heat sink extend in an orientation that is essentially vertical relative to the ground, when the device is installed in a vehicle. ### Claim 10 (depends on 1) The device of claim 1, wherein the heat sink is made of one of aluminum casting, thermo-plastic molding, sheet metal, or a mix thereof. ### Claim 11 (depends on 1) The device of claim 1, wherein the plurality of unstructured light sources and the plurality of structured light sources are controlled to be operating alternately such that said camera is monitoring in continuous sequence safety features tracked using the plurality of structured light sources and safety features tracked using the plurality of unstructured light sources. ### Claim 12 (depends on 1) A motor vehicle including the device of claim 1 attached to a body of an interior cabin thereof. ### Claim 13 A method of monitoring occupants of seats in a passenger compartment of a vehicle, comprising: transmitting a plurality of structured light patterns from a plurality of structured light sources onto occupants of seats of the vehicle, wherein each of the plurality of structured light sources is attached to a base of one of a plurality of heat sinks, wherein each of the heat sinks comprises the base and a plurality of cooling fins, the bases extend along a common axis and define a central niche therebetween, wherein the central niche is bordered by a cooling fin of each respective section, and a plurality of unstructured light sources is attached to each of the plurality of sections, wherein the fins of the heat sink protrude from the base in a direction opposite attachment points of the plurality of unstructured light sources, and the plurality of structured light sources are oriented along the common axis and at oblique angles to the central niche, such that the plurality of structured light patterns are non-overlapping and in combination, are directed such that they would cover all occupants of seats of the vehicles, wherein the base of each section of the heat sink and the niche function as an optical bench for the camera and plurality of structured light sources; capturing, with a camera attached to the niche, image patterns resulting from distortion of the structured light patterns by the occupants of the seats; and capturing, with said camera, video images of an interior of said passenger compartment of the vehicle using illumination of said plurality of unstructured light sources. ### Claim 14 (depends on 13) The method of claim 13, further comprising illuminating, with the plurality of unstructured light sources, an area targeted by the plurality of structured light patterns, and capturing with the camera images of said area illuminated by the unstructured light sources. ### Claim 15 (depends on 13) The method of claim 13, wherein the capturing step comprises capturing image patterns resulting from distortion of the structured light patterns by all of the occupants of the seats. ### Claim 16 (depends on 13) The method of claim 13, wherein the plurality of structured light sources comprises two structured light sources, and wherein the transmitting step comprises transmitting a structured light pattern from each of the two structured light sources onto approximately half of a field of view of the camera. ### Claim 17 (depends on 13) The method of claim 13, further comprising adjusting the angular orientation of one or more of the plurality of structured light sources on the base. ### Claim 18 (depends on 13) The method of claim 13, further comprising analyzing with a processor changes in the captured image patterns due to movements of the occupants of the seats. ### Claim 19 (depends on 13) The method of claim 13, further comprising mounting the device onto a body of the vehicle in a configuration suitable for monitoring occupants of the vehicle.