# US 2019/0244446 A1 · Instrument cluster monitoring system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244446 A1
- Document ID: US20190244446A1
- Status: Published application
- Kind: A1
- Application number: 16/245,935
- Filed: 2019-01-11
- Published: 2019-08-08
- Earliest claimed: 2018-02-02
- Assignees: DENSO International America, Inc.; Denso Corporation
- Applicants: DENSO International America, Inc.; Denso Corporation
- Inventors: Michael MURZYN
- Web page: https://patentgrep.com/patent/US20190244446A1

## CPC

- G07C 5/0825: {using optical means}
- B60K 35/215: characterised by the combination of multiple visual outputs, e.g. combined instruments with analogue meters and additional displays
- B60K 35/22: Display screens
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/80: Arrangements for controlling instruments
- B60K 35/90: Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
- G07C 5/0808: {Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005)}
- G07C 5/0866: {the electronic data carrier being a digital video recorder in combination with video camera}
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 2360/176: Camera images
- B60K 2360/178: Warnings
- B60K 2360/21: using cameras
- B60K 2360/34: Backlit symbols
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES

## Abstract

Systems and methods for monitoring operation of an instrument cluster configured to display vehicle operating information to a driver. The system includes a camera pointed at the instrument cluster to capture images of operation of the instrument cluster. A control module is in receipt of the images of the instrument cluster. The control module is configured to compare operation of the instrument cluster as captured in the images with predetermined, expected operation of the instrument cluster. A fault condition notification module is configured to generate a fault notice when there is a discrepancy between operation of the instrument cluster as captured in the images and the predetermined, expected operation of the instrument cluster.

## Claims

### Claim 1

A system for monitoring operation of an instrument cluster configured to display vehicle operating information to a driver, the system comprising:
a camera pointed at the instrument cluster to capture images of operation of the instrument cluster;
a control module in receipt of the images of the instrument cluster, the control module configured to compare operation of the instrument cluster as captured in the images with predetermined, expected operation of the instrument cluster; and
a fault condition notification module configured to generate a fault notice when there is a discrepancy between operation of the instrument cluster as captured in the images and the predetermined, expected operation of the instrument cluster.

### Claim 2 (depends on 1)

The system of claim 1, wherein the control module is further in receipt of the vehicle operating information, and the control module is further configured to compare operation of the instrument cluster as captured in the images with the vehicle operating information; and
wherein the fault condition notification module is further configured to generate a fault notice when there is a discrepancy between operation of the instrument cluster as captured in the images and the vehicle operating information.

### Claim 3 (depends on 1)

The system of claim 1, wherein the camera is in a common housing with the instrument cluster

### Claim 4 (depends on 1)

The system of claim 1, wherein the camera captures images of tell-tales of the instrument cluster that convey vehicle operating information to the driver when illuminated.

### Claim 5 (depends on 4)

The system of claim 4, wherein the tell-tales include at least one of the following: a traction control tell-tale; a parking brake light tell-tale; a suspension damper tell-tale; a turn-signal tell-tale; a check engine tell-tale; a power steering tell-tale; a battery warning tell-tale; a low oil pressure tell-tale; a temperature warning tell-tale; a tire pressure warning tell-tale; a high-beam light active tell-tale; a head-lights active tell-tale; a fasten seatbelt tell-tale; a brake system warning tell-tale; a low-fuel tell-tale; an anti-lock brake warning tell-tale; and an airbag warning tell-tale.

### Claim 6 (depends on 4)

The system of claim 4, wherein for each one of the tell-tales the control module is configured to scan a predetermined location of the instrument cluster captured by the camera and identify whether the predetermined area is black or at least partially illuminated; and
wherein the control module determines that the tell-tale is in an off state when the tell-tale is black.

### Claim 7 (depends on 4)

The system of claim 4, wherein for each one of the tell-tales the control module is configured to compare a shape of the tell-tale as captured in the image taken by the camera with an expected shape of the tell-tale; and
wherein the control module determines that the tell-tale has a shape error when the tell-tale captured in the image taken by the camera is shaped different than the expected shape of the tell-tale.

### Claim 8 (depends on 4)

The system of claim 4, wherein for each one of the tell-tales the control module is configured to compare a color of the tell-tale as captured in the image taken by the camera with an expected color of the tell-tale; and
wherein the control module determines that the tell-tale has a color error when the tell-tale captured in the image taken by the camera is colored different than the expected color of the tell-tale.

### Claim 9 (depends on 1)

The system of claim 1, wherein the control module controls the camera to capture the image of the instrument cluster once every 50 ms to 100 ms.

### Claim 10

A method for monitoring operation of an instrument cluster configured to display vehicle operating information to a driver, the method comprising:
capturing images of operation of the instrument cluster with a camera pointed at the instrument cluster;
comparing operation of the instrument cluster as captured in the images with predetermined, expected operation of the instrument cluster, the comparison made by a control module in receipt of the images of the instrument cluster; and
generating a fault notice with a fault condition notification module when there is a discrepancy between operation of the instrument cluster as captured in the images and the predetermined, expected operation of the instrument cluster.

### Claim 11 (depends on 10)

The method of claim 10, further comprising comparing with the control module operation of the instrument cluster as captured in the images with vehicle operating information received by the control module; and
generating a fault notice with the fault condition notification module when there is a discrepancy between operation of the instrument cluster as captured in the images and the vehicle operating information.

### Claim 12 (depends on 10)

The method of claim 10, wherein capturing images of the instrument cluster includes capturing images of tell-tales of the instrument cluster that convey vehicle operating information to the driver when illuminated.

### Claim 13 (depends on 12)

The method of claim 12, wherein the tell-tales include at least one of the following: a traction control tell-tale; a parking brake light tell-tale; a suspension damper tell-tale; a turn-signal tell-tale; a check engine tell-tale; a power steering tell-tale; a battery warning tell-tale; a low oil pressure tell-tale; a temperature warning tell-tale; a tire pressure warning tell-tale; a high-beam light active tell-tale; a head-lights active tell-tale; a fasten seatbelt tell-tale; a brake system warning tell-tale; a low-fuel tell-tale; an anti-lock brake warning tell-tale; and an airbag warning tell-tale.

### Claim 14 (depends on 12)

The method of claim 12, further comprising, for each one of the tell-tales, scanning with the control module a predetermined location of the instrument cluster captured by the camera and identifying whether the predetermined area is black or at least partially illuminated; and
determining with the control module that the tell-tale is in an off state when the tell-tale is black.

### Claim 15 (depends on 12)

The method of claim 12, further comprising, for each one of the tell-tales, comparing with the control module a shape of the tell-tale as captured in the image taken by the camera with the expected shape of the tell-tale; and
determining with the control module that the tell-tale has a shape error when the tell-tale captured in the image taken by the camera has a different shape than the expected shape of the tell-tale.

### Claim 16 (depends on 12)

The method of claim 12, further comprising, for each one of the tell-tales, comparing with the control module a color of the tell-tale as captured in the image taken by the camera with the expected color of the tell-tale; and
determining with the control module that the tell-tale has a color error when the tell-tale captured in the image taken by the camera has a different color than the expected color of the tell-tale.

### Claim 17 (depends on 10)

The method of claim 10, further comprising capturing the image of the operation of the instrument cluster with the camera once every 50 ms to 100 ms.

### Claim 18 (depends on 10)

The method of claim 10, wherein generating a fault notice includes displaying a fault notice on a redundant display apart from the instrument cluster.

### Claim 19 (depends on 10)

The method of claim 10, wherein generating a fault notice includes at least one of generating a fault warning chime and generating an electronic fault message.

### Claim 20 (depends on 10)

The method of claim 10, further comprising calibrating the control module to account for one or more of the following tolerances: component installation tolerances; applique tolerances; display tolerances; camera tolerances; and vehicle dynamics tolerances.
