# US 11,077,793 B2 · Rearview display device, rearview display method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,077,793 B2 - Document ID: US11077793B2 - Status: Granted - Kind: B2 - Application number: 16/566,147 - Filed: 2019-09-10 - Published: 2020-03-19 - Granted: 2021-08-03 - Earliest claimed: 2018-09-14 - Assignees: Sharp Kabushiki Kaisha - Applicants: Sharp Kabushiki Kaisha - Inventors: Kazuma Kikuchi; Tomoya Shimura - Web page: https://patentgrep.com/patent/US11077793B2 ## CPC - B60R 1/26: to the rear of the vehicle - B60R 1/083: {Anti-glare mirrors, e.g. "day-night" mirrors} - B60R 1/12: Mirror assemblies combined with other articles, e.g. clocks - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - H04N 5/57: Control of contrast or brightness - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/47: End-user applications - B60R 2001/1215: {with information displays} - B60R 2001/1253: {with cameras, video cameras or video screens} - B60R 2300/207: using multi-purpose displays, e.g. camera image and navigation or video on same display - B60R 2300/30: characterised by the type of image processing - B60R 2300/302: combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data - B60R 2300/306: using a re-scaling of images - B60R 2300/605: the adjustment being automatic - B60R 2300/8066: for monitoring rearward traffic - G06T 2207/30201: Face - G06T 2207/30268: Vehicle interior - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A video processing unit generates a conversion video having the same angle of view as an angle of view of a mirror image by converting a camera video. The video processing unit causes the generated conversion video to be displayed in a display region such that the conversion video is superimposed on the mirror image. ## Claims ### Claim 1 A rearview display device comprising: a display unit; a dimming mirror that is disposed so as to be overlapped with a display surface of the display unit, and reflects, as a mirror image, a periphery of a vehicle; an image capturing unit that generates a video by capturing the periphery of the vehicle; and a video processing unit that generates a conversion video having an angle of view identical with an angle of view of the mirror image by converting the video, and causes the display unit to display the conversion video such that the conversion video is superimposed on the mirror image, wherein when causing the display unit to display the conversion video such that the conversion video is superimposed on the mirror image, the video processing unit outputs a message indicating that display for abnormality confirmation including video inversion confirmation is currently performed, and the display surface of the display unit faces a rear side of the vehicle on which the rearview display device is mounted. ### Claim 2 (depends on 1) The rearview display device according to claim 1, wherein the video processing unit causes the display unit to separately display the conversion video and the mirror image by causing the display unit to display, as a dark video, a part of the conversion video. ### Claim 3 (depends on 1) The rearview display device according to claim 1, further comprising a luminance control unit that controls a luminance of the display unit according to a luminance of the mirror image. ### Claim 4 (depends on 1) The rearview display device according to claim 1, further comprising a reflectance control unit that controls a reflectance of the dimming mirror according to a luminance of the display unit. ### Claim 5 (depends on 1) The rearview display device according to claim 1, further comprising: a luminance control unit that controls a luminance of the display unit according to a luminance of the mirror image; and a reflectance control unit that controls a reflectance of the dimming mirror according to the luminance of the display unit, wherein the reflectance of the dimming mirror and the luminance of the display unit are controlled such that the luminance of the mirror image and the luminance of the display unit match with each other. ### Claim 6 (depends on 2) The rearview display device according to claim 2, wherein the video processing unit causes an image identical with an image of the conversion video or the mirror image which is displayed in an entirety of a display region of the display unit before the separation display to be displayed in a central region of the display region during the separation display. ### Claim 7 (depends on 1) The rearview display device according to claim 1, further comprising: a vehicle information acquisition unit that acquires vehicle information regarding the vehicle; and a determination unit that determines whether or not the vehicle stops based on the vehicle information, wherein the video processing unit causes the display unit to display the conversion video such that the conversion video is superimposed on the mirror image in a case where it is determined that the vehicle stops. ### Claim 8 (depends on 1) The rearview display device according to claim 1, wherein the video processing unit switches between at least two of a display of the conversion video on the display unit, a display of the mirror image on the display unit, and a superimposition display of the conversion video and the mirror image on the display unit for each predetermined time. ### Claim 9 (depends on 1) The rearview display device according to claim 1, further comprising: a viewpoint acquisition unit that acquires a viewpoint of a driver; a pose acquisition unit that acquires a pose of the rearview display device; and a distance acquisition unit that acquires a distance between the image capturing unit and an image capturing target, wherein the video processing unit generates the conversion video having the angle of view identical with the angle of view of the mirror image by using the viewpoint, the pose, and the distance. ### Claim 10 A rearview display device comprising: a display unit; a dimming mirror that is disposed so as to be overlapped with a display surface of the display unit, and reflects, as a mirror image, a periphery of a vehicle; an image capturing unit that generates a video by capturing the periphery of the vehicle; and a video processing unit that converts the video to generate a conversion video in which a size of the video is reduced, and causes the conversion video and the mirror image to be separately displayed in a display region by causing the conversion video to be displayed in a first region of the display region of the display unit and causing a dark video to be displayed in a second region of the display region except for the first region, wherein when causing the display unit to display the conversion video and the mirror image, the video processing unit outputs a message indicating that display for abnormality confirmation including video inversion confirmation is currently performed, and the display surface of the display unit faces a rear side of the vehicle on which the rearview display device is mounted. ### Claim 11 A rearview display method performed by a rearview display device that includes a display unit, and a dimming mirror which is disposed so as to be overlapped with a display surface of the display unit and reflects, as a mirror image, a periphery of a vehicle, the method comprising: generating a video by capturing the periphery of the vehicle; and generating a conversion video having an angle of view identical with an angle of view of the mirror image by converting the video, and causing the display unit to display the conversion video such that the conversion video is superimposed on the mirror image, wherein in said causing the display unit to display the conversion video such that the conversion video is superimposed on the mirror image, a message indicating that display for abnormality confirmation including video inversion confirmation is currently performed is outputted, and the display surface of the display unit faces a rear side of the vehicle on which the rearview display device is mounted. ### Claim 12 A rearview display method performed by a rearview display device that includes a display unit, and a dimming mirror which is disposed so as to be overlapped with a display surface of the display unit and reflects, as a mirror image, a periphery of a vehicle, the method comprising: generating a video by capturing the periphery of the vehicle; and converting the video to generate a conversion video in which a size of the video is reduced, and causing the conversion video and the mirror image to be separately displayed in a display region by causing the conversion video to be displayed in a first region of the display region of the display unit and causing a dark video to be displayed in a second region of the display region except for the first region, wherein when causing the display unit to display the conversion video and the mirror image, the video processing unit outputs a message indicating that display for abnormality confirmation including video inversion confirmation is currently performed, and the display surface of the display unit faces a rear side of the vehicle on which the rearview display device is mounted. ### Claim 13 (depends on 1) A non-transitory computer readable storage medium storing a program causing a computer to function as the rearview display device according to claim 1, the program causing the computer to function as the units.