# US 10,502,962 B2 · Projection type display device and projection control method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,502,962 B2 - Document ID: US10502962B2 - Status: Granted - Kind: B2 - Application number: 15/861,663 - Filed: 2018-01-03 - Published: 2018-05-24 - Granted: 2019-12-10 - Earliest claimed: 2015-07-29 - Assignees: FUJIFILM Corporation - Applicants: FUJIFILM Corporation - Inventors: Koudai Fujita - Web page: https://patentgrep.com/patent/US10502962B2 ## CPC - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/232: controlling the projection distance of virtual images depending on the condition of the vehicle or the driver - B60K 35/234: controlling the brightness, colour or contrast of virtual images depending on the driving conditions or on the condition of the vehicle or the driver - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - G02B 27/01: Head-up displays - G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)} - G03B 17/54: with projector - G06F 3/147: using display panels - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - G09G 5/10: Intensity circuits - G09G 5/36: characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory - H04N 9/3179: {Video signal processing therefor} - H04N 9/3194: {including sensor feedback} - B60K 35/213: {Virtual instruments} - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - B60K 35/81: for controlling displays - B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for - B60K 2360/186: Displaying information according to relevancy - B60K 2360/334: Projection means - G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0181: {Adaptation to the pilot/driver} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen - G09G 2340/04: Changes in size, position or resolution of an image - G09G 2380/10: Automotive applications - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The projection type display device includes a projection display unit that includes light sources, a light modulation element, and a projection unit that projects light onto a projection surface mounted in a vehicle as projection light; a sight line detection unit that detects a line of sight of a driver of the vehicle; and a system controller that performs a control so that a projection condition in a state where the line of sight detected by the sight line detection unit is out of the projection surface becomes a first condition and changes the projection condition when it is determined that the line of sight moves from the outside of the projection surface to the inside of the projection surface into a second condition that visibility of an image based on the projection light is higher than that in the first condition. ## Claims ### Claim 1 A projection type display device comprising: a projection display unit that includes a light source, a light modulation element that spatially modulates light emitted from the light source, and a projection unit that projects light spatially modulated by the light modulation element onto a projection surface mounted in a vehicle as projection light; a sight line detection unit that detects a line of sight of a driver of the vehicle; and a projection controller that performs a control so that a projection condition for the projection of the projection light onto the projection surface in the projection display unit becomes a first condition in a case where the line of sight detected by the sight line detection unit is out of the projection surface, and performs a control so that the projection condition becomes a second condition in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface, wherein the projection controller changes the projection condition from the first projection condition to the second projection condition in which visibility of an image based on the projection light is higher than that in the first condition by decreasing a distance from the projection surface of a virtual image formed by the projection light, after a first period of time ranging between 1 and 4 seconds elapses from a point in time when the projection controller determines that the line of sight is detected by the sight line detection unit to have been moved from the outside of the projection surface to the inside of the projection surface. ### Claim 2 (depends on 1) The projection type display device according to claim 1, wherein the second condition includes a plurality of sub conditions having different visibilities of the image, and the projection controller sequentially changes the projection condition from a sub condition having a lower visibility to a sub condition having a higher visibility by further decreasing the distance from the projection surface of the virtual image formed by the projection light in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface. ### Claim 3 (depends on 2) The projection type display device according to claim 2, wherein the first period of time is manually settable to be between 1 second to 4 seconds in advance. ### Claim 4 (depends on 1) The projection type display device according to claim 1, wherein the first period of time is manually settable to be between 1 second to 4 seconds in advance. ### Claim 5 (depends on 1) The projection type display device according to claim 1, wherein the projection controller determines that the line of sight has been moved from the outside of the projection surface to the inside of the projection surface in a case where the line of sight detected by the sight line detection unit changes from a state where the line of sight detected by the sight line detection unit is out of the projection surface moves to a state where the line of sight detected by the sight line detection unit is within the projection surface and the line of sight is detected by the sight line detection unit have bee continuously within the projection surface for a second period of time. ### Claim 6 A projection type display device comprising: a projection display unit that includes a light source, a light modulation element that spatially modulates light emitted from the light source, and a projection unit that projects light spatially modulated by the light modulation element onto a projection surface mounted in a vehicle as projection light; a sight line detection unit that detects a line of sight of a driver of the vehicle; and a projection controller that performs a control so that a projection condition for the projection of the projection light onto the projection surface in the projection display unit becomes a first condition in a case where the line of sight detected by the sight line detection unit is out of the projection surface, and performs a control so that the projection condition becomes a second condition in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface, wherein the projection controller changes the projection condition from the first projection condition to the second projection condition in which visibility of an image based on the projection light is higher than that in the first condition by increasing a distance of a position of the image based on the projection light from an end portion side of the projection surface, after a first period of time ranging between 1 and 4 seconds elapses from a point in time when the projection controller determines that the line of sight is detected by the sight line detection unit to have been moved from the outside of the projection surface to the inside of the projection surface. ### Claim 7 (depends on 6) The projection type display device according to claim 6, wherein the second condition includes a plurality of sub conditions having different visibilities of the image, and the projection controller sequentially changes the projection condition from a sub condition having a lower visibility to a sub condition having a higher visibility by further increasing the distance of the position of the image based on the projection light from an end portion side of the projection surface in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface. ### Claim 8 (depends on 7) The projection type display device according to claim 7, wherein the first period of time is manually settable to be between 1 second to 4 seconds in advance. ### Claim 9 (depends on 6) The projection type display device according to claim 6, wherein the first period of time is manually settable to be between 1 second to 4 seconds in advance. ### Claim 10 (depends on 6) The projection type display device according to claim 6, wherein the projection controller determines that the line of sight has been moved from the outside of the projection surface to the inside of the projection surface in a case where the line of sight detected by the sight line detection unit changes from a state where the line of sight detected by the sight line detection unit is out of the projection surface to a state where the line of sight detected by the sight line detection unit is within the projection surface and the line of sight is detected by the sight line detection unit to have been continuously within the projection surface for a second period of time. ### Claim 11 A projection control method in a projection type display device including a projection display unit that includes a light source, a light modulation element that spatially modulates light emitted from the light source, and a projection unit that projects light spatially modulated by the light modulation element onto a projection surface mounted in a vehicle as projection light; and a sight line detection unit that detects a line of sight of a driver of the vehicle, the method comprising: a projection control step of performing a control so that a projection condition for the projection of the projection light onto the projection surface in the projection display unit becomes a first condition in a case where the line of sight detected by the sight line detection unit is out of the projection surface, and performing a control so that the projection condition is changed from the first condition to a second condition in which visibility of an image based on the projection light is higher than that in the first condition by decreasing a distance from the projection surface of a virtual image formed by the projection light, in a case where it is determined that the line of sight detected by the sight line detection unit moves has been moved from the outside of the projection surface to the inside of the projection surface, after a first period of time ranging between 1 and 4 seconds elapses from a point in time when the projection controller determines that the line of sight is detected by the sight line detection unit to have been moved from the outside of the projection surface to the inside of the projection surface. ### Claim 12 (depends on 11) The projection control method according to claim 11, wherein the second condition includes a plurality of sub conditions having different visibilities of the image, and in the projection control step, in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface, the projection condition is sequentially changed from a sub condition with a lower visibility to a sub condition with a higher visibility by further decreasing the distance from the projection surface of the virtual image formed by the projection light. ### Claim 13 (depends on 11) The projection control method according to claim 11, wherein, in the projection control step, it is determined that the line of sight has been moved from the outside of the projection surface to the inside of the projection surface in a case where the line of sight detected by the sight line detection unit changes from a state where the line of sight detected by the sight line detection unit is out of the projection surface moves to a state where the line of sight detected by the sight line detection unit is within the projection surface and the line of sight is detected by the sight line detection unit to have been continuously within the projection surface for a second period of time. ### Claim 14 A projection control method in a projection type display device including a projection display unit that includes a light source, a light modulation element that spatially modulates light emitted from the light source, and a projection unit that projects light spatially modulated by the light modulation element onto a projection surface mounted in a vehicle as projection light; and a sight line detection unit that detects a line of sight of a driver of the vehicle, the method comprising: a projection control step of performing a control so that a projection condition for the projection of the projection light onto the projection surface in the projection display unit becomes a first condition in a case where the line of sight detected by the sight line detection unit is out of the projection surface, and performing a control so that the projection condition is changed from the first condition to a second condition in which visibility of an image based on the projection light is higher than that in the first condition by increasing a distance of a position of the image based on the projection light from an end portion side of the projection surface, in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface, after a first period of time ranging between 1 and 4 seconds elapses from a point in time when the projection controller determines that the line of sight is detected by the sight line detection unit to have been moved from the outside of the projection surface to the inside of the projection surface. ### Claim 15 (depends on 14) The projection control method according to claim 14, wherein the second condition includes a plurality of sub conditions having different visibilities of the image, and in the projection control step, in a case where it is determined that the line of sight detected by the sight line detection unit has been moved from the outside of the projection surface to the inside of the projection surface, the projection condition is sequentially changed from a sub condition with a lower visibility to a sub condition with a higher visibility by further increasing the distance of the position of the image based on the projection light from the end portion side of the projection surface. ### Claim 16 (depends on 14) The projection control method according to claim 14, wherein, in the projection control step, it is determined that the line of sight has been moved from the outside of the projection surface to the inside of the projection surface in a case where the line of sight detected by the sight line detection unit changes from a state where the line of sight detected by the sight line detection unit is out of the projection surface moves to a state where the line of sight detected by the sight line detection unit is within the projection surface and the line of sight is detected by the sight line detection unit to have been continuously within the projection surface for a second period of time.