# US 2019/0317596 A1 · Display device that controls screen display according to gaze line of user, and image forming apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317596 A1
- Document ID: US20190317596A1
- Status: Published application
- Kind: A1
- Application number: 16/371,493
- Filed: 2019-04-01
- Published: 2019-10-17
- Earliest claimed: 2018-04-13
- Assignees: KYOCERA Document Solutions Inc.
- Applicants: KYOCERA Document Solutions Inc.
- Inventors: Masaru SATO
- Web page: https://patentgrep.com/patent/US20190317596A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F 2203/04805: Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
- G09G 2320/0693: Calibration of display systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A display device includes a display unit, a gaze line detection unit, and a control unit that includes a processor, and acts, when the processor executes a control program, as a gaze line concentration area detector that detects a gaze line concentration area on the screen, according to a trajectory of the gaze line on the screen detected by the gaze line detection unit, a counter that counts a number of objects displayed in the gaze line concentration area detected, and a display controller that enters an enlarged display mode in which the display object is displayed in an enlarged size, when one display object is included in the gaze line concentration area, and enters a help display mode in which help information is displayed, when no gaze line concentration area is detected, or when a plurality of display objects are included in the gaze line concentration area.

## Claims

### Claim 1

A display device comprising:
a display unit that displays a screen;
a gaze line detection unit that detects a gaze line of a user directed to the screen; and
a control unit that includes a processor, and acts, when the processor executes a control program, as:
a gaze line concentration area detector that detects a gaze line concentration area on the screen, according to a trajectory of the gaze line on the screen detected by the gaze line detection unit;
a counter that counts a number of display objects included in the gaze line concentration area, when the gaze line concentration area is detected; and
a display controller that enters an enlarged display mode in which the display object is displayed in an enlarged size, when one display object is included in the gaze line concentration area, and enters a help display mode in which help information is displayed, when no gaze line concentration area is detected, or when a plurality of display objects are included in the gaze line concentration area.

### Claim 2 (depends on 1)

The display device according to claim 1,
wherein the gaze line concentration area detector detects, when the screen is divided into a plurality of areas, an area that includes a largest amount of the trajectory, as the gaze line concentration area.

### Claim 3 (depends on 1)

The display device according to claim 1,
wherein the display controller displays the help information related to operation of the screen, when the gaze line concentration area is not detected.

### Claim 4 (depends on 1)

The display device according to claim 1,
wherein the display controller displays, when a plurality of display objects are included in the gaze line concentration area, the help information related to functions of the respective display objects.

### Claim 5 (depends on 1)

The display device according to claim 1,
wherein, in the enlarged display mode, the display controller changes the display object to be enlarged, each time the gaze line detected by the gaze line detection unit moves, to another display object located at a position corresponding to the gaze line.

### Claim 6 (depends on 1)

The display device according to claim 1,
wherein, in the help display mode, the display controller changes the display object about which the help information is to be displayed, each time the gaze line detected by the gaze line detection unit moves, to another display object located at a position corresponding to the gaze line.

### Claim 7 (depends on 1)

The display device according to claim 1,
wherein the display controller turns on or off the enlarged display mode, depending on an age of the user.

### Claim 8 (depends on 1)

The display device according to claim 1,
wherein, when the gaze line detection unit detects the gaze line of the user directed to the screen, the gaze line concentration area detector monitors the trajectory of the gaze line on the screen for a predetermined time, calculates density distribution of the trajectory on the screen during the predetermined time, and detects an area where the calculated density distribution is higher than a predetermined threshold, as the gaze line concentration area.

### Claim 9 (depends on 4)

The display device according to claim 4,
wherein the display controller displays the help information so as not to overlap with the display object included in the gaze line concentration area.

### Claim 10 (depends on 7)

The display device according to claim 7,
wherein the gaze line detection unit includes a camera that shoots a face of the user operating the display unit, and detects the gaze line of the user directed to the screen on a basis of image data from the camera, and
the display controller estimates a distance between the screen and the face of the user, on a basis of a ratio of the face of the user to the image data acquired by the gaze line detection unit immediately before the enlarged display mode is entered, and turns off the enlarged display mode when the estimated distance is shorter than a predetermined distance, but turns on the enlarged display mode when the estimated distance is equal to or longer than the predetermined distance.

### Claim 11 (depends on 1)

An image forming apparatus comprising:
the display device according to claim 1; and
a printing unit that prints the help information.
