# US 2021/0278749 A1 · Electronic device and method for controlling electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0278749 A1 - Document ID: US20210278749A1 - Status: Published application - Kind: A1 - Application number: 17/191,245 - Filed: 2021-03-03 - Published: 2021-09-09 - Earliest claimed: 2020-03-06 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Junji Ito - Web page: https://patentgrep.com/patent/US20210278749A1 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G03B 13/02: Viewfinders - G03B 13/36: Autofocus systems - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - H04N 23/675: {comprising setting of focusing regions} - G03B 2213/025: Sightline detection - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic device comprising a control unit performs control such that despite a predetermined trigger issued before a duration of a gaze state according to a line-of-sight input relative to a first region, in which the display item is displayed, reaches a first time, neither a first function nor a second function is performed, in response to the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the first time and less than a second time, a part of a display object based on an input position of the line-of-sight input is selected and the first function is performed, and in response to the predetermined trigger issued in a state where the duration is at least the second time, the display item is selected and the second function is performed. ## Claims ### Claim 1 An electronic device comprising at least one memory and at least one processor which function as: a receiving unit configured to receive a line-of-sight input corresponding to a line-of-sight of a user who looks at a display; a display control unit configured to perform control to display on the display a display object and display a display item superimposed on the display object; and a control unit configured to perform control such that 1) in a case where a predetermined trigger issued before a duration of a gaze state according to the line-of-sight input relative to a first region, in which the display item is displayed, reaches a first time, neither a first function nor a second function is performed, 2) in a case where the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the first time and less than a second time, a part of the display object based on an input position of the line-of-sight input is selected and the first function is performed, and 3) in a case where the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the second time, the display item is selected and the second function is performed. ### Claim 2 (depends on 1) The electronic device according to claim 1, wherein the display object is a live view image, and the first function is at least any of autofocus (AF), setting of an AF target position, and setting of a tracking target. ### Claim 3 (depends on 2) The electronic device according to claim 2, wherein the second function is one of setting change of an image-capturing setting corresponding to the display item displayed in the first region, and display of a setting change screen. ### Claim 4 (depends on 1) The electronic device according to claim 1, wherein the display object is a table, and the first function is selection of a cell of the table. ### Claim 5 (depends on 4) The electronic device according to claim 4, wherein the display item is a text box, and the second function is transition to a state in which text can be input into the text box displayed in the first region. ### Claim 6 (depends on 1) The electronic device according to claim 1, wherein the gaze state relative to a region is a state in which an input position of the line-of-sight input of the user is fixed at the region, and in a case where the input position of the line-of-sight input of the user is moved away from the region for a duration that is shorter than or equal to a predetermined threshold, the gaze state is regarded to be continuing. ### Claim 7 (depends on 1) The electronic device according to claim 1, wherein in a case where the predetermined trigger issued before the duration of the gaze state relative to the first region reaches the first time, the control unit does not perform a process corresponding to the predetermined trigger. ### Claim 8 (depends on 1) The electronic device according to claim 1, wherein in a case where the predetermined trigger issued before the duration of the gaze state relative to the first region reaches the first time, the control unit performs a third function. ### Claim 9 (depends on 8) The electronic device according to claim 8, wherein the third function is irrelevant to both the display item and a portion of the display object that corresponds to an input position of the line-of-sight input. ### Claim 10 (depends on 8) The electronic device according to claim 8, wherein the third function is display of a setting screen that allows setting states of a plurality of setting items to be checked. ### Claim 11 (depends on 1) The electronic device according to claim 1, wherein the predetermined trigger is detection of a predetermined operation performed by the user. ### Claim 12 (depends on 1) The electronic device according to claim 1, wherein the predetermined trigger is one of detection of predetermined voice and detection of a state corresponding to a closing of an eye. ### Claim 13 (depends on 1) The electronic device according to claim 1, wherein the display control unit is further configured to control the display such that the display item is arranged in front of the display object. ### Claim 14 (depends on 1) The electronic device according to claim 1, wherein the display control unit is further configured to control the display to display the display item in a first display appearance before the duration of the gaze state relative to the first region reaches the first time, and in a case where the duration of the gaze state relative to the first region is at least the first time and less than the second time, display the display item in a second display appearance. ### Claim 15 (depends on 1) The electronic device according to claim 1, wherein the display control unit is further configured to control the display to display the display item in a first display appearance before the duration of the gaze state relative to the first region reaches the first time, and in a case where the duration of the gaze state relative to the first region is at least the second time, display the display item in a third display appearance. ### Claim 16 (depends on 1) The electronic device according to claim 1, wherein in a case where the predetermined trigger issued in a state where a duration of the gaze state relative to a second region in which a second display item is displayed superimposed on the display object is at least the second time, the control unit does not perform a function of selecting the second display item. ### Claim 17 (depends on 1) The electronic device according to claim 1, wherein the control unit is further configured to perform control to in a case where the predetermined trigger issued in a state where a duration of the gaze state relative to a third region in which a third display item is displayed superimposed on the display object is at least the first time and less than the second time, perform a function of selecting the third display item, and in a case where the predetermined trigger issued in a state where the duration of the gaze state relative to the third region is at least the second time, select a part of the display object based on an input position of the line-of-sight input and perform the first function. ### Claim 18 A method for controlling an electronic device, the method comprising: a step of receiving a line-of-sight input corresponding to a line-of-sight of a user who looks at a display; a step of performing control to display on the display a display object and display a display item superimposed on the display object; and a step of performing control such that 1) in a case where a predetermined trigger issued before a duration of a gaze state according to the line-of-sight input relative to a first region, in which the display item is displayed, reaches a first time, neither a first function nor a second function is performed, 2) in a case where to the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the first time and less than a second time, a part of the display object based on an input position of the line-of-sight input is selected and the first function is performed, and 3) in a case where the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the second time, the display item is selected and the second function is performed. ### Claim 19 A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute a method for controlling an electronic device, the method comprising: a step of receiving a line-of-sight input corresponding to a line-of-sight of a user who looks at a display; a step of performing control to display on the display a display object and display a display item superimposed on the display object; and a step of performing control such that 1) in a case where a predetermined trigger issued before a duration of a gaze state according to the line-of-sight input relative to a first region, in which the display item is displayed, reaches a first time, neither a first function nor a second function is performed, 2) in a case where to the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the first time and less than a second time, a part of the display object based on an input position of the line-of-sight input is selected and the first function is performed, and 3) in a case where the predetermined trigger issued in a state where the duration of the gaze state relative to the first region is at least the second time, the display item is selected and the second function is performed.