# US 2014/0195955 A1 · Display operation device allocating a plurality of functions to a key, image processing apparatus, and method of receiving user operations > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0195955 A1 - Document ID: US20140195955A1 - Status: Published application - Kind: A1 - Application number: 14/190,672 - Filed: 2014-02-26 - Published: 2014-07-10 - Earliest claimed: 2010-07-22 - Assignees: Sharp Kabushiki Kaisha - Applicants: Sharp Kabushiki Kaisha - Inventors: Mikiya OKADA; Naohiro ANDOH - Web page: https://patentgrep.com/patent/US20140195955A1 ## CPC - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G03G 15/5016: {User-machine interface; Display panels; Control console} - G03G 15/502: {relating to the structure of the control menu, e.g. pop-up menus, help screens} - G03G 15/5087: {for receiving image data} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04855: Interaction with scrollbars - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06K 15/005: {only locally} - G06K 15/4075: {Determining remaining quantities of ink or toner} - H04N 1/00076: {locally} - H04N 1/00408: {Display of information to the user, e.g. menus} - G03G 2215/00109: Remote control of apparatus, e.g. by a host - H04N 2201/0094: Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G03G: ELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY - G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A display operation device has a display-integrated operation panel with a display screen, on which a monochrome copy start key and a color copy start key are displayed. When black-toner-out or color-toner-out occurs, on the monochrome copy start key and the color copy start key, another UI component such as black-toner-out key and color-toner-out key is displayed. Such a UI component is displayed at the display position of the monochrome copy start key and the color copy start key, being superposed on these keys. ## Claims ### Claim 1 A display operation device, comprising: a display-integrated operation panel having a display screen; a first UI component display device displaying a first user interface (UI) component image on said display screen; a process activating device, responsive to a user operation of said first UI component displayed on said display screen by said first UI component display device, for activating a process associated with the first UI component; and a second UI component display device, responsive to occurrence of a predetermined condition related to the process activated in association with said first UI component by said process activating device, for displaying a second UI component on said display screen; wherein said second UI component is displayed at a position of display of said first UI component, to cover said first UI component. ### Claim 2 (depends on 1) The display operation device according to claim 1, wherein said second UI component display device includes a device responsive to activation of a process associated with said first UI component by said process activating device, for displaying said second UI component at the position of said first UI component on said display screen; said operation display device further comprising stopping device, responsive to a user operation of said second UI component, for stopping execution of the process activated by said process activating device. ### Claim 3 (depends on 1) The display operation device according to claim 1, wherein said second UI component display device includes a disabling device, detecting occurrence of an event hindering the process to be activated by said process activating device, for displaying said second UI component at the same position as said first UI component, to be superposed on said first UI component, and thereby for disabling user operation of said first UI component. ### Claim 4 (depends on 3) The display operation device according to claim 3, mounted on an image processing apparatus involving toner use, wherein said first UI component is a device for displaying an image formation start key for activating a process for forming an image using the toner; and said disabling device includes a toner-out detecting device detecting shortage of toner to be used for image formation by said image forming apparatus, and a replenishment message display device, responsive to detection of tone-out by said toner-out detecting device, for displaying a message asking replenishment of toner, as said second UI component. ### Claim 5 (depends on 4) The display operation device according to claim 4, wherein said toner-out detecting device includes a device for separately detecting black-toner-out and color-toner-out; and said replenishment message display device includes a toner-by-toner message display device, responsive to detection of one of or both of black-toner-out and color-toner-out by said tone-out detecting device, for displaying a message asking replenishment of black toner, replenishment of color toner or replenishment of black toner and color toner, as said second UI component. ### Claim 6 (canceled) ### Claim 7 (depends on 3) The display operation device according to claim 3, mounted on an image processing apparatus involving use of a recording medium, wherein said first UI component display device is a device for displaying an image formation start key for activating a process for image formation on the recording medium; and said disabling device includes a trouble detecting device detecting a trouble occurring in relation to supply of the recording medium of said image processing apparatus, and a trouble-solution message display device, responsive to detection of a trouble by said trouble detecting device, for displaying a message asking a solution to the problem, as said second UI component. ### Claim 8 (depends on 7) The display operation device according to claim 7, wherein said image formation start key includes first and second keys for instructing image formation using black toner and color toner, respectively, on the recording medium; and said second UI component is displayed to cover both said first and second keys. ### Claim 9 (depends on 3) The display operation device according to claim 3, mounted on an image processing apparatus transmitting image data through a communication device, wherein said first UI component display device is a device for displaying an image transmission start button for activating a process for transmitting an image to a designated destination; and said disabling device includes a trouble detecting device for detecting failure of designating an appropriate destination when an image is to be transmitted by said image processing apparatus, and a destination input message display device, responsive to detection of a trouble by said trouble detecting device, for displaying a message asking input of an appropriate destination of the image, as said second UI component, superposed on said image transmission start key. ### Claim 10 (depends on 1) The display operation device according to claim 1, wherein said first UI component includes a plurality of components; and said second UI component is displayed in a color different from said first UI components, and displayed in the same color no matter on which of said first UI components the second UI component is displayed. ### Claim 11 (depends on 1) The display operation device according to claim 1, wherein outline form of said second UI component matches outline form of said first UI component. ### Claim 12 (depends on 1) The display operation device according to claim 1, wherein said second UI component is displayed in a transparent manner to allow recognition of a key displayed on a lower layer of said second UI component. ### Claim 13 (depends on 1) The display operation device according to claim 1, further comprising a disabling device, detecting occurrence of an event hindering the process to be activated by said process activating device, for displaying a third UI component at the same position as said first UI component, to be superposed on said first UI component, and thereby for disabling user operation of said first UI component. ### Claim 14 (depends on 13) The display operation device according to claim 13, wherein said second UI component is displayed in a first color, and said third UI component is displayed in a second color different from said first color. ### Claim 15 (depends on 13) The display operation device according to claim 13, wherein said first UI component includes a plurality of components; said second UI component is displayed in a first display color no matter on which of said plurality of first UI components the second UI component is displayed; and said third UI component is displayed in the second color different from said first color, no matter on which of said plurality of first UI components the third UI component is displayed. ### Claim 16 (depends on 1) An image processing apparatus, comprising: the display operation device according to claim 1; an image forming device forming image data; and an image processing unit, connected to said display operation device and said image forming device, for processing the image data formed by said image forming device, based on an output instruction from said display operation device. ### Claim 17 A method of receiving a user operation using a display-integrated operation panel having a display screen, comprising the steps of displaying an image of a first UI component on said display screen; activating, in response to a user operation of said first UI component displayed on said display screen at said step of displaying the image of said first UI component, a process associated with said first UI component; and displaying, in response to occurrence of a predetermined condition related to the process activated at said step of activating a process, a second UI component on said display screen; wherein said second UI component is displayed at a display position of said first UI component to cover said first UI component.