# US 2018/0321834 A1 · Display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0321834 A1 - Document ID: US20180321834A1 - Status: Published application - Kind: A1 - Application number: 15/943,138 - Filed: 2018-04-02 - Published: 2018-11-08 - Earliest claimed: 2017-05-02 - Assignees: KYOCERA Document Solutions Inc. - Applicants: KYOCERA Document Solutions Inc. - Inventors: Takanori SHIRAISHI - Web page: https://patentgrep.com/patent/US20180321834A1 ## CPC - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/0317: {in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A display device has an image shooting unit, a display unit, an operation portion, and a processing unit. The processing unit recognizes a particular segment included in a shot image. The processing unit makes the display unit display an added image indicating the particular segment in a form superimposed on the shot image. The processing unit changes the display as to the added image according to operations on the operation portion. ## Claims ### Claim 1 A display device comprising: an image shooting unit; a display unit which displays a shot image obtained through shooting by the image shooting unit; an operation portion which accepts an operation by a user; and a processing unit which recognizes the operation based on an output of the operation portion, controls display on the display unit, recognizes a particular segment included in the shot image, makes the display unit display an added image indicating the particular segment in a form superimposed on the shot image, and changes display related to the added image according to the operation on the operation portion. ### Claim 2 (depends on 1) The display device according to claim 1, wherein when an enlarging operation on the added image is performed, the processing unit enlarges the added image on which the enlarging operation is performed as compared with before the enlarging operation, when a reducing operation on the added image is performed, the processing unit reduces the added image on which the reducing operation is performed as compared with before the reducing operation, and when enlargement causes added images to overlap each other, the processing unit shifts a display position of another added image that overlaps an enlarged added image. ### Claim 3 (depends on 2) The display device according to claim 2, wherein the processing unit makes a degree of transparency of the added image higher after enlargement than before enlargement and makes the degree of transparency of the added image lower after reduction than before reduction. ### Claim 4 (depends on 1) The display device according to claim 1, wherein when a transparency setting operation is performed, the processing unit have the added image on which the transparency setting operation is performed displayed with a degree of transparency set by the transparency setting operation. ### Claim 5 (depends on 1) The display device according to claim 1, wherein when a rubbing operation of rubbing the added image is performed, the processing unit makes a degree of transparency of the added image on which the rubbing operation is performed higher and when a previously determined recovery time has elapsed since the rubbing operation was performed, the processing unit turns the degree of transparency of the added image on which the rubbing operation was performed back to the degree of transparency before the rubbing operation. ### Claim 6 (depends on 1) The display device according to claim 1, wherein when an operation to change a color of all added images is performed, the processing unit changes all the added images to a selected color, and when an operation to change a color of one added images is performed, the processing unit changes the selected added image to a selected color. ### Claim 7 (depends on 1) The display device according to claim 1, further comprising: a reset detection unit which detects a reset operation which is an operation of shaking the display device, wherein the processing unit recognizes that the reset operation is performed based on an output of the reset detection unit, when the reset operation is performed, the processing unit performs reset processing to bring one or more of a size, a display color, and a degree of transparency of the added image back to a default setting. ### Claim 8 (depends on 7) The display device according to claim 7, wherein when a previously determined reset condition is met, the processing unit performs the reset operation, when the previously determined reset condition is not met, the processing unit does not perform the reset operation, and the reset condition is that the reset operation is performed a previously determined threshold number of times or more within a previously determined threshold period. ### Claim 9 (depends on 1) The display device according to claim 1, wherein the operation portion is a touch panel, when a circling operation involving making a two-point touch and then moving one touch position in a previously determined first direction is performed, the processing unit moves a display position of the added image in a direction away from a center of the display unit, and when a circling operation involving making a two-point touch and then moving one touch position in a second direction opposite to the first direction is performed, the processing unit moves the display position of the added image in a direction approaching the center of the display unit. ### Claim 10 (depends on 1) The display device according to claim 1, wherein the processing unit assigns numbers to displayed added images respectively, the display unit is a touch panel, when a circling operation involving making a two-point touch and then moving one touch position in a previously determined first direction is performed, each time the touch position moves a predetermined amount, the processing unit makes the display unit switch an added image displayed on an enlarged scale according to an order of the numbers, when a circling operation involving making a two-point touch and then moving one touch position in a second direction opposite to the first direction is performed, each time the touch position moves a predetermined amount, the processing unit switches the added image displayed on an enlarged scale in a reverse order of the numbers, and when the touch panel is released at both of two points, the processing unit makes the display unit continue to display on an enlarged scale the added image that is displayed on an enlarged scale at a time point of release at the two points. ### Claim 11 (depends on 1) The display device according to claim 1, wherein the operation portion is a touch panel, when a circling operation involving making a two-point touch and then moving one touch position is performed, the processing unit has a display color of the added image switched according to a movement amount of the touch position, and when the touch panel is released at both of two points, the processing unit has the added image displayed in a display color at a time point of release at the two points. ### Claim 12 (depends on 1) The display device according to claim 1, wherein when a pinning-on operation on the added image is performed, the processing unit has a token image indicating a pin start to be displayed in a form superimposed on a pinned-on added image which is the added image on which the pinning-on operation is performed, and even when the particular segment corresponding to the pinned-on added image is not included in the shot image, the processing unit has the token image displayed at a same position as a display start position of the token image, and makes the display unit display the pinned-on added image corresponding to the token image. ### Claim 13 (depends on 12) The display device according to claim 12, wherein when the particular segment corresponding to the pinned-on added image ceases to be included in the shot image, the processing unit makes the display unit erase the pinned-on added image, and when the token image is operated in a state where the particular segment corresponding to the pinned-on added image is not included in the shot image, the processing unit makes the display unit display the pinned-on added image corresponding to the token image temporarily. ### Claim 14 (depends on 12) The display device according to claim 12, wherein when the particular segment corresponding to the pinned-on added image is not included in the shot image, the processing unit makes the display unit display a direction indicating image indicating a direction of the particular segment. ### Claim 15 (depends on 14) The display device according to claim 14, further comprising: a reset detection unit which detects a reset operation which is an operation of shaking the display device, wherein the processing unit recognizes that the reset operation is performed based on an output of the reset detection unit, and when the reset operation is performed, the processing unit makes the display unit erase the token image. ### Claim 16 (depends on 12) The display device according to claim 12, wherein when an erasing operation on the token image is performed, the processing unit makes the display unit erase the token image on which the erasing operation is performed. ### Claim 17 (depends on 16) The display device according to claim 16, wherein the operation portion is a touch panel, and the erasing operation is an operation involving performing an operation as if pinching the token image and then removing fingers from the touch panel. ### Claim 18 (depends on 12) The display device according to claim 12, wherein when the pinning-on operation is performed, the processing unit makes the display unit display a first token image as the token image, when a sticking-in operation to stick in the first token image is performed, the processing unit makes the display unit display a second token image in place of the first token image, and the second token image differs from the first token image in one or more of shape, size, and color. ### Claim 19 (depends on 18) The display device according to claim 18, wherein when a first display period has elapsed since the pinning-on operation was performed, the processing unit makes the display unit erase the first token image, when a second display period has elapsed since the pinning-on operation was performed, the processing unit makes the display unit erase the second token image, and the first display period is shorter than the second display period. ### Claim 20 (depends on 18) The display device according to claim 18, further comprising: a location sensing unit which senses a location, wherein the processing unit recognizes a distance between a location where the pinning-on operation was performed and a current location based on an output of the location sensing unit, when the distance between the location where the pinning-on operation was performed and the current location becomes equal to or more than a first erasure distance, the processing unit makes the display unit erase the first token image, when the distance between the location where the pinning-on operation was performed and the current location becomes equal to or more than a second erasure distance, the processing unit makes the display unit erase the second token image, the first erasure distance is shorter than the second erasure distance.