# US 11,029,830 B2 · Display control apparatus, display controlling method and display control program for providing guidance using a generated image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,830 B2 - Document ID: US11029830B2 - Status: Granted - Kind: B2 - Application number: 16/430,495 - Filed: 2019-06-04 - Published: 2019-12-12 - Granted: 2021-06-08 - Earliest claimed: 2018-06-11 - Assignees: Casio Computer Co., Ltd. - Applicants: Casio Computer Co., Ltd. - Inventors: Toshihiko Otsuka; Takahiro Tomida; Natsumi Hamaoka - Web page: https://patentgrep.com/patent/US11029830B2 ## CPC - G06F 1/1681: {Details related solely to hinges (hinge details related to the transmission of signals or power are classified in G06F1/1683)} - A45D 44/005: {for selecting or displaying personal cosmetic colours or hairstyle} - G06F 1/166: {related to integrated arrangements for adjusting the position of the main body with respect to the supporting surface, e.g. legs for adjusting the tilt angle} - G06F 3/012: {Head tracking input arrangements} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06T 11/60: Creating or editing images; Combining images with text - G06V 40/165: {using facial parts and geometric relationships} - G06V 40/166: {using acquisition arrangements} - G06V 40/172: {Classification, e.g. identification} - G06V 40/16: Human faces, e.g. facial parts, sketches or expressions - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A45D: HAIRDRESSING OR SHAVING EQUIPMENT (wigs, toupees or the like A41G3/00, A41G5/00; hairdressers' chairs A47C1/04; hair cutting appliances, razors B26B); EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A display control apparatus includes a display and a processor, in which the processor performs processing of acquiring an image of an object, displaying an auxiliary substitute image in which auxiliary information is added to a substitute image on the display, switching between i) a first display mode in which the object's image which is acquired is displayed on the display as a first image and the auxiliary substitute image is displayed on the display as a second image and ii) a second display mode in which the object's image which is acquired is displayed on the display as the second image and the auxiliary substitute image is displayed on the display as the first image, and displaying the object's image and the auxiliary substitute image on the display unit in the display mode which is switched. ## Claims ### Claim 1 A display control apparatus comprising: a display; and a processor, wherein the processor performs processing of: acquiring an image, recognizing a predetermined object from the acquired image; displaying an auxiliary substitute image in which auxiliary information is added to a substitute image on the display, when the processor recognizes the predetermined object from the acquired image, switching between i) a first display mode in which the object's image which is acquired is displayed on the display as a first image and the auxiliary substitute image is displayed on the display as a second image and ii) a second display mode in which the object's image which is acquired is displayed on the display as the second image and the auxiliary substitute image is displayed on the display as the first image, and displaying the object's image and the auxiliary substitute image on the display in the switched to display mode, wherein: the processor displays the object's image and the auxiliary substitute image on the display in one of the first display mode and the second display mode based on a predetermined condition, the processor manages a proficiency level of a user, and the predetermined condition is a condition which relates to the proficiency level. ### Claim 2 (depends on 1) The display control apparatus according to claim 1, further comprising: an imaging device which captures an image, wherein the processor acquires the object's image from the imaging device. ### Claim 3 (depends on 1) The display control apparatus according to claim 1, wherein: the processor controls a predetermined timing that the auxiliary information is displayed on the display, and the processor switches between the object's image and the auxiliary substitute image to be displayed on the display while changing the auxiliary information of the auxiliary substitute image based on the predetermined timing which is controlled. ### Claim 4 (depends on 3) The display control apparatus according to claim 3, wherein: the processor controls the predetermined timing in a case where the object in the object's image which is acquired enters a predetermined state. ### Claim 5 (depends on 4) The display control apparatus according to claim 4, wherein: the predetermined state includes a state which relates to predetermined treatment that the object concerned performs on herself/himself. ### Claim 6 (depends on 4) The display control apparatus according to claim 4, wherein: the predetermined state includes a state which relates to biological information of the object concerned. ### Claim 7 (depends on 4) The display control apparatus according to claim 4, wherein: the processor selects the auxiliary substitute image in a case where the object in the image which is acquired enters the predetermined state. ### Claim 8 (depends on 3) The display control apparatus according to claim 3, wherein: the processor performs a series of guidance by displaying the auxiliary substitute image on the display so as to switch a plurality of the auxiliary substitute image. ### Claim 9 (depends on 3) The display control apparatus according to claim 3, wherein: the processor controls the predetermined timing based on a plurality of pieces of the auxiliary information used to perform a series of guidance. ### Claim 10 (depends on 1) The display control apparatus according to claim 1, wherein: in the first display mode, the object's image is displayed on the display in a first display status and the auxiliary substitute image is displayed on the display in a second display status, and in the second display mode, the object's image is displayed on the display in the second display status and the auxiliary substitute image is displayed on the display in the first display status. ### Claim 11 (depends on 10) The display control apparatus according to claim 10, wherein: the processor displays the object's image and the auxiliary substitute image on the display in such a manner that the image which is displayed in the first display status becomes larger than the image which is displayed in the second display status. ### Claim 12 (depends on 10) The display control apparatus according to claim 10, wherein: the processor displays the object's image and the auxiliary substitute image on the display in such a manner that a display position of the image which is displayed in the first display status and a display position of the image which is displayed in the second display status are different from each other. ### Claim 13 (depends on 1) The display control apparatus according to claim 1, wherein: in the first display mode, the object's image is displayed on the display as a main image and the auxiliary substitute image is displayed on the display as a sub image, and in the second display mode, the object's image is displayed on the display as the sub image and the auxiliary substitute image is displayed on the display as the main image. ### Claim 14 (depends on 1) The display control apparatus according to claim 1, further comprising: a reflection section which is disposed on a front-face side of a display surface of the display, wherein the processor acquires a mirror image of the object using the reflection section. ### Claim 15 (depends on 1) The display control apparatus according to claim 1, further comprising: a memory which stores the substitute image of the object. ### Claim 16 A display controlling method comprising: acquiring an image; recognizing, by a processor, a predetermined object from the acquired image; displaying an auxiliary substitute image in which auxiliary information is added to a substitute image of the object on a display, when the predetermined object is recognized from the acquired image; switching between i) a first display mode in which the object's image which is acquired is displayed on the display as a first image and the auxiliary substitute image is displayed on the display as a second image and ii) a second display mode in which the object's image which is acquired is displayed on the display as the second image and the auxiliary substitute image is displayed on the display as the first image; and displaying the object's image and the auxiliary substitute image on the display in the switched to display mode; and managing a proficiency level of a user, wherein: the switching between the first display mode and the second display mode is based on a predetermined condition; and the predetermined condition is a condition which relates to the proficiency level of the user. ### Claim 17 A non-transitory recording medium recording thereon a computer-readable display control program executable by a computer including a display and a processor, the program causing the processor to perform operations of: acquiring an image; recognizing a predetermined object from the acquired image; displaying an auxiliary substitute image in which auxiliary information is added to a substitute image of the object on the display, when the predetermined object is recognized from the acquired image; switching between i) a first display mode in which the object's image which is acquired is displayed on the display as a first image and the auxiliary substitute image is displayed on the display as a second image and ii) a second display mode in which the object's image which is acquired is displayed on the display as the second image and the auxiliary substitute image is displayed on the display as the first image; and displaying the object's image and the auxiliary substitute image on the display in the switched to display mode; and managing a proficiency level of a user, wherein: the switching between the first display mode and the second display mode is based on a predetermined condition; and the predetermined condition is a condition which relates to the proficiency level of the user.