# US 2013/0155305 A1 · Orientation of illustration in electronic display device according to image of actual object being illustrated > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0155305 A1 - Document ID: US20130155305A1 - Status: Published application - Kind: A1 - Application number: 13/330,428 - Filed: 2011-12-19 - Published: 2013-06-20 - Earliest claimed: 2011-12-19 - Assignees: Sony Corporation - Inventors: PETER SHINTANI - Web page: https://patentgrep.com/patent/US20130155305A1 ## CPC - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06V 10/242: {by image rotation, e.g. by 90 degrees} - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - G09G 2340/0492: Change of orientation of the displayed image, e.g. upside-down, mirrored - G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels - G09G 2380/14: Electronic books and readers - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A user of an e-book is presented with a changed visual appearance of a presentation on a display that includes a reference image of an object according to a virtually real time image of the object taken by a camera. ## Claims ### Claim 1 A system comprising: housing; display supported by the housing; camera supported by the housing; processor configured for controlling the display and receiving input from the camera; and computer readable storage medium accessible to the processor and storing at least one reference image of an object presentable on the display under control of the processor, the camera configured for generating an object image of the object, the processor configured for accessing the object image and altering a presentation on the display of the reference image according to the object image, wherein the processor is configured to compare the object image to reference images in a library of reference images using image recognition to determine how to alter the presentation on the display of the reference image according to the object image. ### Claim 2 (depends on 1) The system of claim 1, wherein the processor alters the presentation on the display of the reference image according to the object image by combining the object image with the reference image. ### Claim 3 (depends on 1) The system of claim 1, wherein the processor alters the presentation on the display of the reference image according to the object image by combining the object image with the reference image using alpha blending to blend the object image into the reference image. ### Claim 4 (depends on 1) The system of claim 1, wherein the processor alters the presentation on the display of the reference image according to the object image by presenting an instruction on the display to turn the display. ### Claim 5 (depends on 1) The system of claim 1, wherein the processor alters the presentation on the display of the reference image according to the object image by presenting an arrow on the display indicating a direction in which to turn the display. ### Claim 6 (canceled) ### Claim 7 (depends on 1) The system of claim 1, wherein the processor alters the presentation on the display of the reference image according to the object image by reorienting the reference image on the display to match an orientation indicated in the object image. ### Claim 8 (depends on 1) The system of claim 1, comprising a light emitter on the housing, the processor causing the light emitter to illuminate a portion of the object. ### Claim 9 (depends on 1) The system of claim 1, wherein the object is a part of a device that is not the system to be mechanically worked on by a user of the system. ### Claim 10 (depends on 1) The system of claim 1, wherein the object is a geographic landmark. ### Claim 11 A method comprising: receiving an object image of an object; comparing the object image to a reference image of the object in a library of reference images using image recognition to determine how to alter the presentation on a display of the reference image according to the object image to render a modified reference image; and presenting, on the display, a visual presentation of the modified reference image. ### Claim 12 (depends on 11) The method of claim 11, wherein the modified reference image is established at least in part by combining the object image with the reference image. ### Claim 13 (depends on 11) The method of claim 11, wherein the modified reference image is established at least in part by combining the object image with the reference image using alpha blending to blend the object image into the reference image. ### Claim 14 (depends on 11) The method of claim 11, wherein the modified reference image is established at least in part by presenting an instruction on the display to turn the display. ### Claim 15 (depends on 11) The method of claim 11, wherein the modified reference image is established at least in part by presenting an arrow on the display indicating a direction in which to turn the display. ### Claim 16 (canceled) ### Claim 17 (depends on 11) The method of claim 11, wherein the modified reference image is established at least in part by reorienting the reference image on the display to match an orientation indicated in the object image. ### Claim 18 (depends on 11) The method of claim 11, comprising causing a light emitter to illuminate a portion of the object according to a comparison of the object image with the reference image. ### Claim 19 An apparatus, comprising: a display; a processor configured for controlling the display to present a presentation on the display including a reference image of an object; and a camera configured for communicating a virtually real time image of the object to the processor to cause the processor to change a visual appearance of the presentation on the display including the reference image of the object according to the virtually real time image of the object taken by the camera, wherein the processor compares the image of the object to at least one reference image in a library of reference images using image recognition to determine how to change, on the display, the visual presentation of the reference image from a visual presentation of the reference image as established in the library. ### Claim 20 (depends on 19) The apparatus of claim 19, wherein the processor changes a visual appearance of the presentation on the display including the reference image of the object according to the virtually real time image of the object taken by the camera by one or more of: combining the object image with the reference image; combining the object image with the reference image using alpha blending to blend the object image into the reference image; presenting an instruction on the display to turn the display; presenting an arrow on the display indicating a direction in which to turn the display; and reorienting the reference image on the display to match an orientation indicated in the object image.