# US 9,438,806 B2 · Photographing apparatus and photographing method for displaying combined avatar and map information related to a subject > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,806 B2 - Document ID: US9438806B2 - Status: Granted - Kind: B2 - Application number: 14/051,533 - Filed: 2013-10-11 - Published: 2014-02-06 - Granted: 2016-09-06 - Earliest claimed: 2010-09-17 - Assignees: Olympus Corporation - Applicants: Olympus Corporation - Inventors: Osamu Nonaka; Manabu Ichikawa; Koichi Nakata - Web page: https://patentgrep.com/patent/US9438806B2 ## CPC - H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)} - H04N 1/00323: {with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location} - H04N 1/0044: {for image preview or review, e.g. to help the user position a sheet} - H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)} - G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) - H04N 2101/00: Still video cameras - H04N 2201/3245: of image modifying data, e.g. handwritten addenda, highlights or augmented reality information - H04N 2201/3253: Position information, e.g. geographical position at time of capture, GPS data - H04N 2201/3273: Display - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A digital camera includes: a display section displaying a photographing image obtained by photographing a subject; a signal processing and control section reading out information related to the subject and information related to surroundings of the subject from a database on the basis of position information and compass direction information about the digital camera; and a display control section selecting the information related to the subject according to the lens condition and performing control so as to display the selected information on the display section by superimposing the selected information on the photographing image. ## Claims ### Claim 1 A method for displaying information related to a photographed subject, the method comprising: displaying an image including the photographed subject, on a display section of a photographing apparatus; retrieving map information recorded in a database system based on both (1) a position of the photographing apparatus at the time the image including the photographed subject was captured and (2) an orientation of the photographing apparatus at the time the image including the photographed subject was captured; retrieving avatar information from the database system using object recognition on the photographed object; and displaying the retrieved avatar information on the display section by superimposing the retrieved avatar information on the retrieved map information. ### Claim 2 (depends on 1) The method according to claim 1 wherein the map information is one of (A) ordinary map, (B) an aerial photograph, or (C) a satellite photograph. ### Claim 3 (depends on 2) The method according to claim 2 wherein the map information is obtained by slicing a predetermined range from map information recorded in the database system. ### Claim 4 (depends on 1) The method according to claim 1 wherein the orientation of the photographing apparatus is a shooting direction. ### Claim 5 (depends on 1) The method according to claim 1 wherein the orientation of the photographing apparatus is a direction defined by a compass direction judging section of the photographing apparatus. ### Claim 6 (depends on 1) The method according to claim 1 wherein the map information retrieved is a vicinity map including a landmark within a predetermined distance of the position of the photographing apparatus. ### Claim 7 (depends on 1) The method according to claim 1 further comprising: combining the retrieved avatar information with the map information; and iconifying the combined avatar and map information to generate a combined avatar-map icon, wherein the act of displaying the retrieved avatar information on the display section includes superimposing the combined avatar-map icon on the photographing image. ### Claim 8 (depends on 7) The method according to claim 7 wherein the retrieved avatar information is combined with the map information at a location on the map determined using a focus adjustment position. ### Claim 9 (depends on 1) The method according to claim 1 wherein the photographed subject is a particular person and wherein retrieved avatar information is a representation of the particular person. ### Claim 10 A method for displaying information related to a photographed subject, the method comprising: displaying an image including the photographed subject, on a display section of a photographing apparatus; retrieving map information recorded in a database system based on both (1) a position of the photographing apparatus at the time the image including the photographed subject was captured and (2) an orientation of the photographing apparatus at the time the image including the photographed subject was captured; forming an avatar image by at least one of (A) extracting characteristics of the photographed subject, (B) simplifying contours of the photographed subject, and (C) combining face parts of the photographed subject; and displaying the avatar image on the display section by superimposing the avatar image on the retrieved map information. ### Claim 11 Photographing apparatus for displaying information related to a photographed subject, the apparatus comprising: a display section configured to display an image including the photographed subject; a communications section adapted to 1) retrieve map information recorded in a database system based on both (1) a position of the photographing apparatus at the time the image including the photographed subject was captured and (2) an orientation of the photographing apparatus at the time the image including the photographed subject was captured, and 2) retrieve avatar information from the database system using object recognition on the photographed subject; and a display control section adapted to display the retrieved avatar information on the display section by superimposing the retrieved avatar information on the retrieved map information. ### Claim 12 (depends on 11) The photographing apparatus according to claim 11 wherein the map information is one of (A) ordinary map, (B) an aerial photograph, or (C) a satellite photograph. ### Claim 13 (depends on 11) The photographing apparatus according to claim 11 wherein the orientation of the photographing apparatus is a shooting direction. ### Claim 14 (depends on 11) The photographing apparatus according to claim 11 further comprising: a compass direction judging section adapted to determine the orientation of the photographing apparatus. ### Claim 15 (depends on 11) The photographing apparatus according to claim 11 wherein the database system is remote from the photographing apparatus. ### Claim 16 (depends on 11) The photographing apparatus according to claim 11 wherein the map information retrieved is a vicinity map including a landmark within a predetermined distance of the position of the photographing apparatus. ### Claim 17 (depends on 11) The photographing apparatus according to claim 11 wherein the display control section is further adapted to (1) combine the retrieved avatar information with the map information, and (2) iconify the combined avatar and map information to generate a combined avatar-map icon, wherein the display control section displays the retrieved avatar information on the display section by superimposing the combined avatar-map icon on the photographing image. ### Claim 18 (depends on 17) The photographing apparatus of claim 17 wherein the retrieved avatar information is combined with the map information at a location on the map determined using a focus adjustment position. ### Claim 19 (depends on 11) The photographing apparatus according to claim 11 wherein the photographed subject is a particular person and wherein retrieved avatar information is a representation of the particular person.