# US 10,769,196 B2 · Method and apparatus for displaying electronic photo, and mobile device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,196 B2
- Document ID: US10769196B2
- Status: Granted
- Kind: B2
- Application number: 15/562,090
- Filed: 2015-03-27
- Published: 2018-03-15
- Granted: 2020-09-08
- Earliest claimed: 2015-03-27
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Yuanrong Zhang
- Web page: https://patentgrep.com/patent/US10769196B2

## CPC

- G06Q 10/40: Business processes related to social networking or social networking services
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 16/10: File systems; File servers
- G06F 16/23: Updating
- G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/587: using geographical or spatial information, e.g. location
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention provides a method and an apparatus for displaying an electronic photo. A key object included in an electronic photo is identified, associated information that matches the key object is integrated, and the associated information is constantly updated, so that information included in the electronic photo is dynamic and fresh, and an amount of the information included in the electronic photo is increased. The method includes: identifying a key object included in the electronic photo, obtaining, for at least one time, associated information that matches the identified key object, and presenting the associated information and the electronic photo when a preset presentation manner is triggered.

## Claims

### Claim 1

A method for displaying an electronic photograph, implemented by a device, comprising:
identifying a face included in a first electronic photograph captured and stored on the device;
classifying an area in which a first key object included in the first electronic photograph is located as a first hotspot area;
marking a position of the first hotspot area in the first electronic photograph to obtain position information corresponding to the first hotspot area;
establishing, for the first key object, a mapping relationship between the position information of the first hotspot area and associated information of the first key object that is obtained at a current time;
saving, in an associative manner, the first electronic photograph and the mapping relationship that is established for the first key object;
searching for a second electronic photograph that includes the face from a plurality of electronic photographs stored in the device, wherein the first electronic photograph is different from the second electronic photograph;
storing a relationship between the first electronic photograph and the second electronic photograph;
detecting an instruction for viewing the first electronic photograph;
obtaining a current mood associated with the face in response to detecting the instruction for viewing the first electronic photograph; and
simultaneously presenting, based on the relationship, the first electronic photograph, the second electronic photograph, and the current mood associated with the face on a display screen of the device by:
presenting the first electronic photograph;
obtaining current position information of a person associated with the face when the first electronic photograph is tapped; and
presenting the current position information in a designated position in the first electronic photograph.

### Claim 2 (depends on 1)

The method of claim 1, further comprising one of:
searching contact status information corresponding to a contact profile picture that matches the face for contact profile pictures in a third-party social application program;
identifying key information included in the face and searching files stored in the device for a file that matches the face;
identifying the key information included in the face and searching information that matches the face for a third-party unsocial application program; or
identifying the key information included in the face and invoking an Internet interface to search the Internet for information that matches the key information.

### Claim 3 (depends on 1)

The method of claim 1, further comprising one of:
presenting link information of associated information in a designated position in the first electronic photograph, and when the link information is tapped, setting a window, embedding the associated information in the window, and presenting, in the first electronic photograph, the window in which the associated information is embedded;
presenting the link information of the associated information in the designated position in the first electronic photograph, and when the link information is tapped, jumping to an application program that provides the associated information;
embedding the associated information in the first electronic photograph for presentation; or
presenting the associated information in a background of the device.

### Claim 4 (depends on 1)

The method of claim 1, further comprising detecting an instruction for tapping a hotspot area in which the face is located.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
obtaining environment information of an environment in which the first electronic photograph is taken; and
obtaining associated information that matches both the face and the environment information.

### Claim 6 (depends on 5)

The method of claim 5, further comprising presenting the environment information of the environment in which the first electronic photograph is taken in the first electronic photograph.

### Claim 7 (depends on 1)

The method of claim 1, further comprising simultaneously displaying an icon representing a manner of contacting a person associated with the face when the first electronic photograph, the second electronic photograph, and the current mood are displayed.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
analyzing data from one or more third-party social applications; and
simultaneously displaying information obtained from analyzing the data from the one or more third-party social applications along with the current mood.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
obtaining a current altitude and a current temperature; and
simultaneously displaying the current altitude and the current temperature along with the current mood.

### Claim 10 (depends on 1)

The method of claim 1, further comprising simultaneously displaying a current location of a person associated with the face along with the current mood, wherein the current location of the person is different than a location of the person when the first electronic photograph was taken.

### Claim 11

A mobile device in communication with a server, comprising:
a display screen configured to display a first electronic photograph and associated information;
an input device configured to detect an input from a user;
a memory configured to store instructions, the first electronic photograph, and the associated information; and
a processor, wherein the input device, the display screen, the memory, and the processor are communicatively coupled to each other using a bus, and wherein the processor is configured to execute the instructions to configure the mobile device to be configured to:
identify a face included in the first electronic photograph and stored on the mobile device;
classify an area in which the face included in the first electronic photograph is located as a first hotspot area;
mark a position of the first hotspot area in the first electronic photograph to obtain position information corresponding to the first hotspot area;
establish, for the face, a mapping relationship between the position information of the first hotspot area and associated information of the face that is obtained at a current time:
save, in an associative manner, the first electronic photograph and the mapping relationship that is established for the face;
search for a second electronic photograph that includes the face from a plurality of electronic photographs stored in the mobile device, wherein the first electronic photograph is different from the second electronic photograph;
store a relationship between the first electronic photograph and the second electronic photograph;
detect an instruction for viewing the first electronic photograph;
obtain a current mood associated with the face in response to detecting the instruction for viewing the first electronic photograph; and
simultaneously present, based on the relationship, the first electronic photograph, the second electronic photograph, and the current mood associated with the face on the display screen of the mobile device by:
presenting the first electronic photograph;
obtaining current position information of a person associated with the face when the first electronic photograph is tapped; and
presenting the current position information in a designated position in the first electronic photograph.

### Claim 12 (depends on 11)

The mobile device of claim 11, wherein the processor is further configured to execute the instructions to configure the mobile device to be configured to perform one of:
obtaining the associated information that matches the face when a specified period elapses;
obtaining the associated information that matches the face when an instruction to obtain the associated information that matches the face is detected; or
obtaining the associated information that matches the face when the instruction for viewing the first electronic photograph is detected.

### Claim 13 (depends on 11)

The mobile device of claim 11, wherein the processor is further configured to execute the instructions to configure the mobile device to be configured to perform one of:
searching contact status information corresponding to a contact profile picture that matches the face for contact profile pictures in a third-party social application program;
identifying key information included in the face and searching files provided by the mobile device for a file that matches the face;
identifying the key information included in the face and searching a third-party unsocial application program for information that matches the face; or
identifying the key information included in the face and invoking an Internet interface to search the Internet for information that matches the key information.

### Claim 14 (depends on 11)

The mobile device of claim 11, wherein the processor is further configured to execute the instructions to configure the mobile device to be configured to perform one of:
presenting link information of associated information in a designated position in the first electronic photograph, and when the link information is tapped, setting a window, embedding the associated information in the window, and presenting, in the first electronic photograph, the window in which the associated information is embedded;
presenting the link information of the associated information in the designated position in the first electronic photograph, and when the link information is tapped, jumping to an application program that provides the associated information;
embedding the associated information in the first electronic photograph for presentation; or
presenting the associated information in a background of the mobile device.

### Claim 15 (depends on 11)

The mobile device of claim 11, wherein the processor is further configured to execute the instructions to configure the mobile device to be configured to detect an instruction for tapping a hotspot area in which the face is located.

### Claim 16 (depends on 11)

The mobile device of claim 11, wherein the mobile device further comprises a sensor configured to record environment information of an environment in which the first electronic photograph is taken, and wherein the processor is further configured to execute the instructions to configure the mobile device to be configured to:
obtain the environment information of the environment in which the first electronic photograph is taken; and
obtain associated information that matches both the face and the environment information.

### Claim 17 (depends on 16)

The mobile device of claim 16, wherein the processor is further configured to execute the instructions to configure the mobile device to be configured to present the environment information in the first electronic photograph.

### Claim 18

A non-transitory computer-readable medium configured to store an instruction which when executed by a processor causes a device to execute a method for displaying an electronic photo, wherein the method comprises:
identifying a face included in a first electronic photograph captured and stored on the device;
classifying an area in which a first key object included in the first electronic photograph is located as a first hotspot area;
marking a position of the first hotspot area in the first electronic photograph to obtain position information corresponding to the first hotspot area;
establishing, for the first key object, a mapping relationship between the position information of the first hotspot area and associated information of the first key object that is obtained at a current time;
saving, in an associative manner, the first electronic photograph and the mapping relationship that is established for the first key object
searching for a second electronic photograph that includes the face from a plurality of electronic photographs stored in the device, wherein the first electronic photograph is different from the second electronic photograph;
storing a relationship between the first electronic photograph and the second electronic photograph;
detecting an instruction for viewing the first electronic photograph;
obtaining a current mood associated with the face in response to detecting the instruction for viewing the first electronic photograph; and
simultaneously presenting, based on the relationship, the first electronic photograph, the second electronic photograph, and the current mood associated with the face on a display screen of the device by:
presenting the first electronic photograph;
obtaining current position information of a person associated with the face when the first electronic photograph is tapped; and
presenting the current position information in a designated position in the first electronic photograph.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the method further comprises simultaneously displaying an icon representing a manner of contacting a person associated with the face when the first electronic photograph, the second electronic photograph, and the current mood are displayed.

### Claim 20 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the method further comprises:
analyzing data from one or more third-party social applications; and
simultaneously displaying information obtained from analyzing the data from the one or more third-party social applications along with the current mood.
