# US 2013/0156274 A1 · Using photograph to initiate and perform action

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156274 A1
- Document ID: US20130156274A1
- Status: Published application
- Kind: A1
- Application number: 13/329,327
- Filed: 2011-12-19
- Published: 2013-06-20
- Earliest claimed: 2011-12-19
- Assignees: Microsoft Corporation
- Inventors: Daniel Buchmueller; Amir Akbarzadeh; Michael Kroepfl
- Web page: https://patentgrep.com/patent/US20130156274A1

## CPC

- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- G06Q 10/42: Determination of affinities or common interests between users
- G06Q 10/48: using social graphs
- G06V 20/30: in albums, collections or shared content, e.g. social network photos or video
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Actions, such as adding new connection to a social graph, may be performed through picture taking. In one example, a user takes a picture of one or more people. The face in the picture may be sent to a social network for identification. The social network may use various resources to identify the face, including the social network's picture database and its social graph. When the person in the picture has been identified, the user may indicate an action (e.g., “adding as a friend” in a social network) to be performed with respect to the identified person. The action requested by the user may be then performed with respect to the identified person.

## Claims

### Claim 1

A computer-readable medium having executable instructions to initiate an action with a picture, the executable instructions, when executed by a computer, causing the computer to perform acts comprising:
receiving, from a user, an indication of a face in a photograph;
sending information that represents said face to a server that operates said social network, said server identifying one or more candidates of said face;
receiving a list of said one or more candidates from said server;
based on said list of candidates, receiving a request from said user to add a person associated with said face as a connection in a social network; and
adding a first one of said one or more candidates as a connection of said user in said social network.

### Claim 2 (depends on 1)

The computer-readable medium of claim 1, said server using a photo database stored at said server to identify said candidates based on visual similarity of said face to faces stored in said photo database.

### Claim 3 (depends on 1)

The computer-readable medium of claim 1, said server maintaining a social graph of relationships between users of said social network, said server using said social graph to identify said candidates based on social distance between said candidates and said user, or between said candidates and a photographer who took said photograph.

### Claim 4 (depends on 1)

The computer-readable medium of claim 1, said server maintaining data on locations of users of said social network, said photograph being associated with metadata that indicates a place and time at which said photograph was taken, said server identifying said candidates based on whether said candidates were at said place at said time.

### Claim 5 (depends on 1)

The computer-readable medium of claim 1, said server maintaining a social graph of relationships between users of said social network, said social graph indicating a workplace, an interest, and an age for each of the users of said social network, said server identifying said candidates based on comparing of said candidates' workplaces, interests, and ages with workplaces, interests, and ages of users in said social graph.

### Claim 6 (depends on 1)

The computer-readable medium of claim 1, said acts further comprising:
sending an e-mail to said first one of said candidates based on said first one of said candidates having been identified by said server as one of said candidates.

### Claim 7 (depends on 1)

The computer-readable medium of claim 1, said acts further comprising:
inviting said first one of said candidates to an event based on said first one of said candidates having been identified by said server as one of said candidates.

### Claim 8 (depends on 1)

The computer-readable medium of claim 1, said computer being a handheld device of said user, said device comprising a camera, said acts further comprising:
using said camera on said device to capture said photograph.

### Claim 9

A method of identifying a request target based on a picture, the method comprising:
using a processor to perform acts comprising:
receiving, from a user, an image of a first face in a photograph ;
using said first face, said social graph, and a photo database to identify one or more candidates in said social graph as being said target person;
providing a list of said candidates to a device of said user;
based on a fact that a first one of said candidates was identified as being one of said candidates based on said first face, and not based on said user's having identified said first one of said candidates using text, receiving a request by said user to add a connection to a target person in a social graph; and
adding, to said social graph, a connection between a first one of said candidates and said user.

### Claim 10 (depends on 9)

The method of claim 9, identifying of said one or more candidates being based on visual similarity between said first face and faces stored in said photo database.

### Claim 11 (depends on 9)

The method of claim 9, said identifying of said one or more candidates being based on social distance between said candidates and said user.

### Claim 12 (depends on 9)

The method of claim 9, said photograph having been taken by a photographer other than said user, said identifying of said one or more candidates being based on social distance between said candidates and said photographer.

### Claim 13 (depends on 9)

The method of claim 9, said acts further comprising:
maintaining data on physical locations of people in said social graph, said photograph being associated with metadata that indicates a place and time at which said photograph was taken, identifying of said one or more candidates being based on whether said candidates were at said place at said time.

### Claim 14 (depends on 9)

The method of claim 9, said social graph indicating relationships between people, said social graph indicating a workplace, an interest, and an age for each of said people, identifying of said one or more candidates being based on comparing of said candidates' workplaces, interests, and ages with workplaces, interests, and ages of said people in said social graph.

### Claim 15 (depends on 9)

The method of claim 9, said device being a handheld device of said user, said device comprising a camera, said photograph having been captured by said user using said camera.

### Claim 16 (depends on 9)

The method of claim 9, said receiving of said first face comprising receiving of said photograph, said photograph containing said first face and one or more second faces, identifying of said one or more candidates being based relationships between an identity associated with said first face and identities associates with said one or more second faces.

### Claim 17

A system for identifying a request target based on a picture, the system comprising:
a memory;
a processor;
a social graph that defines relationships among people in a social network;
a photo database that stores photographs and metadata relating to said photographs; and
a component that is stored in said memory and that executes on said processor, that receives a photograph containing a first face and one or more second faces, that uses said first face, said social graph, and said photo database to identify one or more candidates in said social graph as being said target person, that provides providing a list of said candidates to a device of a user, that receives, from said user a request to add a connection between said user and said target person in said social graph, and that adds to said social graph a connection between a first one of said candidates and said user based on a fact that a first one of said candidates was identified as being one of said candidates based on said first face, and not based on said user's having identified said first one of said candidates using text.

### Claim 18 (depends on 17)

The system of claim 17, said component identifying said one or more candidates based relationships between an identity associated with said first face and identities associates with said one or more second faces.

### Claim 19 (depends on 17)

The system of claim 17, said component identifying said one or more candidates based on social distance between said candidates and said user, or between said one or more candidates and a photographer who took said photograph.

### Claim 20 (depends on 17)

The system of claim 17, said social graph maintaining data on physical locations of people in said social graph, said photograph being associated with metadata that indicates a place and time at which said photograph was taken, said component identifying said one or more candidates based on whether said candidates were at said place at said time