# US 2021/0081648 A1 · Facial recognition based auto zoom

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081648 A1
- Document ID: US20210081648A1
- Status: Published application
- Kind: A1
- Application number: 16/570,254
- Filed: 2019-09-13
- Published: 2021-03-18
- Earliest claimed: 2019-09-13
- Assignees: Citrix Systems, Inc.
- Applicants: Citrix Systems, Inc.
- Inventors: Nandikotkur Achyuth; Divyansh Deora; Arnav Akhoury
- Web page: https://patentgrep.com/patent/US20210081648A1

## CPC

- G06V 40/161: {Detection; Localisation; Normalisation}
- G06T 3/02: Affine transformations (for image registration G06T3/147; for image mosaicing G06T3/4038)
- G06T 3/10: Selection of transformation methods according to the characteristics of the input images
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/17: {using hand-held instruments}
- G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V 40/172: {Classification, e.g. identification}
- G06T 2207/30201: Face
- G06T 2210/12: Bounding box
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A smart device having a photo processing system, and a related program product and method for processing photos. The photo processing system includes: a detector that detects when a photo is displayed on the smart device; an auto capture system that captures a viewer image from a front facing camera on the smart device in response to detecting that the photo is being displayed; a facial matching system that determines whether the viewer image matches any face images in the photo; and an auto zoom system that enlarges and displays a matched face image from the photo.

## Claims

### Claim 1

A smart device having a photo processing system, comprising:
a detector that detects when a photo is displayed on the smart device;
an auto capture system that captures a viewer image from a front facing camera on the smart device in response to detecting that the photo is being displayed;
a facial matching system that determines whether the viewer image matches any face images in the photo; and
an auto zoom system that enlarges and displays a matched face image from the photo.

### Claim 2 (depends on 1)

The smart device of claim 1, wherein the detector analyzes the photo using a face detection algorithm to determine whether the photo comprises a group photo.

### Claim 3 (depends on 2)

The smart device of claim 2, wherein the auto capture system, facial matching system and auto zoom system are activated only when the photo comprises a group photo.

### Claim 4 (depends on 1)

The smart device of claim 1, wherein the facial matching system uses facial recognition.

### Claim 5 (depends on 1)

The smart device of claim 1, wherein the auto zoom system places a bounding box around the matched face image and then enlarges an area of the photo in the bounding box.

### Claim 6 (depends on 1)

The smart device of claim 1, wherein the facial matching system determines whether the viewer image includes two captured face images and in response to a determination of two captured face images, the facial matching system determines whether the two captured face images match two face images in the photo.

### Claim 7 (depends on 6)

The smart device of claim 6, wherein, in response to the two captured face images matching two face images in the photo, the auto zoom system places a bounding box around both face images in the photo and enlarges an area of the photo in the bounding box.

### Claim 8

A computer program product stored on a computer readable storage medium, which when executed by a processor on a smart device, processes photos, wherein the computer program product comprises:
program code that detects when a photo is displayed on the smart device;
program code that captures a viewer image from a front facing camera on the smart device in response to detecting that the photo is being displayed;
program code that determines whether the viewer image matches any face images in the photo; and
program code that enlarges and displays a matched face image from the photo.

### Claim 9 (depends on 8)

The program product of claim 8, wherein the program code that detects when the photo is displayed further analyzes the photo using a face detection algorithm to determine whether the photo comprises a group photo.

### Claim 10 (depends on 9)

The program product of claim 9, further comprising program code that causes the program product to exit further processing of the photo if the photo is not a group photo.

### Claim 11 (depends on 8)

The program product of claim 8, wherein the program code that determines whether the viewer image matches any face images in the photo uses facial recognition.

### Claim 12 (depends on 8)

The program product of claim 8, wherein the program code that enlarges and displays places a bounding box around the matched face image and then enlarges an area in of the photo in the bounding box.

### Claim 13 (depends on 8)

The program product of claim 8, further comprising program code that determines whether the viewer image includes two captured face images and in response to a determination of two captured face images, determines whether the two captured face images match two face images in the photo.

### Claim 14 (depends on 13)

The program product of claim 13, further comprising program code that, in response to the two captured face images matching two face images in the photo, places a bounding box around both face images in the photo and enlarges an area of the photo in the bounding box.

### Claim 15

A method for processing a photo on a smart device, comprising:
detecting when a photo is displayed on the smart device;
capturing a viewer image from a front facing camera on the smart device in response to detecting that the photo is being displayed;
determining whether the viewer image matches any face images in the photo; and
enlarging and displaying a matched face image from the photo.

### Claim 16 (depends on 15)

The method of claim 15, wherein the detecting analyzes the photo using a face detection algorithm to determine whether the photo comprises a group photo.

### Claim 17 (depends on 16)

The method of claim 16, further comprising exiting further processing the photo if the photo is not a group photo.

### Claim 18 (depends on 15)

The method of claim 15, wherein the zooming includes placing a bounding box around the matched face image and then enlarging an area of the photo in the bounding box.

### Claim 19 (depends on 15)

The method of claim 15, further comprising determining whether the viewer image includes two captured face images and in response to a determination of two captured face images, determining whether the two captured face images match two face images in the photo.

### Claim 20 (depends on 19)

The method of claim 19, wherein, in response to the two captured face images matching two face images in the photo, placing a bounding box around both face images in the photo and enlarging an area of the photo in the bounding box.
