# US 11,308,153 B1 · Optimal photo selection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,308,153 B1
- Document ID: US11308153B1
- Status: Granted
- Kind: B1
- Application number: 17/522,533
- Filed: 2021-11-09
- Granted: 2022-04-19
- Earliest claimed: 2021-05-24
- Assignees: Aircam Inc.
- Applicants: Aircam Inc.
- Inventors: Evan Rifkin; Ryan Rifkin; David Hopkins; Jonathan Angelo; Marcus Buffet
- Web page: https://patentgrep.com/patent/US11308153B1

## CPC

- G06F 16/5854: {using shape and object relationship}
- G06F 16/587: using geographical or spatial information, e.g. location
- G06Q 10/063112: {Skill-based matching of a person or a group to a task}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)}
- H04N 1/2104: {for one or a few pictures}
- H04W 4/02: Services making use of location information
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

There is disclosed a system, apparatus and methods for optimizing photo selection. When a photographer takes photos as requested in a shot list, the photos are automatically assigned a quality score which correlates to how prominently the photo would be displayed in an online search. The photos and the quality scores are displayed to the photographer so that when the photographer has shot a sufficiently high quality photo then the photographer can stop shooting. Photos with the highest quality scores are optimal. The shot lists include reference photos, and if a new photo has a higher quality score than the corresponding reference photo, the new photo becomes the reference photo.

## Claims

### Claim 1

A method of operating a photo communication program on a mobile device of a photographer to optimize photo selection, the method comprising:
the photo communication program obtaining, from a remote server, a job comprising a shot list comprising information of a plurality of requests for photos to be taken including, for each request, a reference image and a textual description of at least one object required to be included in the photo, the job further comprising a real world location where the photos in the shot list are to be taken;
photo communication program receiving a selection from the photographer of one of the requests;
the mobile device displaying the reference image and the textual description of the selected request;
the photo communication program obtaining a current location of the mobile device from the mobile device;
the photo communication program verifying that the current location is the real world location;
the photo communication program monitoring a real time stream of photos received into the mobile device as taken by the photographer at the real world location;
the photo communication program synchronously with receipt of each photo into the mobile device, automatically assigning a quality score of whether the photo prominently has the required object which is in the selected request;
the photo communication program synchronously with assigning the scores, causing the photos from the stream to be displayed on the mobile device with their respective quality scores for viewing by the photographer;
the photo communication program receiving a selection of one of the scored photos by the photographer; and
the photo communication program modifying the display of the scored photos to emphasize the selected photo.

### Claim 2 (depends on 1)

The method of claim 1 wherein if the score of the selected photo is higher than the score of the reference image of the selected request, causing the selected image to be used as the reference image for the selected request in the shot list.

### Claim 3 (depends on 1)

The method of claim 1 wherein the photographer shoots a series of photos and then pauses.

### Claim 4 (depends on 1)

The method of claim 1 wherein the photographer shoots one photo at a time.

### Claim 5 (depends on 1)

The method of claim 1 wherein the requests include a desired camera angle for the photo to be taken, and a minimum image quality of the photo to be taken.

### Claim 6 (depends on 1)

The method of claim 1 wherein the shot list includes an indication whether a photo satisfying the request has been taken by the photographer.

### Claim 7 (depends on 1)

The method of claim 1 wherein the current location is generalized.

### Claim 8 (depends on 1)

The method of claim 1 wherein assigning a quality score comprises:
detecting, by an artificial intelligence engine, presence of real world objects detected and identified in the photo,
determining, by the artificial intelligence engine, a desired number of the object detections and identifications, and
determining a respective prominence, as determined by the artificial intelligence engine, of the identified objects in the photo.

### Claim 9

A method of optimizing photo selection by a server using a data store of photographer information including, for plural human photographers, identification of the photographer, wherein the photographers have respective mobile devices having a photo communication program which can obtain and report a current location of the mobile device, wherein the identification of the photographer correlates to the photo communication program on the photographer's mobile device, the method comprising steps performed with respect to a plurality of the photographers at a combination of overlapping, concurrent and separate time periods,
the server creating a plurality of jobs each comprising a shot list comprising information of a plurality of requests for photos to be taken including, for each request, a reference image, a textual description of at least one object required to be included in the photo, and a quality score conveying whether the reference image prominently has the required object;
the server obtaining a current location of the mobile devices of the photographers;
the server assigning jobs to the photographers based upon, at least, proximity of the respective current locations of the mobile devices and a real world location where the photos requested in the shot lists are to be taken;
the server causing the assigned jobs to be transmitted to the mobile devices of the respectively assigned photographers;
the server receiving photos from the mobile devices of the photographers, taken by the respective photographers in response to the respective job, each received photo including identification of one of the requests of the shot list to which the photo responds and a quality score conveying whether the photo prominently has the required object which is in the request; and
the server comparing the quality scores of the received photos with the quality scores of the reference images, and if the received photo has a higher quality score than the corresponding reference image, making the received photo the reference image in the shot list.

### Claim 10 (depends on 9)

The method of claim 9 wherein the photographer information includes a skill level of the photographer, and assigning jobs is also based upon the skill levels of the photographers.

### Claim 11

An apparatus comprising a non-volatile machine-readable medium storing a program having instructions which when executed by a processor will cause the processor to optimize photo selection, the instructions of the program for:
obtaining, from a remote server, a job comprising a shot list comprising information of a plurality of requests for photos to be taken including, for each request, a reference image and a textual description of at least one object required to be included in the photo, the job further comprising a real world location where the photos in the shot list are to be taken;
receiving a selection from the photographer of one of the requests;
displaying the reference image and the textual description of the selected request;
obtaining a current location of the mobile device from the mobile device;
verifying that the current location is the real world location;
monitoring a real time stream of photos received into the mobile device as taken by the photographer at the real world location;
synchronously with receipt of each photo into the mobile device, automatically assigning a quality score of whether the photo prominently has the required object which is in the selected request;
synchronously with assigning the scores, causing the photos from the stream to be displayed on the mobile device with their respective quality scores for viewing by the photographer;
the photo communication program receiving a selection of one of the scored photos by the photographer; and
modifying the display of the scored photos to emphasize the selected photo.

### Claim 12 (depends on 11)

The apparatus of claim 11 wherein if the score of the selected photo is higher than the score of the reference image of the selected request, causing the selected image to be used as the reference image for the selected request in the shot list.

### Claim 13 (depends on 11)

The apparatus of claim 11 wherein the photographer shoots a series of photos and then pauses.

### Claim 14 (depends on 11)

The apparatus of claim 11 wherein the photographer shoots one photo at a time.

### Claim 15 (depends on 11)

The apparatus of claim 11 wherein the requests include a desired camera angle for the photo to be taken, and a minimum image quality of the photo to be taken.

### Claim 16 (depends on 11)

The apparatus of claim 11 wherein the shot list includes an indication whether a photo satisfying the request has been taken by the photographer.

### Claim 17 (depends on 11)

The apparatus of claim 11 wherein the current location is generalized.

### Claim 18 (depends on 11)

The apparatus of claim 11 wherein assigning a quality score comprises:
detecting, by an artificial intelligence engine, presence of real world objects detected and identified in the photo,
determining, by the artificial intelligence engine, of the object detections and identifications, and
determining a respective prominence, as determined by the artificial intelligence engine, of the identified objects in the photo.

### Claim 19 (depends on 11)

The apparatus of claim 11 further comprising:
a user input device
a display device
a processor
a memory
wherein the processor and the memory comprise circuits and software for performing the instructions on the storage medium.