# US 10,771,685 B2 · Automatic guided capturing and presentation of images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,685 B2
- Document ID: US10771685B2
- Status: Granted
- Kind: B2
- Application number: 16/363,158
- Filed: 2019-03-25
- Published: 2019-09-19
- Granted: 2020-09-08
- Earliest claimed: 2015-12-04
- Assignees: eBay Inc.
- Applicants: eBay Inc.
- Inventors: Robinson Piramuthu; Wen Zheng
- Web page: https://patentgrep.com/patent/US10771685B2

## CPC

- G06T 1/0007: {Image acquisition}
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 10/235: {based on user input or interaction}
- G06V 10/28: Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
- G06V 20/20: in augmented reality scenes
- G06V 20/64: Three-dimensional [3D] objects
- H04N 5/2226: {Determination of depth image, e.g. for foreground/background separation (determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10)}
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed are embodiments for facilitating automatic-guided image capturing and presentation. In some embodiments, the method includes capturing an image of an item, removing a background of the image frame, performing manual mask editing, generating an item listing based on the manually edited mask, inferring item information from the image frame and applying the inferred item information to an item listing.

## Claims

### Claim 1

A method, comprising:
capturing a first image representing an item;
classifying a portion of pixels in the first image as background pixels;
modifying the first image based on the classification to generate a second image representing the item;
causing display of the second image on an electronic display;
receiving data defining a scribble on the displayed second image;
smoothing the scribble using domain transform geodesic filtering and scaling the scribble by performing binary quantization of the scribble;
classifying a second portion of pixels in the second image as background pixels based on the smoothed and scaled scribble;
modifying the second image based on the classification to generate a third image representing the item; and
causing display of the third image on the electronic display.

### Claim 2 (depends on 1)

The method of claim 1, wherein classifying the portion of pixels in the first image as background pixels comprises determining a probability for each pixel in the portion of pixels of whether the respective pixel is part of a background of the first image.

### Claim 3 (depends on 2)

The method of claim 2, further comprising determining a color histogram for the first image, wherein the determining of the probabilities is based on the color histogram.

### Claim 4 (depends on 1)

The method of claim 1, further comprising causing display of guidance to position the mobile device in a direction from the item such that the item is included within a bounded area of a user interface of the mobile device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising: classifying the item as represented by the third image; and
generating an item listing for the item based on the classification.

### Claim 6 (depends on 1)

The method of claim 1, wherein causing display of the second image comprises causing display of a binary mask of the second image, and the receiving of the data defining the scribble comprises receiving input defining one or more changes to the binary mask.

### Claim 7 (depends on 1)

The method of claim 1, wherein classifying a portion of pixels in the first image as background pixels comprises generating a binary mask of the first image, smoothing and scaling the binary mask, wherein the modification of the first image is based on the smoothed and scaled binary mask.

### Claim 8

A system, comprising:
hardware processing circuitry;
one or more hardware memories storing instructions that when executed configure the hardware processing circuitry to perform operations comprising:
capturing a first image representing an item;
classifying a portion of pixels in the first image as background pixels;
modifying the first image based on the classification to generate a second image representing the item;
causing display of the second image on an electronic display;
receiving data defining a scribble on the displayed second image;
smoothing the scribble using domain transform geodesic filtering and scaling the scribble by performing binary quantization of the scribble;
classifying a second portion of pixels in the second image as background pixels based on the smoothed and scaled scribble;
modifying the second image based on the classification to generate a third image representing the item; and
causing display of the third image on the electronic display.

### Claim 9 (depends on 8)

The system of claim 8, wherein classifying the portion of pixels in the first image as background pixels comprises determining a probability for each pixel in the portion of pixels of whether the respective pixel is part of a background of the first image.

### Claim 10 (depends on 9)

The system of claim 9, the operations further comprising determining a color histogram for the first image, wherein the determining of the probabilities is based on the color histogram.

### Claim 11 (depends on 8)

The system of claim 8, the operations further comprising causing display of guidance to position the mobile device in a direction from the item such that the item is included within a bounded area of a user interface of the mobile device.

### Claim 12 (depends on 8)

The system of claim 8, further comprising:
classifying the item as represented by the third image; and
generating an item listing for the item based on the classification.

### Claim 13 (depends on 8)

The system of claim 8, wherein causing the display of the second image comprises causing display of a binary mask of the second image, and the receiving of the data defining the scribble comprises receiving input defining one or more changes to the binary mask.

### Claim 14 (depends on 8)

The system of claim 8, wherein classifying a portion of pixels in the first image as background pixels comprises generating a binary mask of the first image, smoothing and scaling the binary mask, wherein the modification of the first image is based on the smoothed and scaled binary mask.

### Claim 15

A non-transitory computer readable storage medium comprising instructions that when executed configure hardware processing circuitry to perform operations comprising:
capturing a first image representing an item;
classifying a portion of pixels in the first image as background pixels; modifying the first image based on the classification to generate a second image representing the item;
causing display of the second image on an electronic display;
receiving data defining a scribble on the displayed second image;
smoothing the scribble using domain transform geodesic filtering and scaling the scribble by performing binary quantization of the scribble;
classifying a second portion of pixels in the second image as background pixels based on the smoothed and scaled scribble;
modifying the second image based on the classification to generate a third image representing the item; and
causing display of the third image on the electronic display.

### Claim 16 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein causing display of the second image comprises causing display of a binary mask of the second image, and the receiving of the data defining the scribble comprises receiving input defining one or more changes to the binary mask.

### Claim 17 (depends on 15)

The non-transitory computer readable storage medium of claim 15,
wherein classifying a portion of pixels in the first image as background pixels comprises generating a binary mask of the first image, smoothing and scaling the binary mask, wherein the modification of the first image is based on the smoothed and scaled binary mask.