# US 2019/0244271 A1 · Computer Vision and Image Characteristic Search

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244271 A1
- Document ID: US20190244271A1
- Status: Published application
- Kind: A1
- Application number: 16/388,473
- Filed: 2019-04-18
- Published: 2019-08-08
- Earliest claimed: 2017-12-29
- Assignees: eBay Inc.
- Applicants: eBay Inc.
- Inventors: Robinson Piramuthu; Timothy Samuel Keefer; Kenneth Clark Crookston; Ashmeet Singh Rekhi; Niaz Ahamed Khaja Nazimudeen; Padmapriya Gudipati; Shane Lin; John F. Weigel; Fujun Zhong; Suchitra Ramesh; Mohammadhadi Kiapour; Shuai Zheng; Alberto Ordonez Pereira; Ravindra Surya Lanka; Md Atiq ul Islam; Nicholas Anthony Whyte; Giridharan Iyengar; Bryan Allen Plummer
- Web page: https://patentgrep.com/patent/US20190244271A1

## CPC

- G06Q 30/0627: {by specifying product or service characteristics, e.g. product dimensions}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 16/3326: {using relevance feedback from the user, e.g. relevance feedback on documents, documents sets, document terms or passages}
- G06F 16/532: Query formulation, e.g. graphical querying
- G06F 16/538: Presentation of query results
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/9035: Filtering based on additional data, e.g. user or group profiles
- G06F 16/907: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/908: using metadata automatically derived from the content
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06N 20/00: Machine learning
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06V 20/20: in augmented reality scenes
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06Q 30/0621: {by configuring or customising goods or services}
- G06Q 30/0631: {Recommending goods or services}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Computer vision and image characteristic search is described. The described system leverages visual search techniques by determining visual characteristics of objects depicted in images and comparing the determined characteristics to visual characteristics of other images, e.g., to identify similar visual characteristics in the other images. In some aspects, the described system performs searches that leverage a digital image as part of a search query to locate digital content of interest. In some aspects, the described system surfaces multiple user interface instrumentalities that include images of patterns, textures, or materials and that are selectable to initiate a visual search of digital content having a similar pattern, texture, or material. The described aspects also include pattern-based authentication in which the system determines authenticity of an item in an image based on a similarity of its visual characteristics to visual characteristics of known authentic items.

## Claims

### Claim 1

A method implemented by at least one computing device, the method comprising:
receiving, by the at least one computing device, a selection via a user interface indicating to list an item on a listing service with an authentic designation;
receiving, by the at least one computing device, digital visual content depicting one or more visual characteristics of the item being listed;
comparing, by the at least one computing device, the one or more visual characteristics to one or more known visual characteristics of authentic items depicted in additional digital visual content;
determining, by the at least one computing device, whether the item being listed is authentic based on the comparing; and
responsive to a determination that the item being listed is authentic, surfacing, by the at least one computing device, an indication that a listing of the item on the listing service is allowed to include the authentic designation; or
responsive to a determination that the item being listed is not authentic, surfacing, by the at least one computing device, an indication that the listing of the item on the listing service is not allowed to include the authentic designation.

### Claim 2 (depends on 1)

A method as described in claim 1, further comprising prompting a user via the user interface to provide the digital visual content depicting the one or more visual characteristics.

### Claim 3 (depends on 2)

A method as described in claim 2, wherein the prompting includes causing presentation of a prompt via the user interface that specifies a location of the item being listed to capture in the digital visual content.

### Claim 4 (depends on 2)

A method as described in claim 2, wherein the prompting includes causing presentation of a prompt via the user interface that specifies a feature of the item being listed to capture in the digital visual content.

### Claim 5 (depends on 1)

A method as described in claim 1, further comprising receiving an additional selection to surface the listing of the item with the authentic designation via the listing service.

### Claim 6 (depends on 1)

A method as described in claim 1, wherein the digital visual content depicting the one or more characteristics of the item being listed comprises digital video.

### Claim 7 (depends on 1)

A method as described in claim 1, wherein the digital visual content depicting the one or more characteristics of the item being listed comprises at least one digital image.

### Claim 8

A system comprising:
one or more processors; and
memory having stored thereon computer-readable instructions that are executable by the one or more processors to perform operations comprising:
receiving digital visual content depicting one or more visual characteristics of an item being listed on a listing service;
generating non-textual data indicative of the one or more visual characteristics of the item from the digital visual content;
comparing the non-textual data to additional non-textual data indicative of visual characteristics of known authentic items generated from additional digital visual content depicting the known authentic items;
determining whether the item being listed is authentic based on the comparing; and
controlling presentation of an authentic designation with a listing of the item according to the determining.

### Claim 9 (depends on 8)

A system as described in claim 8, wherein the non-textual data and the additional non-textual data are feature vectors.

### Claim 10 (depends on 8)

A system as described in claim 8, wherein controlling the presentation of the authentic designation with the listing includes allowing the item to be listed via the listing service with the authentic designation responsive to a determination that the item is authentic.

### Claim 11 (depends on 8)

A system as described in claim 8, wherein controlling the presentation of the authentic designation with the listing includes preventing the item from being listed via the listing service with the authentic designation responsive to a determination that the item is not authentic.

### Claim 12 (depends on 8)

A system as described in claim 8, wherein the listing service prevents items from being listed with the authentic designation absent a determination that the items are authentic.

### Claim 13 (depends on 8)

A system as described in claim 8, wherein the operations further comprise receiving a selection via a user interface to list the item on the listing service with the authentic designation.

### Claim 14

A method implemented by at least one computing device, the method comprising:
receiving digital visual content depicting one or more visual characteristics of an item being listed on a listing service;
generating non-textual data indicative of the one or more visual characteristics of the item from the digital visual content;
comparing the non-textual data to additional non-textual data indicative of visual characteristics of known authentic items generated from additional digital visual content depicting the known authentic items;
determining whether the item being listed is authentic based on the comparing; and
controlling presentation of an authentic designation with a listing of the item according to the determining.

### Claim 15 (depends on 14)

A method as described in claim 14, wherein the non-textual data and the additional non-textual data are feature vectors.

### Claim 16 (depends on 14)

A method as described in claim 14, wherein the listing service prevents items from being listed with the authentic designation absent a determination that the items are authentic.

### Claim 17 (depends on 14)

A method as described in claim 14, further comprising causing presentation of a prompt that prompts the user to capture the digital visual content depicting the one or more visual characteristics of the item being listed.

### Claim 18 (depends on 17)

A method as described in claim 17, wherein the prompt prompts the user to capture digital video of the item being listed.

### Claim 19 (depends on 17)

A method as described in claim 17, wherein the prompt prompts the user to capture at least one digital image of the item being listed.

### Claim 20 (depends on 17)

A method as described in claim 17, wherein the prompt specifies at least one of:
a location of the item being listed to capture in the digital visual content; or
a feature of the item being listed to capture in the digital visual content.
