# US 10,482,519 B1 · Relationship-based search and recommendations via authenticated negatives > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,519 B1 - Document ID: US10482519B1 - Status: Granted - Kind: B1 - Application number: 14/546,859 - Filed: 2014-11-18 - Granted: 2019-11-19 - Earliest claimed: 2014-11-18 - Assignees: Netflix, Inc. - Applicants: Netflix, Inc. - Inventors: Vijay Bharadwaj - Web page: https://patentgrep.com/patent/US10482519B1 ## CPC - G06Q 30/0631: {Recommending goods or services} - G06F 16/9535: Search customisation based on user profiles and personalisation - H04L 63/08: {for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32)} - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract One embodiment of the present invention sets forth techniques for generating recommendation sets for a first client device. A recommendation system receives, from the first client device, a first selection of a first recommended item included in a plurality of recommended items. The recommendation system identifies a second recommended item included in the plurality of recommended items that has not been selected. The recommendation system retrieves an authenticated negative item from a plurality of authenticated negative items. The recommendation system stores one or more entries in a log file comprising a plurality of entries, based on at least one of the first recommended item, the second recommended item, and the authenticated negative item. One advantage of the disclosed techniques is that the use of authenticated negative examples, also referred to herein as authenticated negative items, provides a more relevant set of recommendations for the user. ## Claims ### Claim 1 A method, comprising: receiving, from a first client device, a first selection of a first recommended item included in a plurality of recommended items presented on the first client device for streaming to the first client device over a network, wherein each of the plurality of recommended items is tagged with a user identifier associated with a user of the first client device; identifying a second recommended item included in the plurality of recommended items that has not been selected for presentation by the user of the first client device, wherein the second recommended item is marked as an item that has not been selected for presentation by the user of the first client device; retrieving an authenticated negative item from a plurality of authenticated negative items not included in the plurality of recommended items, wherein the plurality of authenticated negative items are not presented on the first client device and are associated with content deemed to be undesirable by one or more users other than the user of the first client device; tagging the authenticated negative item with the user identifier associated with the user of the first client device; marking the authenticated negative item as an item that has not been selected by the user of the first client device; storing in a digital log file one or more entries associated with a presentation of the plurality of recommended items on the first client device, wherein each of the one or more entries includes the user identifier associated with the user of the first client device, and wherein at least one of the one or more entries identifies the authenticated negative item tagged with the user identifier and marked as an item that has not been selected; and generating a second plurality of recommended items for presentation on the first client device based at least on the one or more entries stored in the digital log file. ### Claim 2 (depends on 1) The method of claim 1, further comprising identifying all remaining recommended items included in the plurality of recommended items that have not been selected. ### Claim 3 (depends on 2) The method of claim 2, further comprising, for each of the remaining recommended items, storing an entry in the digital log file based on the recommended item. ### Claim 4 (depends on 1) The method of claim 1, wherein each entry in the one or more entries plurality of entries includes an item identifier and at least one rating parameter. ### Claim 5 (depends on 4) The method of claim 4, wherein the at least one rating parameter includes a popularity value. ### Claim 6 (depends on 4) The method of claim 4, wherein the at least one rating parameter includes a genre. ### Claim 7 A non-transitory computer-readable storage medium including instructions that, when executed by a processing unit, cause the processing unit to perform an operation, the operation comprising: receiving, from a first client device, a first selection of a first recommended item included in a plurality of recommended items presented on the first client device for streaming to the first client device over a network, wherein each of the plurality of recommended items is tagged with a user identifier associated with a user of the first client device; identifying a second recommended item included in the plurality of recommended items that has not been selected for presentation by the user of the first client device, wherein the second recommended item is marked as an item that has not been selected for presentation by the user of the first client device; retrieving an authenticated negative item from a plurality of authenticated negative items not included in the plurality of recommended items, wherein the plurality of authenticated negative items are not presented on the first client device and are associated with content deemed to be undesirable by one or more users other than the user of the first client device; tagging the authenticated negative item with the user identifier associated with the user of the first client device; marking the authenticated negative item as an item that has not been selected by the user of the first client device; storing in a digital log file one or more entries associated with a presentation of the plurality of recommended items on the first client device, wherein each of the one or more entries includes the user identifier associated with the user of the first client device, and wherein at least one of the one or more entries identifies the authenticated negative item tagged with the user identifier and marked as an item that has not been selected; and generating a second plurality of recommended items for presentation on the first client device based at least on the one or more entries stored in the digital log file. ### Claim 8 (depends on 7) The non-transitory computer-readable storage medium of claim 7, wherein the operation further comprises, identifying all remaining recommended items included in the plurality of recommended items that have not been selected. ### Claim 9 (depends on 8) The non-transitory computer-readable storage medium of claim 8, wherein the operation further comprises, for each of the remaining recommended items, storing an entry in the digital log file based on the recommended item. ### Claim 10 (depends on 7) The non-transitory computer-readable storage medium of claim 7, wherein at least one of the first recommended item, the second recommended item, and the authenticated negative item is related to a good or service that is available for purchase. ### Claim 11 (depends on 7) The non-transitory computer-readable storage medium of claim 7, wherein at least one of the first recommended item, the second recommended item, and the authenticated negative item is related to a media title that is available for streaming to the first client device. ### Claim 12 (depends on 7) The non-transitory computer-readable storage medium of claim 7, wherein each entry in the plurality of entries includes a user identifier, an item identifier, and at least one rating parameter. ### Claim 13 (depends on 12) The non-transitory computer-readable storage medium of claim 12, wherein the at least one rating parameter includes a popularity value. ### Claim 14 A computing device, comprising: a memory; and a processor that executes instructions stored in the memory to: receive, from a first client device, a first selection of a first recommended item included in a plurality of recommended items presented on the first client device for streaming to the first client device over a network, wherein each of the plurality of recommended items is tagged with a user identifier associated with a user of the first client device, and identify a second recommended item included in the plurality of recommended items that has not been selected for presentation by the user of the first client device, wherein the second recommended item is marked as an item that has not been selected for presentation by the user of the first client device, retrieve an authenticated negative item from a plurality of authenticated negative items not included in the plurality of recommended items, wherein the plurality of authenticated negative items are not presented on the first client device and are associated with content deemed to be undesirable by one or more users other than the user of the first client device, tag the authenticated negative item with the user identifier associated with the user of the first client device, mark the authenticated negative item as an item that has not been selected by the user of the first client device, store in a digital log file one or more entries associated with a presentation of the plurality of recommended items on the first client device, wherein each of the one or more entries includes the user identifier associated with the user of the first client device, and wherein at least one of the one or more entries identifies the authenticated negative item tagged with the user identifier and marked as an item that has not been selected, and generate a second plurality of recommended items for presentation on the first client device based at least on the one or more entries stored in the digital log file.