# US 10,770,062 B2 · Adjusting a ranking of information content of a software application based on feedback from a user > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,770,062 B2 - Document ID: US10770062B2 - Status: Granted - Kind: B2 - Application number: 16/564,698 - Filed: 2019-09-09 - Published: 2019-12-26 - Granted: 2020-09-08 - Earliest claimed: 2016-06-23 - Assignees: Intuit Inc. - Applicants: Intuit Inc. - Inventors: Raymond Chan; Igor A. Podgorny; Benjamin Indyk - Web page: https://patentgrep.com/patent/US10770062B2 ## CPC - G10L 15/08: Speech classification or search - G06F 16/24575: {using context} - G06F 16/24578: {using ranking} - G06F 16/683: using metadata automatically derived from the content - G10L 25/63: for estimating an emotional state - G10L 25/72: for transmitting results of analysis - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Techniques are disclosed for adjusting a ranking of information content of a software application based on feedback from a user. One embodiment presented herein includes a method comprising receiving, at a computing device, an audio stream comprising audio of the user, the audio being indicative of feedback related to information content. The method further comprises analyzing the audio stream for paralinguistic information to determine an attribute of the user. The method further comprises adjusting a ranking of the information content based on at least one of the feedback and additional feedback and the determined attribute of the user. ## Claims ### Claim 1 A method, comprising: receiving, from a first user, a first audio stream associated with a content item; extracting a first set of paralinguistic features from the first audio stream; determining an attribute of the first user based on the first set of paralinguistic features; annotating the content item with the attribute of the first user as metadata; receiving a second audio stream from a second user requesting the content item; extracting a second set of paralinguistic features from the second audio stream; determining an attribute of the second user based on the second set of paralinguistic features; determining the attribute of the second user matches the metadata indicating the attribute of the first user; and providing the content item to the second user. ### Claim 2 (depends on 1) The method of claim 1, further comprises: retrieving a set of content items with each content item annotated with the same attribute as the second user; ranking the set of content items; and providing the ranked set of content items to the second user. ### Claim 3 (depends on 2) The method of claim 2, further comprises: adjusting the ranked set based on feedback from the second user. ### Claim 4 (depends on 1) The method of claim 1, wherein the first audio stream is feedback from the first user associated with the content item. ### Claim 5 (depends on 1) The method of claim 1, wherein the first user generates the content item. ### Claim 6 (depends on 1) The method of claim 1, wherein the annotation includes using extensible markup language. ### Claim 7 (depends on 1) The method of claim 1, wherein the annotation includes using emotional markup language. ### Claim 8 A system, comprising: a processor; and a memory storing instructions which when executed by the processor perform a method comprising: receiving, from a first user, a first audio stream associated with a content item; extracting a first set of paralinguistic features from the first audio stream; determining an attribute of the first user based on the first set of paralinguistic features; annotating the content item with the attribute of the first user as metadata; receiving a second audio stream from a second user requesting the content item; extracting a second set of paralinguistic features from the second audio stream; determining an attribute of the second user based on the second set of paralinguistic features; determining the attribute of the second user matches the metadata indicating the attribute of the first user; and providing the content item to the second user. ### Claim 9 (depends on 8) The system of claim 8, further comprises: retrieving a set of content items with each content item annotated with the same attribute as the second user; ranking the set of content items; and providing the ranked set of content items to the second user. ### Claim 10 (depends on 9) The system of claim 9, further comprises: adjusting the ranked set based on feedback from the second user. ### Claim 11 (depends on 8) The system of claim 8, wherein the first audio stream is feedback from the first user associated with the content item. ### Claim 12 (depends on 8) The system of claim 8, wherein the first user generates the content item. ### Claim 13 (depends on 8) The system of claim 8, wherein the annotation includes using extensible markup language. ### Claim 14 (depends on 8) The system of claim 8, wherein the annotation includes using emotional markup language. ### Claim 15 A non-transitory computer-readable storage medium comprising instructions that when executed by a computing device cause the computing device to perform a method, comprising: receiving, from a first user, a first audio stream associated with a content item; extracting a first set of paralinguistic features from the first audio stream; determining an attribute of the first user based on the first set of paralinguistic features; annotating the content item with the attribute of the first user as metadata; receiving a second audio stream from a second user requesting the content item; extracting a second set of paralinguistic features from the second audio stream; determining an attribute of the second user based on the second set of paralinguistic features; determining the attribute of the second user matches the metadata indicating the attribute of the first user; and providing the content item to the second user. ### Claim 16 (depends on 15) The non-transitory computer-readable storage medium of claim 15, further comprises: retrieving a set of content items with each content item annotated with the same attribute as the second user; ranking the set of content items; and providing the ranked set of content items to the second user. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium of claim 16, further comprises: adjusting the ranked set based on feedback from the second user. ### Claim 18 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the first audio stream is feedback from the first user associated with the content item. ### Claim 19 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the first user generates the content item. ### Claim 20 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the annotation includes using extensible markup language.