# US 2017/0286531 A1 · Scalable mining of trending insights from text > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0286531 A1 - Document ID: US20170286531A1 - Status: Published application - Kind: A1 - Application number: 15/085,714 - Filed: 2016-03-30 - Published: 2017-10-05 - Earliest claimed: 2016-03-30 - Assignees: LinkedIn Corporation - Applicants: LinkedIn Corporation - Inventors: Yongzheng Zhang; Rui Zhao; Chi-Yi Kuan; Yi Zheng - Web page: https://patentgrep.com/patent/US20170286531A1 ## CPC - G06F 16/3346: {using probabilistic model} - G06F 16/353: into predefined classes - G06F 16/93: Document management systems - G06F 16/951: Indexing; Web crawling techniques - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system and method for identifying trending topics in a document corpus are provided. First, multiple topics are identified, some of which topics may be filtered or removed based on co-occurrence. Then, for each remaining topic, a frequency of the topic in the document corpus is determined, one or more frequencies of the topic in one or more other document corpora are determined, a trending score of the topic is generated based on the determined frequencies. Lastly, the remaining topics are ranked based on the generated trending scores. ## Claims ### Claim 1 A method comprising: identifying a first plurality of topics in a plurality of documents; determining a co-occurrence of one or more pairs of topics in the first plurality of topics; based on the co-occurrence of the one or more pairs of topics, identifying a second plurality of topics that includes fewer topics than the first plurality of topics; for each topic in the plurality of topics: determining one or more frequencies of said each topic, wherein determining the one or more frequencies comprises, for each time period of one or more time periods, determining a frequency of said each topic during said each time period; determining a particular frequency of said each topic in a particular time period that is subsequent to the one or more time periods; generating a trending score for said each topic based on the one or more frequencies and the particular frequency; ranking the plurality of topics based on the trending score for each topic in the plurality of topics; wherein the method is performed by one or more computing devices. ### Claim 2 (depends on 1) The method of claim 1, further comprising: storing a plurality of document corpora, wherein each document corpus of the plurality of document corpora is associated with a different time period of a plurality of time periods that includes the one or more time periods and the particular time period; for a first document corpus of the plurality of document corpora: analyzing the first document corpus to identify a first set of topics, and for each topic in the first set of topics, determining a number of instances, in the first document corpus, of said each topic; for a second document corpus of the plurality of document corpora: analyzing the second document corpus to identify a second set of topics, and for each topic in the second set of topics, determining a number of instances, in the second document corpus, of said each topic. ### Claim 3 (depends on 1) The method of claim 1, wherein: the one or more periods are a plurality of periods; the one or more frequencies are a plurality of frequencies; each frequency in the plurality of frequencies corresponds to a different period of the plurality of periods; generating the trending score comprises generating the trending score based on the plurality of frequencies and the particular frequency. ### Claim 4 (depends on 3) The method of claim 3, wherein: generating the trending score comprises calculating a difference between the particular frequency and an aggregation of the plurality of frequencies. ### Claim 5 (depends on 4) The method of claim 4, wherein: generating the trending score comprises calculating a ratio of the difference and the aggregation. ### Claim 6 (depends on 1) The method of claim 1, wherein generating the trending score comprises: selecting, based on the one or more frequencies, a smoother coefficient; generating the trending score based on the smoother coefficient. ### Claim 7 (depends on 6) The method of claim 6, wherein generating the trending score comprises: for a first topic in the plurality of topics: determining one or more first frequencies of the first topic; determining a first frequency of the first topic; selecting, based on the one or more first frequencies, a first smoother coefficient; generating a first trending score based on the one or more first frequencies, the first frequency, and the first smoother coefficient; for a second topic, in the plurality of topics, that is different than the first topic: determining one or more second frequencies of the second topic; determining a second frequency of the second topic; selecting, based on the one or more second frequencies, a second smoother coefficient that is different than the first smoother coefficient; generating a second trending score based on the one or more second frequencies, the second frequency, and the second smoother coefficient. ### Claim 8 (depends on 6) The method of claim 6, further comprising: determining which topics in the plurality of topics were selected based on user input; based on the user input, adjusting a smoother function that generates the smoother coefficient. ### Claim 9 (depends on 1) The method of claim 1, wherein determining the co-occurrence of pairs of topics in the plurality of topics comprises limiting the determining to the same sentence, wherein a pair of topics co-occur only if both topics appear in the same sentence. ### Claim 10 (depends on 1) The method of claim 1, wherein a document in the plurality of documents is a blog post, a comment on an online posting, or a tweet. ### Claim 11 A system comprising: one or more processors; one or more storage media storing instructions which, when executed by the one or more instructions, cause: identifying a first plurality of topics in a plurality of documents; determining a co-occurrence of one or more pairs of topics in the first plurality of topics; based on the co-occurrence of the one or more pairs of topics, identifying a second plurality of topics that includes fewer topics than the first plurality of topics; for each topic in the plurality of topics: determining one or more frequencies of said each topic, wherein determining the one or more frequencies comprises, for each time period of one or more time periods, determining a frequency of said each topic during said each time period; determining a particular frequency of said each topic in a particular time period that is subsequent to the one or more time periods; generating a trending score for said each topic based on the one or more frequencies and the particular frequency; ranking the plurality of topics based on the trending score for each topic in the plurality of topics. ### Claim 12 (depends on 11) The system of claim 11, wherein the instructions, when executed by the one or more processors, further cause: storing a plurality of document corpora, wherein each document corpus of the plurality of document corpora is associated with a different time period of a plurality of time periods that includes the one or more time periods and the particular time period; for a first document corpus of the plurality of document corpora: analyzing the first document corpus to identify a first set of topics, and for each topic in the first set of topics, determining a number of instances, in the first document corpus, of said each topic; for a second document corpus of the plurality of document corpora: analyzing the second document corpus to identify a second set of topics, and for each topic in the second set of topics, determining a number of instances, in the second document corpus, of said each topic. ### Claim 13 (depends on 11) The system of claim 11, wherein: the one or more periods are a plurality of periods; the one or more frequencies are a plurality of frequencies; each frequency in the plurality of frequencies corresponds to a different period of the plurality of periods; generating the trending score comprises generating the trending score based on the plurality of frequencies and the particular frequency. ### Claim 14 (depends on 13) The system of claim 13, wherein: generating the trending score comprises calculating a difference between the particular frequency and an aggregation of the plurality of frequencies. ### Claim 15 (depends on 14) The system of claim 14, wherein: generating the trending score comprises calculating a ratio of the difference and the aggregation. ### Claim 16 (depends on 11) The system of claim 11, wherein generating the trending score comprises: selecting, based on the one or more frequencies, a smoother coefficient; generating the trending score based on the smoother coefficient. ### Claim 17 (depends on 16) The system of claim 16, wherein generating the trending score comprises: for a first topic in the plurality of topics: determining one or more first frequencies of the first topic; determining a first frequency of the first topic; selecting, based on the one or more first frequencies, a first smoother coefficient; generating a first trending score based on the one or more first frequencies, the first frequency, and the first smoother coefficient; for a second topic, in the plurality of topics, that is different than the first topic: determining one or more second frequencies of the second topic; determining a second frequency of the second topic; selecting, based on the one or more second frequencies, a second smoother coefficient that is different than the first smoother coefficient; generating a second trending score based on the one or more second frequencies, the second frequency, and the second smoother coefficient. ### Claim 18 (depends on 16) The system of claim 16, wherein the instructions, when executed by the one or more processors, further cause: determining which topics in the plurality of topics were selected based on user input; based on the user input, adjusting a smoother function that generates the smoother coefficient. ### Claim 19 (depends on 11) The system of claim 11, wherein determining the co-occurrence of pairs of topics in the plurality of topics comprises limiting the determining to the same sentence, wherein a pair of topics co-occur only if both topics appear in the same sentence. ### Claim 20 (depends on 11) The system of claim 11, wherein a document in the plurality of documents is a blog post, a comment on an online posting, or a tweet.