Back to results
US 2022/0100965 A1Published application
Method and device for adjusting and implementing topic detection processes
AssigneeAT&T Intellectual Property I, L.P.
InventorsSudhakar Kalluri, Maisam Shahid Wasti
Life of this patent
Estimating the term…
Abstract
Aspects of the subject disclosure may include, for example, applying a topic detection process to documents to obtain automatically detected topics and groups of automatically detected words, comparing the automatically detected topics with manually determined topics to determine actual purity metrics, determining an error metric based on a measure of deviation between ideal purity metrics and the actual purity metrics, and adjusting a parameter of the topic detection process according to the error metric resulting in an adjusted topic detection process. Other embodiments are disclosed.
Claims20
A device comprising:
- a processing system including a processor;
- and
- a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, comprising:
- obtaining a first set of topics relating to a document and a first set of word lists, each of the first set of word lists comprising one or more words and corresponding to a respective one of the first set of topics, wherein each topic of the first set of topics is characterized by a probability distribution over a set of words associated with the document, wherein each word of the first set of word lists is in the document, and wherein the obtaining comprises an automated topic detection process using a topic detection parameter;
- comparing, for each topic of the first set of topics, a corresponding first word list of the first set of word lists with a second word list of a second set of word lists, each of the second set of word lists comprising one or more words and corresponding to a respective one of a second set of topics, the comparing performed according to similarities between respective words of the first word list and respective words of the second word list to determine actual purity metrics, wherein the second set of topics and the second set of word lists are determined in a non-automated process;
- determining an error metric based on a measure of deviation between ideal purity metrics and the actual purity metrics;
- and
- adjusting the topic detection parameter to reduce the error metric resulting in an adjusted topic detection process, wherein the adjusting is performed iteratively, wherein the adjusting is discontinued in accordance with meeting a predetermined criterion.
5 more elements
A method comprising:
- obtaining, by a processing system including a processor, a first set of topics relating to a document and a first set of word lists, each of the first set of word lists comprising one or more words and corresponding to a respective one of the first set of topics, wherein each topic of the first set of topics is characterized by a probability distribution over a set of words associated with the document, wherein each word of the first set of word lists is in the document, and wherein the obtaining comprises an automated topic detection process using a topic detection parameter;
- comparing, by the processing system for each topic of the first set of topics, a corresponding first word list of the first set of word lists with a second word list of a second set of word lists, each of the second set of word lists comprising one or more words and corresponding to a respective one of a second set of topics, the comparing performed according to similarities between respective words of the first word list and respective words of the second word list to determine actual purity metrics, wherein the second set of topics and the second set of word lists are determined in a non-automated process;
- determining, by the processing system, an error metric based on a measure of deviation between ideal purity metrics and the actual purity metrics;
- and
- adjusting, by the processing system, the topic detection parameter to reduce the error metric resulting in an adjusted topic detection process, wherein the adjusting is performed iteratively.
2 more elements
A non-transitory machine readable medium comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, comprising:
- obtaining a first set of topics relating to a document and a first set of word lists, each of the first set of word lists comprising one or more words and corresponding to a respective one of the first set of topics, wherein each topic of the first set of topics is characterized by a probability distribution over a set of words associated with the document, wherein each word of the first set of word lists is in the document, wherein the obtaining comprises an automated topic detection process using a topic detection parameter, and wherein a filtering procedure comprising filtering the document is performed prior to performing the topic detection process;
- comparing, for each topic of the first set of topics, a corresponding first word list of the first set of word lists with a second word list of a second set of word lists, each of the second set of word lists comprising one or more words and corresponding to a respective one of a second set of topics, the comparing performed according to similarities between respective words of the first word list and respective words of the second word list to determine actual purity metrics, wherein the second set of topics and the second set of word lists are determined in a non-automated process;
- determining an error metric based on a measure of deviation between ideal purity metrics and the actual purity metrics;
- and
- adjusting the topic detection parameter to reduce the error metric resulting in an adjusted topic detection process, wherein the adjusting is performed iteratively, wherein the adjusting is discontinued in accordance with meeting a predetermined criterion.
2 more elements
Dependencies are inferred from the claim text.