User Rating
OwnerMark Ograminventor
Life of this patent
Estimating the term…
Abstract
The invention utilizes a computer and a surrounding system to provide evaluations for AI operating computer through the use of both personal/user opinions as well as third-party assessments. The third-party assessments include, but are not limited to: factual assessment for AI accuracy to the facts, operational assessment for mechanical controls, proprietary assessment relative to proprietary data, peer-to-peer assessment through other AI evaluations, and expert assessment for disciplines such as medical, legal, psychology, religion, etc.
Claims19
An AI rating system comprising:
- a) an operator computer adapted to,
- 1) communicate a human generated query to an AI computer,
- 2) receive an AI response from the AI computer, and,
- 3) communicate an identity of the AI computer and the human generated query to a central computer;
- and,
- b) the central computer adapted to:
- 1) receive the identity of the AI computer and the human generated query from the operator computer,
- 2) based upon the human generated query, communicate a set of rating questions to the operator computer,
- 3) receive a human analysis from the operator computer for the rating questions,
- 4) create a human rating of the AI computer based on the human analysis, and,
- 5) based on the identity of the AI computer, obtain a third-party assessment of the AI computer.
A rating system for AI computers comprising:
- a) an operator computer adapted to,
- 1) communicate a human generated query to an AI computer,
- 2) receive an AI response from the AI computer in response to the human generated query, and,
- 3) communicate an identity of the AI computer and the human generated query to a querying computer, and;
- a querying computer adapted to repetitively:
- 1) withdraw, based upon the human generated query, a chosen query from a set of queries with associated accuracy data,
- 2) communicate the chosen query to the AI computer,
- 3) receive an AI response to the chosen query from the AI computer,
- 4) communicate the AI response to the chosen query, the chosen query, the associated accuracy data to the operator computer,
- 5) obtain a third-party evaluation for the AI computer, and,
- 6) communicate the third-party assessment to the operator computer.
A document verification computer adapted to:
- a) obtain a document from an operator computer,
- b) check at least one salient fact within the document for accuracy,
- c) based upon the at least one salient fact, obtain from third-party assessment computer a third-party assessment,
- d) identify, using the third-party assessment, false salient facts that are not accurate to create a report on the false salient facts data, and,
- e) communicate the report on the false salient facts to the operator computer.
Dependencies are inferred from the claim text.