# US 12,118,479 B2 · Artificial intelligence annotation through gamification > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,479 B2 - Document ID: US12118479B2 - Status: Granted - Kind: B2 - Application number: 17/221,994 - Filed: 2021-04-05 - Published: 2021-12-16 - Granted: 2024-10-15 - Earliest claimed: 2020-06-11 - Applicants: Wesley T. Chuang - Inventors: Wesley T. Chuang - Web page: https://patentgrep.com/patent/US12118479B2 ## CPC - G06N 5/04: Inference or reasoning models - G06N 20/00: Machine learning - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract In a system and method of labeling or annotating entities or objects in a data stream, the data is displayed in a virtual game environment, and the identification and labeling tasks are carried out by players of the game through game input devices capable of selecting an object or entity displayed in the game environment, and of categorizing the object or entity upon selection. ## Claims ### Claim 1 A method of enticing users to label virtual reality objects for the purpose of training an AI system to recognize the objects, comprising the steps of: broadcasting a data stream over a network to a plurality of computing devices, the data stream including, in a virtual game environment, objects or entities recognizable by a user, the computing devices displaying, on display devices connected to respective said computing devices, the objects or entities included in the data stream; enabling users, in response to display of one of the objects or entities included in the data stream, to play video games by manipulating or utilizing computer input devices to select and label, in a manner consistent with the virtual game environment, the displayed objects or entities; communicating, via the network, labels selected by the user for the displayed object or entity from the computing devices to the AI system for use in teaching the AI system to identify the object or entity based on labels input by the users; upon selection of a label by a respective user, displaying a result, consistent with the virtual game environment, that rewards the respective user for carrying out the selection and labeling in order to entice the user into continuing to select and label displayed objects, and thereby train the AI system to recognize the displayed objects or entities included in said data stream and broadcast over the network. ### Claim 2 (depends on 1) The method as claimed in claim 1, wherein the step of labeling the object or entity includes the step of associating the object or entity with a category. ### Claim 3 (depends on 2) The method as claimed in claim 2, wherein the computer input devices include a game controller, the step of associating the object or entity with a category includes steps of selecting the object or entity by manipulating the game controller, and categorizing the object or entity by pressing one of a plurality of buttons on the game controller, each button associated with a different category. ### Claim 4 (depends on 3) The method as claimed in claim 3, wherein the game controller is a joystick. ### Claim 5 (depends on 3) The method as claimed in claim 3, wherein the plurality of buttons include buttons for categorizing the object or entity. ### Claim 6 (depends on 1) The method as claimed in claim 1, wherein the object or entity is categorized as a person, organization, or location. ### Claim 7 (depends on 4) The method as claimed in claim 4, wherein the game controller includes a button for selecting the object or entity after a marker representing an aiming beam is positioned by the joystick. ### Claim 8 (depends on 5) The method as claimed in claim 5, wherein the object or entity is a text object. ### Claim 9 (depends on 8) The method as claimed in claim 8, further comprising the step of displaying parts of the text object before displaying the entire text object. ### Claim 10 (depends on 8) The method as claimed in claim 8, further comprising the step of varying a direction or speed of displayed objects or entities. ### Claim 11 (depends on 8) The method as claimed in claim 8, wherein the variations are random. ### Claim 12 (depends on 5) The method as claimed in claim 5, wherein the object or entity is a speech waveform. ### Claim 13 (depends on 12) The method as claimed in claim 12, wherein the speech waveform is to be categorized according as a part of speech. ### Claim 14 (depends on 10) The method as claimed in claim 10, wherein the categorization is carried out by a voice command. ### Claim 15 (depends on 5) The method as claimed in claim 5, wherein the object or entity is an image. ### Claim 16 (depends on 1) The method as claimed in claim 1, further comprising the step of offering monetary rewards to game play participants based on an accuracy of a model generated in response to the selection and labeling carried out by the participants. ### Claim 17 (depends on 14) The method as claimed in claim 14, wherein the input device is a joystick. ### Claim 18 (depends on 14) The method as claimed in claim 14, wherein the object or entity is a text object. ### Claim 19 (depends on 14) The method as claimed in claim 14, wherein the object or entity is a speech waveform. ### Claim 20 (depends on 14) The method as claimed in claim 14, wherein the object or entity is an image.