Large language model powered social integrity system
AssigneeSony Interactive Entertainment Inc.
InventorVinit Acharya
Life of this patent
Estimating the term…
Abstract
A pseudo account is set up to mimic a potential victim's demographic messaging behavior while seeming completely legitimate to an anti-social (AS) user. This can entail mimicking the messaging behavior of minors and presenting that behavior where AS users look for it. The AS account establishes communication with the pseudo account. The AS account may be flagged as suspicious, and the system can wait for the AS user to make an initial move on a legitimate account and report it before any undesirable communication takes place. The pseudo account can be controlled by a large language model (LLM) such as a generative pre-trained transformer (GPTT).
Claims20
A system comprising:
- at least one non-transitory computer medium comprising instructions executable by at least one processor assembly to:
- generate a pseudo account, the pseudo account accessing at least one large language model (LLM) to appear as a peer user account;
- identify a first account associated with a user, wherein an input of the user via an input device requests establishing communication with the pseudo account;
- communicate, using the pseudo account, with the first account, wherein the communication includes the LLM generating a multi-turn natural language dialog, and wherein at least a portion of the multi-turn natural language dialog is presented to the first account as originating from the peer user account;
- determine, by processing data of the communication using an analysis model that is separate from the LLM, that the first account exhibits a first characteristic;
- determine, based on the first characteristic, that the first account is to be further monitored without restricting the first account;
- and
- generate an advisory warning based on the first account establishing a communication with a second account.
A method comprising:
- generating a pseudo account, the pseudo account accessing at least one large language model (LLM) to appear as a peer user account;
- identifying a first account associated with a user, wherein an input of the user via an input device requests establishing communication with the pseudo account;
- communicating, using the pseudo account, with the first account, wherein the communication includes the LLM generating a multi-turn natural-language dialog, and wherein at least a portion of the multi-turn natural-language dialog is presented to the first account as originating from the peer user account;
- determining, by processing data of the communication using an analysis model that is separate from the LLM, that the first account exhibits a first characteristic;
- determining, based on the first characteristic, that the first account is to be further monitored without restricting the first account;
- and
- generating an advisory warning based on the first account establishing a communication with a second account.
An apparatus, comprising:
- at least one processor assembly configured to:
- generate a pseudo account, the pseudo account accessing at least one large language model (LLM) to appear as a peer user account;
- identify a first account associated with a user, wherein an input of the user via an input device requests establishing communication with the pseudo account;
- communicate, using the pseudo account, with the first account, wherein the communication includes the LLM generating a multi-turn natural-language dialog, and wherein at least a portion of the multi-turn natural-language dialog is presented to the first account as originating from the peer user account;
- determine, by processing data of the communication using an analysis model that is separate from the LLM, that the first account exhibits a first characteristic;
- determine, based on the first characteristic, that the first account is to be further monitored without restricting the first account;
- and
- generate an advisory warning based on the first account establishing a communication with a second account.
Dependencies are inferred from the claim text.