US 2019/0173918 A1Published application

Systems and methods for aida based a/b testing

AssigneeKnowBe4, Inc.

InventorEric Sites

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods are described by which a serving module of a campaign controller identifies a first version of a model which the campaign controller uses to communicate a first simulated phishing communication to a plurality of users. The campaign controller receives a first response from a first user to the simulated phishing communication and a second response from a second user to the simulated phishing communication and determines that the first and second responses are corresponding, for example are the same or similar. The serving module assigns a first user to a first group of users and a second user to a second group of users and identifies a second version of the model to use for the first user and a third version of the model to use for the second user.

Claims19

Dependent claims

A method for testing one or more versions of a model used for simulated phishing campaigns, the method comprising:

(a) identifying, by a serving module of a campaign controller, a first version of a model to be used by the campaign controller for executing simulated phishing campaigns;
(b) communicating, by the campaign controller, a first simulated phishing communication to a plurality of users using the first version of the model;
(c) receiving, by the campaign controller, a first response from a first user of the plurality of users to the first simulated phishing communication and a second response from a second user of the plurality of users to the first simulated phishing communication;
(d) determining, by the campaign controller, that the first response and the second response are corresponding responses;
(e) assigning, by the serving module responsive to the determination, the first user to a first group of users and the second user to a second group of users different from the group of users;
and
(f) identifying, by the serving module, a second version of the model to use for the first user and a third version of the model to use for the second user.

4 more elements

A system for testing one or more versions of a model used for simulated phishing campaigns, the system comprising:

one or more hardware processors, coupled to memory;
a serving module of a campaign controller executable on the one or more hardware processors, coupled to memory and configured to identify a first version of a model to be used by the campaign controller for executing simulated phishing campaigns;
wherein the campaign controller is configured to communicate a first simulated phishing communication to a plurality of users using the first version of the model;
receive a first response from a first user of the plurality of users to the first simulated phishing communication and a second response from a second user of the plurality of users to the first simulated phishing communication;
determine that the first response and the second response are corresponding responses;
wherein the serving module is configured to assign, responsive to the determination, the first user to a first group of users and the second user to a second group of users different from the group of users;
and
identify a second version of the model to use for the first user and a third version of the model to use for the second user.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/829,742Filed 1 Dec 2017
Published: 6 Jun 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification16 codes

H04L 63/1483
Countermeasures against malicious traffic: service impersonation, e.g. phishing, pharming or web spoofing
G06N 3/044
Architecture, e.g. interconnection topology: recurrent networks, e.g. Hopfield networks
G06N 3/0455
Combinations of networks: auto-encoder networks; Encoder-decoder networks
G06N 3/082
Learning methods: modifying the architecture, e.g. adding, deleting or silencing nodes or connections

Family

US 10,581,910 B2Related patent
US 2019/0173918 A1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key