# US 2022/0277347 A1 · Dynamic evaluation and use of global and contextual personas

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277347 A1
- Document ID: US20220277347A1
- Status: Published application
- Kind: A1
- Application number: 17/747,657
- Filed: 2022-05-18
- Published: 2022-09-01
- Earliest claimed: 2020-01-21
- Assignees: Walmart Apollo, LLC
- Applicants: Walmart Apollo, LLC
- Inventors: Yang DENG; Omkar DESHPANDE; Afroza ALI; Abhimanyu MITRA; Kannan ACHAN
- Web page: https://patentgrep.com/patent/US20220277347A1

## CPC

- G06Q 30/0255: {based on user history}
- G06Q 30/0246: {Traffic}
- G06Q 30/0268: {at point-of-sale [POS]}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A system and method for content selection and presentation is disclosed. A plurality of content elements configured for presentation in at least one content container is received and one of the plurality of content elements is selected for presentation in the at least one content container. The one of the plurality of content elements is selected by a trained selection model configured to select one of an individual context or a global context. An interface including the selected one of the plurality of content elements is generated.

## Claims

### Claim 1

A system comprising:
a memory resource storing instructions; and
a processor coupled to the memory resource, the processor being configured to execute the instructions to:
for a user, receive training data including impression data indicating one or more instances the user interacted with one or more content elements on a user interface presented by a device of the user, the user interface including a plurality of containers, and each of the one or more instances being associated with one of a plurality of contexts;
obtain, from a database, a plurality of content elements configured for presentation in at least a first content container of the plurality of containers;
based at least on the training data, implement, by utilizing a trained selection model, a context selection process that selects a context to be assigned to the user, the context selection process comprising:
based at least on a first subset of training data, determining an expected future reward value of each of one or more contexts of the training data;
based at least on the training data, determining an expected future reward value of a global context;
based on a comparison of the expected future reward value of each of the one or more contexts of the training data and the expected future reward value of the global context, select the global context or one of the one or more contexts.

### Claim 2 (depends on 1)

The system of claim 1, wherein the processor executes the instructions further to:
iteratively implement a machine learning process that generates the trained selection model by utilizing a reinforcement learning mechanism and at least an individual explore-exploit mechanism.

### Claim 3 (depends on 1)

The system of claim 1, wherein the processor executes the instructions further to:
generate and present the selected global context or one of the one or more contexts in the first content container of the user interface on a display of the device of the user.

### Claim 4 (depends on 1)

The system of claim 1, wherein the expected future reward value is associated with a click-through rate.

### Claim 5 (depends on 1)

The system of claim 1, wherein the expected future reward value is determined using Thompson sampling.

### Claim 6 (depends on 1)

The system of claim 1, wherein the impression data includes data characterizing a click-through rate, data characterizing a user return rate, or data characterizing historic purchase data.

### Claim 7 (depends on 1)

The system of claim 1, wherein the expected future reward value of the global context (CTRglobal) is determined according to:
CTR
global
=
∑
k
=
1
n
(
q
k
*
p
k
∑
j
=
1
n
p
j
)
where pk is a past click-through rate, pj is a reward value for a j-th interaction, and qk is a future click-through rate.

### Claim 8 (depends on 1)

The system of claim 1, wherein the expected future reward value of at least one of the one or more contexts of the training data (CTRcontextual) is determined according to:
CTR
contextual
=
∑
l
=
1
L
[
pct
l
*
(
∑
k
=
1
n
l
(
q
k
*
p
lk
∑
j
=
1
n
l
p
lj
)
]
where plk is a sampled click-through rate, qlk is a future click-through rate for each item Ilk associated with the at least one of the one or more contexts of the training data Cl, and pctl is a proportion of impressions to customers for the at least one of the one or more contexts of the training data Cl where l=1,2, . . . , L, k=1,2, . . . , nl, and pctl=1.

### Claim 9 (depends on 1)

The system of claim 1, wherein the trained selection model is trained by combining two or more individual contexts into a single context.

### Claim 10 (depends on 9)

The system of claim 9, wherein the two or more individual contexts are grouped based on a pairwise distance.

### Claim 11

A computer-implemented method comprising:
for a user, receiving, by using a processor, training data including impression data indicating one or more instances the user interacted with one or more content elements on a user interface presented by a device of the user, the user interface including a plurality of containers, and each of the one or more instances being associated with one of a plurality of contexts;
obtaining, by using a processor, from a database, a plurality of content elements configured for presentation in at least a first content container of the plurality of containers;
based at least on the training data, implementing, by using a processor and by utilizing a trained selection model, a context selection process that selects a context to be assigned to the user, the context selection process comprising:
based at least on a first subset of training data, determining an expected future reward value of each of one or more contexts of the training data;
based at least on the training data, determining an expected future reward value of a global context;
based on a comparison of the expected future reward value of each of the one or more contexts of the training data and the expected future reward value of the global context, selecting, by using a processor, the global context or one of the one or more contexts.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11 further comprising:
iteratively implementing a machine learning process that generates the trained selection model by utilizing a reinforcement learning mechanism and at least an individual explore-exploit mechanism.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11 further comprising:
generating and presenting the selected global context or one of the one or more contexts in the first content container of the user interface on a display of the device of the user.

### Claim 14 (depends on 11)

The computer-implemented method of claim 11, wherein the expected future reward value is associated with a click-through rate.

### Claim 15 (depends on 11)

The computer-implemented method of claim 11, wherein the expected future reward value is determined using Thompson sampling.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, wherein the impression data includes data characterizing a click-through rate, data characterizing a user return rate, or data characterizing historic purchase data.

### Claim 17 (depends on 11)

The computer-implemented method of claim 11, wherein the expected future reward value of the global context (CTRglobal) is determined according to:
CTR
global
=
∑
k
=
1
n
(
q
k
*
p
k
∑
j
=
1
n
p
j
)
where pk is a past click-through rate, pj is a reward value for a j-th interaction, and qk is a future click-through rate.

### Claim 18 (depends on 11)

The computer-implemented method of claim 11, wherein the expected future reward value of at least one of the one or more contexts of the training data (CTRcontextual) is determined according to:
CTR
contextual
=
∑
l
=
1
L
[
pct
l
*
(
∑
k
=
1
n
l
(
q
k
*
p
lk
∑
j
=
1
n
l
p
lj
)
]
where plk is a sampled click-through rate, qlk is a future click-through rate for each item Ilk associated with the at least one of the one or more contexts of the training data Cl, and pctl is a proportion of impressions to customers for the at least one of the one or more contexts of the training data Cl where l=1,2, . . . , L, k=1,2, . . . , nl, and Σ1Lpctl32 1.

### Claim 19 (depends on 11)

The computer-implemented method of claim 11, wherein the trained selection model is trained by combining two or more individual contexts into a single context.

### Claim 20

A non-transitory computer readable medium having instructions stored thereon, wherein the instructions, when executed by a processor cause a device to perform operations comprising:
for a user, receiving training data including impression data indicating one or more instances the user interacted with one or more content elements on a user interface presented by a device of the user, the user interface including a plurality of containers, and each of the one or more instances being associated with one of a plurality of contexts;
obtaining, from a database, a plurality of content elements configured for presentation in at least a first content container of the plurality of containers;
based at least on the training data, implementing, by utilizing a trained selection model, a context selection process that selects a context to be assigned to the user, the context selection process comprising:
based at least on a first subset of training data, determining an expected future reward value of each of one or more contexts of the training data;
based at least on the training data, determining an expected future reward value of a global context;
based on a comparison of the expected future reward value of each of the one or more contexts of the training data and the expected future reward value of the global context, select the global context or one of the one or more contexts.
