# US 2023/0418571 A1 · Sketch Based Hyper-Personalization of User Interfaces

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0418571 A1
- Document ID: US20230418571A1
- Status: Published application
- Kind: A1
- Application number: 18/463,327
- Filed: 2023-09-08
- Published: 2023-12-28
- Earliest claimed: 2022-09-10
- Inventors: Nikolas Louis Ciminelli; Tom Zeev Jacob Palny; Ron Zass
- Web page: https://patentgrep.com/patent/US20230418571A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F 8/36: Software reuse
- G06F 8/38: for implementing user interfaces
- G06F 8/71: Version control (security arrangements therefor G06F21/57); Configuration management
- G06F 9/451: Execution arrangements for user interfaces
- G06F 40/253: Grammatical analysis; Style critique
- G06F 40/30: Semantic analysis
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06V 10/945: {User interactive design; Environments; Toolboxes}
- G06V 30/19173: {Classification techniques}
- G06V 30/422: Technical drawings; Geographical maps
- H04L 67/306: User profiles
- H04W 4/02: Services making use of location information
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0475: Generative networks
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G06N 20/20: Ensemble learning
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems, methods and non-transitory computer readable media for hyper personalization of user interfaces are provided. In some examples, a sketch associated with a desire of a particular individual to affect a design of a user interface is received. The sketch and digital data associated with a first individual are used to generate a first version of the design. First digital signals are transmitted to a first computing device associated with the first individual to cause the first computing device to present the user interface based on the first version of the design. The sketch and digital data associated with a second individual are used to generate a second version of the design. Second digital signals are be transmitted to a second computing device associated with the second individual to cause the second computing device to present the user interface based on the second version of the design.

## Claims

### Claim 1

A non-transitory computer readable medium storing a software program comprising data and computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for hyper personalization of user interfaces, the operations comprising:
receiving from a particular individual a sketch, the sketch is associated with a desire of the particular individual to affect a design of a user interface;
obtaining first digital data associated with a first individual;
using the sketch and the first digital data to generate a first version of the design of the user interface;
transmitting first digital signals to a first computing device associated with the first individual, the first digital signals are configured to cause the first computing device to present the user interface based on the first version of the design;
obtaining second digital data associated with a second individual, the second digital data differs from the first digital data;
using the sketch and the second digital data to generate a second version of the design of the user interface, the second version differs from the first version; and
transmitting second digital signals to a second computing device associated with the second individual, the second digital signals are configured to cause the second computing device to present the user interface based on the second version of the design.

### Claim 2 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further comprise:
analyzing the sketch to generate a base version of the design of the user interface; and
causing a presentation to the particular individual of the user interface based on the base version of the design.

### Claim 3 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein the operations further comprise:
using the base version of the design and the first digital data to generate the first version of the design of the user interface; and
using the base version of the design and the second digital data to generate the second version of the design of the user interface.

### Claim 4 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein the operations further comprise:
receiving third digital data associated with a preliminary version of the design of the user interface;
analyzing the sketch to determine at least one change to the preliminary version of the design of the user interface; and
implementing the determined at least one change to generate the base version of the design of the user interface.

### Claim 5 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further comprise:
receiving first textual data, the first textual data includes a description in the natural language of at least one characteristic of the first individual;
analyzing the first textual data to determine the first digital data, the first digital data is based on the at least one characteristic of the first individual;
receiving second textual data, the second textual data includes a description in the natural language of at least one characteristic of the second individual; and
analyzing the second textual data to determine the second digital data, the second digital data is based on the at least one characteristic of the second individual.

### Claim 6 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further comprise:
determining that the first individual is associated with a first population segment;
determining that the second individual is associated with a second population segment, the second population segment differs from the first population segment;
accessing a data-structure associating population segments with digital records based on the first population segment to obtain the first digital data; and
accessing the data-structure based on the second population segment to obtain the second digital data.

### Claim 7 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the first digital data includes an indication of a first physical location associated with the first individual, the second digital data includes an indication of a second physical location associated with the second individual, the generation of the first version of the design of the user interface is based on the sketch and the first physical location, and the generation of the second version of the design of the user interface is based on the sketch and the second physical location.

### Claim 8 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the first digital data includes an indication of a demographic characteristic of the first individual, the second digital data includes an indication of a demographic characteristic of the second individual, the generation of the first version of the design of the user interface is based on the sketch and the demographic characteristic of the first individual, and the generation of the second version of the design of the user interface is based on the sketch and the demographic characteristic of the second individual.

### Claim 9 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the first digital data includes an indication of a first behavior pattern associated with the first individual, the second digital data includes an indication of a second behavior pattern associated with the second individual, the generation of the first version of the design of the user interface is based on the sketch and the first behavior pattern, and the generation of the second version of the design of the user interface is based on the sketch and the second behavior pattern.

### Claim 10 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the first digital data includes an indication of a first virtual location associated with the first individual, the second digital data includes an indication of a second virtual location associated with the second individual, the generation of the first version of the design of the user interface is based on the sketch and the first virtual location, and the generation of the second version of the design of the user interface is based on the sketch and the second virtual location.

### Claim 11 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the first digital data includes an indication of a first social group associated with the first individual, the second digital data includes an indication of a second social group associated with the second individual, the generation of the first version of the design of the user interface is based on the sketch and the first social group, and the generation of the second version of the design of the user interface is based on the sketch and the second social group.

### Claim 12 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the second version of the design of the user interface differs from the first version of the design of the user interface in at least one visual content.

### Claim 13 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the second version of the design of the user interface differs from the first version of the design of the user interface in at least a distance between two elements of the user interface.

### Claim 14 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the second version of the design of the user interface differs from the first version of the design of the user interface in at least a color scheme of at least part of the user interface.

### Claim 15 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the second version of the design of the user interface differs from the first version of the design of the user interface in at least a font used to present at least one textual content in the user interface.

### Claim 16 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further comprise using a machine learning model to analyze the sketch and the first digital data to generate the first version of the design of the user interface, and using the machine learning model to analyze the sketch and the second digital data to generate the second version of the design of the user interface.

### Claim 17 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the sketch includes a plurality of pixel values, and the operations further comprise:
calculating a convolution of at least part of the pixel values of the sketch to obtain a result value;
analyzing the first digital data to identify a first mathematical object in a mathematical space;
analyzing the second digital data to identify a second mathematical object in the mathematical space;
calculating a function of the first mathematical object and the result value to obtain a third mathematical object in the mathematical space;
basing the generation of the first version of the design of the user interface on the third mathematical object;
calculating a function of the second mathematical object and the result value to obtain a fourth mathematical object in the mathematical space; and
basing the generation of the second version of the design of the user interface on the forth mathematical object.

### Claim 18 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the operations further comprise:
receiving a textual input from the particular individual, the textual input is associated with the desire of the particular individual to affect the design of the user interface;
analyzing the textual input, the sketch and the first digital data to generate the first version of the design of the user interface; and
analyzing the textual input, the sketch and the second digital data to generate the second version of the design of the user interface.

### Claim 19

A system for hyper personalization of user interfaces, the system comprising at least one processing unit configured to perform operations, the operations comprise:
receiving from a particular individual a sketch, the sketch is associated with a desire of the particular individual to affect a design of a user interface;
obtaining first digital data associated with a first individual;
using the sketch and the first digital data to generate a first version of the design of the user interface;
transmitting first digital signals to a first computing device associated with the first individual, the first digital signals are configured to cause the first computing device to present the user interface based on the first version of the design;
obtaining second digital data associated with a second individual, the second digital data differs from the first digital data;
using the sketch and the second digital data to generate a second version of the design of the user interface, the second version differs from the first version; and
transmitting second digital signals to a second computing device associated with the second individual, the second digital signals are configured to cause the second computing device to present the user interface based on the second version of the design.

### Claim 20

A method for hyper personalization of user interfaces, the method comprising:
receiving from a particular individual a sketch, the sketch is associated with a desire of the particular individual to affect a design of a user interface;
obtaining first digital data associated with a first individual;
using the sketch and the first digital data to generate a first version of the design of the user interface;
transmitting first digital signals to a first computing device associated with the first individual, the first digital signals are configured to cause the first computing device to present the user interface based on the first version of the design;
obtaining second digital data associated with a second individual, the second digital data differs from the first digital data;
using the sketch and the second digital data to generate a second version of the design of the user interface, the second version differs from the first version; and
transmitting second digital signals to a second computing device associated with the second individual, the second digital signals are configured to cause the second computing device to present the user interface based on the second version of the design.
