# US 2024/0364770 A1 · Multimedia Conferencing Platform, And System And Method For Presenting Media Artifacts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0364770 A1
- Document ID: US20240364770A1
- Status: Published application
- Kind: A1
- Application number: 18/765,258
- Filed: 2024-07-06
- Published: 2024-10-31
- Earliest claimed: 2020-04-27
- Assignees: FabZing Pty Ltd.
- Applicants: FabZing Pty Ltd.
- Inventors: Jon Frank Shaffer; Gary John Smith
- Web page: https://patentgrep.com/patent/US20240364770A1

## CPC

- H04L 65/75: Media network packet handling
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/64: Protecting data integrity, e.g. using checksums, certificates or signatures
- G06N 3/08: Learning methods
- G06N 20/00: Machine learning
- G09B 5/067: {Combinations of audio and projected visual presentation, e.g. film, slides}
- H04L 65/1073: Registration or de-registration
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

The present disclosure relates to a system and a method for a multimodal media interface that enables the display of and interaction between multiple media files. The system uses a multimodal format/interface in which media files are displayed in one or more tiles. The system also allows for communication and interaction between the tiles, enabling the exchange of data therebetween. The system is also configured to retrieve data from external entities, such as search engines or application servers, which are then displayed on the tile. The multimodal interface provides a means for the users to view, compare, and interact with various types of media files concurrently, and allow data/content of the media files to be modified/updated based on internal and external information, thereby improving the user experience.

## Claims

### Claim 1

A method for displaying one or more media artifacts, comprising:
receiving, by a processor, one or more inputs from one or more users through one or more tiles configured to display a corresponding media artifact, wherein the one or more tiles are configured to communicate with at least one of: other tiles, or an external entity;
receiving, by the processor, one or more retrieved data from either the other tiles or the external entity, wherein the other tiles or the external entities are configured to retrieve and transmit the one or more retrieved data in response to the one or more inputs; and
updating, by the processor, the media artifact displayed on the one or more tiles based on at least one of: the one or more inputs and/or the one or more retrieved data.

### Claim 2 (depends on 1)

The method of claim 1, further comprising transmitting, by the processor, the one or more inputs to the other tiles or the external entity for updating the media artifact displayed on the one or more tiles.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more tiles comprises at least one interactable element configured to display the media artifacts on an overlay window when the at least one interactable element is interacted with.

### Claim 4 (depends on 1)

The method of claim 1, wherein the one or more tiles comprises at least one interactable element, and wherein when the at least one interactable element is interacted with the method comprises:
generating, by the processor, one or more tokens; and
transmitting, by the processor, one or more signals to the external entity or the other tiles indicating the generation of the one or more tokens, wherein the one or more tokens are configured to cause execution of a set of processor-executable instructions on being triggered.

### Claim 5 (depends on 1)

The method of claim 1, wherein when the media artifact on a first tile from the one or more tiles comprise at least one of: a uniform resource locator (URL) or an automatic identification and data capture (AIDC) means, and wherein the one or more inputs indicate a request to access media contents associated with the URL or the AIDC means, the method comprises:
retrieving, by the processor, the media contents associated with the URL or the AIDC means; and
displaying, by the processor, the media contents on a second tile from the one or more tiles.

### Claim 6 (depends on 1)

The method of claim 1, wherein when the one or more inputs are communicated to the other tiles or the external entity, the method comprises:
processing, by the processor, the one or more retrieved data using an artificial intelligence (AI) engine; and
updating, by the processor, the media artifacts displayed in the one or more tiles based on the one or more retrieved data processed by the AI engine.

### Claim 7 (depends on 6)

The method of claim 6, wherein the AI engine is configured to determine order of updating the one or more tiles based on the processing of the one or more retrieved data.

### Claim 8 (depends on 1)

The method of claim 1, further comprising determining, by the processor, at least one of: size, number, orientation, or arrangement of the one or more tiles based on at least one of: the one or more retrieved data or the one or more inputs.

### Claim 9 (depends on 1)

The method of claim 1, further comprising generating, by the processor, the media artifacts for presentation on the one or more tiles based on at least one of: the one or more retrieved data or the one or more inputs.

### Claim 10 (depends on 1)

The method of claim 1, wherein the one or more tiles communicate with either the other tiles or the external entities through at least one of: function calls, or application programming interface (API) calls.

### Claim 11 (depends on 1)

The method of claim 1, wherein the external entities are indicative of one or more search engines configured to retrieve search artifacts based on the one or more inputs.

### Claim 12 (depends on 1)

The method of claim 1, wherein the input is at least one of: a natural language input, an audio input, an image input, a biometric input, and/or a video input.

### Claim 13

A system for displaying one or more media artifacts, comprising:
a processor; and
a memory coupled to the processor, wherein the memory comprises one or more processor-executable instructions that cause the processor to:
receive one or more inputs from one or more users through one or more tiles configured to display a corresponding media artifact, wherein the one or more tiles are configured to communicate with at least one of: other tiles, or an external entity;
receive one or more retrieved data from either the other tiles or the external entity, wherein the other tiles or the external entities are configured to retrieve and transmit the one or more retrieved data in response to the one or more inputs; and
update the media artifact displayed on the one or more tiles based on at least one of: the one or more inputs and/or the one or more retrieved data.

### Claim 14

A non-transitory computer readable medium, comprising instructions to:
receive one or more inputs from one or more users through one or more tiles configured to display a corresponding media artifact, wherein the one or more tiles are configured to communicate with at least one of: other tiles, or an external entity;
receive one or more retrieved data from either the other tiles or the external entity, wherein the other tiles or the external entities are configured to retrieve and transmit the one or more retrieved data in response to the one or more inputs; and
update the media artifact displayed on the one or more tiles based on at least one of: the one or more inputs and/or the one or more retrieved data.

### Claim 15

A method for autonomously guided presentation of media artifacts, comprising:
receiving, by a processor, an input from one or more users;
generating, by the processor, one or more media artifacts in response to the input; and
displaying, by the processor, the one or more media artifacts on one or more tiles.

### Claim 16 (depends on 15)

The method of claim 15, wherein for generating the one or more media artifacts, the method comprises any one or combination of:
retrieving, by the processor, the one or more media artifacts from a database or an external entity;
processing, by the processor, the one or more retrieved media artifacts to generate further media artifacts using an AI engine; or
generating, by the processor, the one or more media artifacts based on the input.

### Claim 17 (depends on 15)

The method of claim 15, wherein a first subset of media artifacts from the one or more media artifacts are displayed sequentially, and a second subset of media artifacts from the one or more media artifacts are displayed concurrently.

### Claim 18 (depends on 15)

The method of claim 15, wherein for displaying the one or more media artifacts, the method comprises, determining, by the processor, an order of displaying the one or more media artifacts on the one or more tiles.

### Claim 19 (depends on 15)

The method of claim 15, further comprising determining, by the processor, at least one of: size, number, orientation, or arrangement of the one or more tiles for displaying the one or more media artifacts.

### Claim 20 (depends on 19)

The method of claim 19, further comprising instantiation, by the processor, the one or more tiles based on the determination of at least one of: size, number, orientation, or arrangement of the one or more tiles.

### Claim 21 (depends on 15)

The method of claim 15, comprising iteratively receiving the one or more inputs, processing generating the one or more media artifacts based on the inputs, and displaying the one or more media artifacts on the one or more tiles, in real-time.

### Claim 22 (depends on 15)

The method of claim 15, wherein the one or more tiles are accessible on scanning at least one of: a uniform resource locator (URL) or an automatic identification and data capture (AIDC) means.

### Claim 23 (depends on 15)

The method of claim 15, further comprising:
identifying, by the processor, one or more potential symptoms based on the one or more inputs using an artificial intelligence (AI) engine;
matching, by the processor, the one or more potential symptoms with one or more potential diagnoses using the AI engine; and
displaying, by the processor, the one or more media artifacts generated based on the one or more potential diagnoses.

### Claim 24

A method for processing multimodal inputs from users, comprising:
interacting, by a processor, with a user on a first multimodal interface using an artificial intelligence (AI) engine, wherein the interaction comprises:
receiving, by the processor, one or more inputs from the user through the first multimodal interface; and
transmitting, by the processor, one or more instructions generated by the AI engine based on the one or more inputs,
determining, by the processor, one or more assessment values based on the one or more inputs and the one or more instructions; and
displaying, by the processor, the one or more assessment values on a second multimodal interface.

### Claim 25 (depends on 24)

The method of claim 24, wherein for displaying the one or more assessment values, the method comprises:
generating, by the processor, one or more media artifacts based on at least one of: the one or more inputs, the one or more instructions, or the one or more assessment values; and
displaying, by the processor, the one or more media artifacts on the second multimodal interface.
