# US 2021/0240989 A1 · Providing visual guidance for presenting visual content in a venue

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240989 A1
- Document ID: US20210240989A1
- Status: Published application
- Kind: A1
- Application number: 17/234,091
- Filed: 2021-04-19
- Published: 2021-08-05
- Earliest claimed: 2019-11-08
- Assignees: MSG Entertainment Group, LLC
- Applicants: MSG Entertainment Group, LLC
- Inventors: David E. Rodriguez; Michael Ramaszewicz; Evan Schectman; Michael Graae; Clay Budin; Mateusz Marcinowski
- Web page: https://patentgrep.com/patent/US20210240989A1

## CPC

- H04N 21/41415: {involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk}
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 3/1446: {display composed of modules, e.g. video walls}
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06V 10/40: Extraction of image or video features
- G06V 20/20: in augmented reality scenes
- H04N 21/2143: {located in a single building, e.g. hotel, hospital or museum (arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106)}
- H04N 21/25841: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)}
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4524: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)}
- H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics}
- G09G 3/03: {specially adapted for displays having non-planar surfaces, e.g. curved displays}
- G09G 5/363: {Graphics controllers}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Disclosed herein are system, method, and computer program product embodiments for providing visual guidance on presenting content on a media surface of a venue. An embodiment operates by mapping visual content onto a media surface of the venue and a key feature unique to the visual content and/or the media surface being extracted. Thereafter, an experiment metric corresponding to the visual content and/or the media surface is retrieved, a viewer location metric and/or a media surface metric based on the experiment metric and the key feature is determined. The viewer location metric and the media surface metric correspond to the attribute, which is utilized to provide a hint of the attribute to a user.

## Claims

### Claim 1

A method for previewing visual content on a media surface in a venue from a viewer location in the venue, the method comprising:
providing, by a processor, to a user a viewer location heat map that graphically identifies a plurality of groups of viewer locations in the venue, the plurality of groups of viewer locations being assigned to respective attribute ranges from among a plurality of attribute ranges;
receiving, by the processor, a selection by the user of the viewer location having an attribute value within the respective attribute range of a group of viewer locations from among the plurality of groups of viewer locations in the venue from the viewer location heat map;
rendering, by the processor, an image of the visual content on the media surface in the venue from the point of view of the viewer location selected by the user, wherein the rendering is based on an attribute value assigned to the viewer location, the visual content, and media surface geometry of the media surface viewable from the viewer location; and
providing, by the processor, the image of the visual content on the media surface to the user.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving, by the processor, a selection by the user of the visual content; and
receiving, by the processor, a selection by the user of the venue.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining, by the processor, for each viewer location in a plurality of viewer locations in the venue respective views of the visual content on the media surface;
determining, by the processor, for each viewer location in the plurality of viewer locations respective attribute values of the respective views of the visual content on the media surface; and
generating, by the processor, the viewer location heat map based on the visual content, the media surface, the venue, the plurality of viewer locations, and the respective attribute values.

### Claim 4 (depends on 3)

The method of claim 3, further comprising assigning respective colors to each group of viewer locations in the plurality of groups of viewer locations in the viewer location heat map based on the respective attribute ranges assigned to each of the groups of viewer locations.

### Claim 5 (depends on 1)

The method of claim 1, further comprising receiving, by the processor, a selection of the attribute value from the user, wherein the attribute value is selected from a group consisting of: a degree of a field of view of the media surface from the viewer location, a distance to a portion of the media surface from the viewer location, an amount of a field of view of the media surface occluded by venue structure or viewer location geometry from the viewer location, an amount of the visual content viewable on the media surface from the viewer location, an amount of the media surface viewable from the viewer location, and a degree of distortion of the visual content from the viewer location.

### Claim 6 (depends on 1)

The method of claim 1, further comprising overlaying, by the processor, a visual indicator of the attribute value on the image of the visual content on the media surface.

### Claim 7 (depends on 6)

The method of claim 6, wherein overlaying the visual indicator comprises overlaying a media surface heat map on the image, the media surface heat map corresponding to a plurality of regions on the media surface that are each assigned to respective media surface attribute ranges from among a plurality of media surface attribute ranges, each region of the media surface being defined based on portions of the media surface that correspond to a media attribute value that falls within the respective media surface attribute range for that region, and each region of the media surface being assigned a respective color or respective shading.

### Claim 8

A system for previewing visual content on a media surface in a venue from a viewer location in the venue, the system comprising:
a memory that stores a viewer location heat map that graphically identifies a plurality of groups of viewer locations in the venue, the plurality of groups of viewer locations being assigned to respective attribute ranges from among a plurality of attribute ranges; and
a processor configured to execute instructions stored in the memory, the instructions, when executed by the processor, configuring the processor to:
receive a selection by a user of a group of viewer locations from among the plurality of groups of viewer locations in the venue from the viewer location heat map, wherein the viewer location is assigned to the group of viewer locations based on an attribute value that falls within the respective range assigned to the group of viewer locations;
render a respective image of the visual content on the media surface for each viewer location in the group of viewer locations, wherein the rendering is based on a respective attribute value assigned to the each viewer location, the visual content, and media surface geometry of the media surface viewable from the viewer location;
combine the respective images of the visual content on the media surface into a representative image of the visual content on the media surface; and
provide the representative image of the visual content to the user.

### Claim 9 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the processor, further configure the processor to:
receive a selection by the user of the visual content; and
receive a selection by the user of the venue.

### Claim 10 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the processor, further configure the processor to:
determine for each viewer location in a plurality of viewer locations in the venue respective views of the visual content on the media surface;
determine for each viewer location in the plurality of viewer locations the respective attribute values of the respective views of the visual content on the media surface; and
generate the viewer location heat map based on the visual content, the media surface, the venue, the plurality of viewer locations, and the respective attribute values.

### Claim 11 (depends on 10)

The system of claim 10, wherein the instructions, when executed by the processor, further configure the processor to assign respective colors to each group of viewer locations in the plurality of groups of viewer locations in the viewer location heat map based on the respective attribute ranges assigned to each the groups of viewer locations.

### Claim 12 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the processor, further configure the processor to receive a selection of the attribute value from the user,
wherein the attribute value is selected from a group consisting of: a degree of a field of view of the media surface from the viewer location, a distance to a portion of the media surface from the viewer location, an amount of a field of view of the media surface occluded by venue structure or viewer location geometry from the viewer location, an amount of the visual content viewable on the media surface from the viewer location, an amount of the media surface viewable from the viewer location, and a degree of distortion of the visual content from the viewer location.

### Claim 13 (depends on 10)

The system of claim 10, wherein the instructions, when executed by the processor, further configure the processor to:
combine the respective attribute value assigned to the each viewer location in the group of viewer locations into a combined attribute value representative of the group of viewer locations; and
overlay a visual indicator of the combined attribute value on the image of the visual content on the media surface.

### Claim 14

A method for previewing visual content on a media surface in a venue from a viewer location in the venue, the method comprising:
providing, by a processor, to a user a viewer location heat map that graphically identifies a plurality of groups of viewer locations in the venue, the plurality of groups of viewer locations being assigned to respective metric ranges from among a plurality of metric ranges;
receiving, by the processor, a selection by the user of the viewer location from among a plurality of viewer locations in the venue from the viewer location heat map, the viewer location having a metric that falls within the respective attribute range of a group of viewer locations from among the plurality of groups of viewer locations;
rendering, by the processor, an image of the visual content on the media surface in the venue from the point of view of the viewer location selected by the user, wherein the rendering is based on the visual content, media surface geometry of the media surface viewable from the viewer location, and the metric of the viewer location, the metric corresponding to a plurality of attributes for the viewer location; and
providing, by the processor, the image of the visual content on the media surface to the user.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
receiving, by the processor, a selection by the user of the visual content; and
receiving, by the processor, a selection by the user of the venue.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
determining, by the processor, for each viewer location in the plurality of viewer locations in the venue respective views of the visual content on the media surface;
determining, by the processor, for each viewer location in the plurality of viewer locations and each attribute in the plurality of attributes respective attribute values of the respective views of the visual content on the media surface;
determining, by the processor, a respective metric based on each of the respective attribute values for each viewer location in the plurality of viewer locations; and
generating, by the processor, the viewer location heat map based on the visual content, the media surface, the venue, the plurality of viewer locations, and the respective metric for each viewer location in the plurality of viewer locations.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
assigning respective colors to each group of viewer locations in the plurality of groups of viewer locations in the viewer location heat map based on the respective metric ranges assigned to each of the groups of viewer locations.

### Claim 18 (depends on 14)

The method of claim 14, further comprising:
receiving, by the processor, a selection of the plurality of attributes from the user, wherein the plurality of attributes are selected from a group consisting of: a degree of a field of view of the media surface from the viewer location, a distance to a portion of the media surface from the viewer location, an amount of a field of view of the media surface occluded by venue structure or viewer location geometry from the viewer location, an amount of the visual content viewable on the media surface from the viewer location, an amount of the media surface viewable from the viewer location, and a degree of distortion of the visual content from the viewer location.

### Claim 19 (depends on 14)

The method of claim 14, further comprising overlaying, by the processor, a visual indicator of the metric on the image of the visual content on the media surface.

### Claim 20 (depends on 14)

The method of claim 14, further comprising overlaying, by the processor, a visual indicator of respective values of one or more of the plurality of attributes on the image of the visual content on the media surface.