# US 10,873,768 B2 · Three-dimensional advertising space determination system, user terminal, and three-dimensional advertising space determination computer > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,873,768 B2 - Document ID: US10873768B2 - Status: Granted - Kind: B2 - Application number: 15/821,335 - Filed: 2017-11-22 - Published: 2018-03-22 - Granted: 2020-12-22 - Earliest claimed: 2015-06-02 - Assignees: Dentsu Inc. - Applicants: Dentsu Inc. - Inventors: Akihiro Shimura - Web page: https://patentgrep.com/patent/US10873768B2 ## CPC - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06Q 30/02: Marketing; Price estimation or determination; Fundraising - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - H04N 13/194: Transmission of image signals - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement} - H04N 21/43: Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware {(real-time communication protocols in data switching networks H04L65/00)} - H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)} - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An effective advertising frame in a free viewpoint motion image is provided. A distribution computer 51 distributes free viewpoint motion image data to each of user terminals 50AN1 to 50ANK. The user terminals 50AN1 to 50ANK create a motion image from the received free viewpoint motion image data and display the motion image. The user terminals 50AN1 to 50ANK extract history data of a focused region of the displayed image and transmit the history data to a stereoscopic advertising frame determination computer 52. The stereoscopic advertising frame determination computer 52 stores the history data for every user ID and every content ID and extracts a common region from focused regions of a plurality of users for each content ID to determine the region as a stereoscopic advertising frame. ## Claims ### Claim 1 A stereoscopic advertising frame determination system, comprising: a user terminal configured to: receive content data formed of a free viewpoint motion image in which a viewing viewpoint can be changed from a distribution computer and display motion image data from a specific viewpoint on a display means, and display, when an operator applies viewpoint characteristic changing data that changes viewpoint characteristics to the displayed specific viewpoint motion image data, the specific viewpoint motion image data on the display means on the basis of the viewpoint characteristic changing data; and a stereoscopic advertising frame determination computer, wherein A) the user terminal further includes: a focused space determining means for determining a focused space in the specific viewpoint motion image on the basis of the specific viewpoint motion image data displayed on the display means, and a transmitting means for transmitting transitional history of the focused space to the stereoscopic advertising frame determination computer, B) the stereoscopic advertising frame determination computer includes a user-specific history data receiving means for receiving the transitional history of the content data as user-specific history data, and a stereoscopic advertising frame determining means for determining a content-specific stereoscopic advertising frame obtained from the user-specific history data, C) the focused space determining means determines, as the focused space, a three-dimensional individual region that meets a two-dimensional display region specified by a designated viewpoint, a viewpoint direction, and provided depth specified data among three-dimensional individual regions formed by dividing a three-dimensional space defined in the free viewpoint motion image into a plurality of spaces, and D) the stereoscopic advertising frame determining means determines a three-dimensional area based on a set of three-dimensional individual region given from a plurality of user terminals as the stereoscopic advertisement frame. ### Claim 2 (depends on 1) The stereoscopic advertising frame determination system according to claim 1, wherein the stereoscopic advertising frame determining means determines an AND-operated set or OR-operated set of three-dimensional individual regions given from a plurality of user terminals as the stereoscopic advertisement frame. ### Claim 3 (depends on 1) The stereoscopic advertising frame determination system according to claim 1, wherein the free viewpoint motion image is played back from specified viewpoint and the viewpoint directions from start of playback until end of the playback. ### Claim 4 (depends on 2) The stereoscopic advertising frame determination system according to claim 2, wherein the three-dimensional advertisement frame is a rectangular parallelepiped formed by removing or adding a part from the AND operation set or OR operation set of the three-dimensional individual region. ### Claim 5 (depends on 2) The stereoscopic advertising frame determination system according to claim 2, wherein the stereoscopic advertising frame determining means, when the areas defined by the AND operation set or the OR operation set are not continuous, combines the areas to form the stereoscopic advertisement frame. ### Claim 6 A stereoscopic advertising frame determination system, comprising: a user terminal configured to: receive content data formed of a free viewpoint motion image in which a viewing viewpoint can be changed from a distribution computer and display motion image data from a specific viewpoint on a display means, and display, when an operator applies viewpoint characteristic changing data that changes viewpoint characteristics to the displayed specific viewpoint motion image data, the specific viewpoint motion image data on the display means on the basis of the viewpoint characteristic changing data; and a stereoscopic advertising frame determination computer, wherein A) the user terminal further includes: a focused space basic data creating means for creating focused space basic data to determine a focused space in the specific viewpoint motion image on the basis of the specific viewpoint motion image data displayed on the display means, and a transmitting means for transmitting transitional history of the focused space basic data to the stereoscopic advertising frame determination computer, B) the stereoscopic advertising frame determination computer includes a user-specific history data receiving means for receiving the transitional history of the content data as user-specific history data, and a stereoscopic advertising frame determining means for determining a content-specific stereoscopic advertising frame obtained from the user-specific history data, and C) the focused space basic data creating means determines, as the focused space, a three-dimensional individual region that meets a two-dimensional display region specified by a designated viewpoint, a viewpoint direction, and provided depth specified data among three-dimensional individual regions formed by dividing a three-dimensional space defined in the free viewpoint motion image into a plurality of spaces, and creates the focused space basic data, and D) the stereoscopic advertising frame determining means determines a three-dimensional area based on a set of three-dimensional individual region given from a plurality of user terminals as the stereoscopic advertisement frame. ### Claim 7 (depends on 6) The stereoscopic advertising frame determination system according to claim 6, wherein the stereoscopic advertising frame determining means determines an AND-operated set or OR-operated set of three-dimensional individual regions given from a plurality of user terminals as the stereoscopic advertisement frame. ### Claim 8 (depends on 6) The stereoscopic advertising frame determination system according to claim 6, wherein the free viewpoint motion image is played back from specified viewpoint and the viewpoint directions from start of playback until end of the playback. ### Claim 9 (depends on 7) The stereoscopic advertising frame determination system according to claim 7, wherein the stereoscopic advertisement frame is a rectangular parallelepiped formed by removing or adding a part from the AND operation set or OR operation set of the three-dimensional individual region. ### Claim 10 (depends on 7) The stereoscopic advertising frame determination system according to claim 7, wherein the stereoscopic advertising frame determining means, when the areas defined by the AND operation set or the OR operation set are not continuous, combines the areas to form the stereoscopic advertisement frame. ### Claim 11 A method for determining a stereoscopic advertising frame, a distribution computer, a user terminal, and a stereoscopic advertising frame determination computer being connected to one another, the user terminal being configured to: receive content data formed of a free viewpoint motion image in which a viewing viewpoint can be changed from the distribution computer and display motion image data from a specific viewpoint on the user terminal, and display, when an operator applies viewpoint characteristic changing data that changes viewpoint characteristics to the displayed specific viewpoint motion image data, the specific viewpoint motion image data based on the viewpoint characteristic changing data, wherein A) the user terminal includes: a focused space determining step of determining a focused space in the specific viewpoint motion image on the basis of the displayed specific viewpoint motion image data as user-specific history data, and a step of transmitting transitional history of the focused space to the stereoscopic advertising frame determination computer, and B) the stereoscopic advertising frame determination computer is configured to determine a content-specific stereoscopic advertising frame obtained from the user-specific history data when receiving the transitional history of the content data, and C) the user terminal computer determines, as the focused space, a three-dimensional individual region that meets a two-dimensional display region specified by a designated viewpoint, a viewpoint direction, and provided depth specified data among three-dimensional individual regions formed by dividing a three-dimensional space defined in the free viewpoint motion image into a plurality of spaces in the focused space determining step, and D) the stereoscopic advertising frame determination computer determines a three-dimensional area based on a set of three-dimensional individual region given from a plurality of user terminals as the stereoscopic advertisement frame. ### Claim 12 (depends on 11) The stereoscopic advertising frame determination method according to claim 11, wherein the stereoscopic advertisement frame is determined based on an AND-operated set or OR-operated set of three-dimensional individual regions given from a plurality of user terminals. ### Claim 13 (depends on 11) The stereoscopic advertising frame determination method according to claim 11, wherein the free viewpoint motion image is played back from specified viewpoint and the viewpoint directions from start of playback until end of the playback. ### Claim 14 (depends on 12) The stereoscopic advertising frame determination method according to claim 12, wherein the stereoscopic advertisement frame is a rectangular parallelepiped formed by removing or adding a part from the AND operation set or OR operation set of the three-dimensional individual region. ### Claim 15 (depends on 12) The stereoscopic advertising frame determination method according to claim 12, wherein the stereoscopic advertising frame determining means, when the areas defined by the AND operation set or the OR operation set are not continuous, the areas is combined to form the stereoscopic advertisement frame.