# US 2013/0159856 A1 · Techniques for augmenting a digital on-screen graphic

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0159856 A1
- Document ID: US20130159856A1
- Status: Published application
- Kind: A1
- Application number: 13/818,948
- Filed: 2011-08-25
- Published: 2013-06-20
- Earliest claimed: 2010-08-27
- Assignees: Intel Corporation
- Inventors: Bran Ferren
- Web page: https://patentgrep.com/patent/US20130159856A1

## CPC

- H04N 21/632: {using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices (broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- G01S 5/20: Position of source determined by a plurality of spaced direction-finders
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/0383: {Signal control means within the pointing device}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0414: {using force sensing means to determine a position}
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/0485: Scrolling or panning
- G06N 5/02: Knowledge representation; Symbolic representation
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06V 20/635: {Overlay text, e.g. embedded captions in a TV programme}
- G08C 17/00: Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C 17/02: using a radio link
- G08C 19/00: Electric signal transmission systems (G08C17/00 takes precedence)
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits}
- H04N 5/91: Television signal processing therefor
- H04N 21/4147: PVR [Personal Video Recorder] (H04N5/76 takes precedence {; arrangements for broadcast with accumulation-type receivers H04H20/40})
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/4333: {Processing operations in response to a pause request}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/437: Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server {(flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60)}
- H04N 21/4432: {Powering on the client, e.g. bootstrap loading using setup parameters being stored locally or received from the server (resetting in general G06F1/14; program loading or initiating in general G06F9/445; bootstrapping in general G06F9/4401; secure boots of computer platforms G06F21/57)}
- H04N 21/4436: {Power management, e.g. shutting down unused components of the receiver (power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418)}
- H04N 21/4508: {Management of client data or end-user data}
- H04N 21/4516: {involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/482: End-user interface for programme selection
- H04N 21/4882: {for displaying messages, e.g. warnings, reminders (arrangements for providing short real-time information to substation in data switching networks H04L12/1895)}
- H04N 21/63: Control signaling {related to video distribution} between client, server and network components; Network processes for video distribution between server and clients {or between remote clients}, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing (real-time session protocols H04L65/1101; distributed application using peer-to-peer [P2P] networks H04L67/104)
- H04N 21/654: Transmission by server directed to the client
- G06F 2203/04804: Transparency, e.g. transparent or translucent windows
- G08C 2201/32: Remote control based on movements, attitude of remote control device
- G08C 2201/40: Remote control systems using repeaters, converters, gateways
- H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)}
- H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

In an embodiment, a digital on-screen graphic may be identified within a multimedia stream for an electronic display. An augmentation overlay may be determined based on the digital on-screen graphic. The augmentation overlay may be presented on the electronic display to at least partially surround the digital on-screen graphic. Other embodiments are described and claimed.

## Claims

### Claim 1

An article of manufacture comprising a machine-readable storage medium containing instructions that when executed enable a system to:
identify a digital on-screen graphic within a multimedia stream for an electronic display;
determine an augmentation overlay based on the digital on-screen graphic; and
present the augmentation overlay on the electronic display to at least partially surround the digital on-screen graphic.

### Claim 2 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine one or more segments of the augmentation overlay, the segments to correspond to entertainment-related menu items.

### Claim 3 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine a selected segment of the augmentation overlay; and
present a secondary object on the electronic display based on the selected segment.

### Claim 4 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
use pattern recognition to locate the digital on-screen graphic.

### Claim 5 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine a set of multiple frames from the multimedia stream; and
use an integration calculation to determine the digital on-screen graphic using the set of frames.

### Claim 6 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
compare a static image in multiple frames of the multimedia stream to a library of digital on-screen graphics; and
determine that the static image matches a digital on-screen graphic from the library.

### Claim 7 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine a repeated image on the bottom half of multiple sequential fames of the multimedia stream; and
determine that the repeated image is the on-screen graphic.

### Claim 8 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine a shape of the digital on-screen graphic, the shape comprising: a rectangle, a circle, a triangle or a polygon.

### Claim 9 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine a color of the augmentation overlay such that the augmentation overlay blends in with one or more of the digital on-screen graphic and one or more frames of the multimedia stream.

### Claim 10 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine dimensions of the augmentation overlay based on the digital on-screen graphic, the dimensions comprising: one-dimensional, two-dimensional or three-dimensional.

### Claim 11 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
determine one or more segments of the augmentation overlay based on one or more of user preferences and current content on the multimedia stream.

### Claim 12 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
create an alert based on an incoming message, a program to be recorded, related content, shopping opportunities, or enhanced content.

### Claim 13 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
change a color of the augmentation overlay based on an entertainment-related event.

### Claim 14 (depends on 1)

The article of claim 1, comprising instructions that when executed enable a system to:
flash the augmentation overlay on the electronic display at a defined rate based on an entertainment-related event.

### Claim 15

A method comprising:
identifying a digital on-screen graphic within a multimedia stream for an electronic display;
selecting a augmentation overlay based on the digital on-screen graphic;
determining one or more segments of the augmentation overlay, a segment corresponding to an entertainment category; and
presenting the segmented augmentation overlay on the electronic display to at least partially enhance the digital on-screen graphic.

### Claim 16 (depends on 15)

The method of claim 15, comprising:
determining a segment of the one or more segments of the augmentation overlay selected by a user; and
presenting a secondary object based on the selected segment.

### Claim 17 (depends on 15)

The method of claim 15, comprising:
determining one or more menu items corresponding to the one or more segments, the menu items comprising: favorites, share, shop, relate, chat or record.

### Claim 18 (depends on 15)

The method of claim 15, comprising:
using pattern recognition to locate the digital on-screen graphic.

### Claim 19 (depends on 15)

The method of claim 15, comprising:
determining a set of multiple frames from the multimedia stream; and
using a mathematical calculation to determine the digital on-screen graphic using the set of frames.

### Claim 20 (depends on 15)

The method of claim 15, comprising:
comparing a static image in multiple frames of the multimedia stream to a library of digital on-screen graphics; and
determining that the static image matches a digital on-screen graphic from the library.

### Claim 21 (depends on 15)

The method of claim 15, comprising:
determining a repeated image on the bottom half of multiple sequential fames of the multimedia stream; and
determining that the repeated image is the on-screen graphic.

### Claim 22 (depends on 15)

The method of claim 15, comprising:
determining a shape of the digital on-screen graphic, the shape comprising: a rectangle, a circle, a triangle or a polygon.

### Claim 23 (depends on 15)

The method of claim 15, comprising:
determining a color of the augmentation overlay so that the augmentation overlay blends with one or more of the digital on-screen graphic and one or more frames of the multimedia stream.

### Claim 24 (depends on 15)

The method of claim 15, comprising:
determining one or more segments of the augmentation overlay based on one or more of user preferences and current content of the multimedia stream.

### Claim 25 (depends on 15)

The method of claim 15, comprising:
highlighting at least one of the one or more segments of the augmentation overlay based on an entertainment-related event.

### Claim 26 (depends on 15)

The method of claim 15, comprising:
changing a color of at least one of the one or more of the segments of the augmentation overlay based on an entertainment-related event.

### Claim 27

An apparatus comprising:
a processing component; and
a visually augmented digital on-screen graphic component operative on the processing component to navigate a multimedia stream, the visually augmented digital on-screen graphic component comprising:
a digital on-screen graphic recognition component operative to identify a digital on-screen graphic within the multimedia stream,
an augmentation overlay determination component operative to determine a augmentation overlay based on the digital on-screen graphic, and
a menu segmentation component operative to determine one or more segments of the augmentation overlay, wherein a segment triggers a secondary object to be presented.

### Claim 28 (depends on 27)

The apparatus of claim 27, the visually augmented digital on-screen graphic component comprising:
visually augmented digital on-screen graphic implementation component operative to change a color of at least a portion of the augmentation overlay.

### Claim 29 (depends on 27)

The apparatus of claim 27, the visually augmented digital on-screen graphic component operative to present the augmentation overlay to at least partially surround the digital on-screen graphic.

### Claim 30 (depends on 27)

The apparatus of claim 27, comprising:
a digital display on a media processing device.
