# US 2019/0172235 A1 · Method and apparatus for generating actionable marked objects in images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172235 A1
- Document ID: US20190172235A1
- Status: Published application
- Kind: A1
- Application number: 15/830,687
- Filed: 2017-12-04
- Published: 2019-06-06
- Earliest claimed: 2017-12-04
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: AT&T Intellectual Property I, L.P.
- Inventors: Mehmet Ozkan
- Web page: https://patentgrep.com/patent/US20190172235A1

## CPC

- H04N 5/222: Studio circuitry; Studio devices; Studio equipment (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00)
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Aspects of the subject disclosure may include, for example, embodiments for generating an embedded object definitions (EOD) file for an image of a video file. The EOD file can include information about object markings of the video image. Further embodiments include identifying an object within the original video and determining a plurality of pixels associated with the object. A position, a color, a contrast and a brightness are associated with each of the plurality of pixels. Additional embodiments include adjusting color, contrast, and brightness of each of the plurality of pixels resulting in adjusted pixels of each of the plurality of pixels. Also, embodiments can include overlaying the marked image with the adjusted pixels of each of the plurality of pixels during a presentation of the video file. The marked image presents the object as marked on a display to a user, resulting in a marked object. Other embodiments are disclosed.

## Claims

### Claim 1

A device, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
generating an embedded object definitions (EOD) file associated with an image of a video file, wherein the EOD file includes information regarding image markings, resulting in a marked image;
identifying an object within a video image;
determining a plurality of pixels associated with the object, wherein a position, a color, a contrast and a brightness are associated with each of the plurality of pixels;
adjusting the color, the contrast, and the brightness of each of the plurality of pixels resulting in adjusted pixels of each of the plurality of pixels; and
overlaying the marked image with the adjusted pixels of each of the plurality of pixels during a presentation of the video file, wherein the marked image presents the object as marked on a display to a user, resulting in a marked object.

### Claim 2 (depends on 1)

The device of the claim 1, wherein the operations comprise:
generating an assigned object actions (AOA) file associated with the marked image;
identifying an action with the marked object; and
associating the action with the marked object in the AOA file.

### Claim 3 (depends on 2)

The device of the claim 2, wherein the operations comprise:
receiving user-generated input, wherein the user-generated input includes selected pixels of the marked image;
determining that one or more of the selected pixels include a portion of the adjusted pixels within the EOD file;
identifying the marked object associated with the adjusted pixels; and
identifying the action associated with the marked object in the AOA file.

### Claim 4 (depends on 3)

The device of claim 3, wherein generating the EOD file includes receiving object marking information from an object marking software application, wherein the information regarding image markings is based on the object marking information, and wherein the video image is not changed when marking the object.

### Claim 5 (depends on 2)

The device of claim 2, wherein the operations comprise executing the action associated with the marked object.

### Claim 6 (depends on 5)

The device of claim 5, wherein the action can be one of accessing a website, initiating communication with a customer representative, and implementing a software application.

### Claim 7 (depends on 5)

The device of claim 5, wherein a first portion of the video file includes the image and the action includes accessing a second portion of the video file.

### Claim 8 (depends on 1)

The device of claim 1, wherein the EOD file comprises information regarding the object markings of the original video file, includes the marked object.

### Claim 9 (depends on 1)

The device of claim 1, wherein the identifying the object comprises identifying the object using image recognition techniques implemented by a software application.

### Claim 10

A machine-readable storage medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
receiving user-generated input, wherein the user-generated input includes selected pixels of a marked image;
determining that one or more of the selected pixels include a portion of adjusted pixels of the marked image within an embedded object definitions (EOD) file;
identifying a marked object associated with the adjusted pixels; and
identifying an action associated with the marked object in an assigned object actions (AOA) file.

### Claim 11 (depends on 10)

The machine-readable storage medium of claim 10, wherein the operations further comprise:
generating the EOD file associated with an image, wherein the EOD file includes information regarding object markings within a video file resulting in a marked image;
identifying an object within a video image of the video file;
determining a plurality of pixels associated with the object, wherein a position, a color, a contrast, and a brightness are associated with each of the plurality of pixels;
adjusting the color, the contrast, and the brightness of each of the plurality of pixels resulting in adjusted pixels of each of the plurality of pixels; and
overlaying the marked image with the adjusted pixels of each of the plurality of pixels during a presentation of the video file, wherein the marked image presents the object as marked on a display to a user, resulting in the marked object.

### Claim 12 (depends on 11)

The machine-readable storage medium of claim 11, wherein the operations further comprise:
generating the AOA file associated with the image;
identifying the action with the marked object; and
associating the action with the marked object in the AOA file.

### Claim 13 (depends on 12)

The machine-readable storage medium of claim 12, wherein the operations further comprise executing the action associated with the marked object.

### Claim 14 (depends on 13)

The machine-readable storage medium of claim 13, wherein the executing the action comprises accessing a portion of the video file.

### Claim 15 (depends on 11)

The machine-readable storage medium of claim 11, wherein the operations further comprise:
obtaining an image of the object, wherein identifying the object within the marked image comprises identifying the object within object by comparing the marked image to the image of the object using image recognition techniques implemented by a software application.

### Claim 16

A method, comprising:
obtaining, by a processing system including a processor, an image of an object;
generating, by the processing system, an embedded object definitions (EOD) file associated with an image of a video file, wherein the EOD file includes information regarding a marked object within a video image resulting in a marked image;
identifying, by the processing system, the object within an original video image
determining, by the processing system, a plurality of pixels associated with the object, wherein a position, a color, a contrast, and a brightness are associated with each of the plurality of pixels;
adjusting, by the processing system, the color, the contrast, and brightness of each of the plurality of pixels resulting in adjusted pixels of each of the plurality of pixels; and
overlaying, by the processing system, the marked image with the adjusted pixels of each of the plurality of pixels during a presentation of the video file, wherein the marked image presents the object as marked on a display to a user, resulting in a marked object.

### Claim 17 (depends on 16)

The method of claim 16, comprising:
generating, by the processing system, an assigned object actions (AOA) file associated with the image;
identifying, by the processing system, an action with the marked object; and
associating, by the processing system, the action with the marked object in the AOA file.

### Claim 18 (depends on 17)

The method of claim 17, comprising:
receiving, by the processing system, voice-generated user input, wherein the voice-generated user input includes a name of the marked object in the marked image;
determining, by the processing system, one or more of selected pixels of the marked image according to the name of the marked object, wherein the selected pixels include a portion of the adjusted pixels within the EOD file;
identifying, by the processing system, the marked object associated with the adjusted pixels; and
identifying, by the processing system, the action associated with the marked object in the AOA file.

### Claim 19 (depends on 18)

The method of claim 18, comprising executing, by the processing system, the action associated with the marked object.

### Claim 20 (depends on 19)

The method of claim 19, wherein the executing the action comprises accessing, by the processing system, a portion of the video file.
