System to augment a visual data stream with user-specific content

A method for adding relevant augment information to a video stream, the method comprising:

• accessing a first frame and a second frame of a video stream, wherein the first frame comprises objects and the second frame comprises objects;
• relating patterns in the first frame and the second frame to determine points of interest contained within each of the first frame and the second frame;
• receiving characteristics information of the points of interest included in the first frame and the second frame, wherein the characteristics information of the points of interest include geometric shapes of the objects contained in the first frame and geometric shapes of the objects contained in the second frame;
• selecting relevant augment information from an augment information database based upon the received characteristics information;
• and
• adding, by a processor, the selected relevant augment information to the accessed video stream.

An apparatus for adding relevant augment information to a video stream, the apparatus comprising:

• a memory storing machine readable instructions, that when executed, cause the apparatus to:
• access a first frame and a second frame of a video stream, wherein the first frame comprises objects and the second frame comprises objects;
• decompose the objects contained in the first frame and the second frame into geometric shapes;
• relate patterns in the first frame and the second frame to determine points of interest contained within each of the first frame and the second frame;
• receive characteristics information of the determined points of interest, wherein the characteristics information of the points of interest include the geometric shapes of the objects contained in the first frame and the second frame;
• select relevant augment information from an augment information database based upon the received characteristics information;
• and
• add the selected relevant augment information to the accessed video stream;
• and
• a processor to execute the machine readable instructions.

A non-transitory machine readable storage medium on which is stored machine readable instructions that when executed by a processor are to cause the processor to:

• access a first frame and a second frame of a video stream, wherein the first frame comprises objects and the second frame comprises objects;
• decompose the objects contained in the first frame and the second frame into geometric shapes;
• relate patterns in the first frame and the second frame to determine points of interest contained within each of the first frame and the second frame;
• receive characteristics information of the determined points of interest, wherein the characteristics information of the points of interest include the geometric shapes of the objects contained in the first frame and the second frame;
• select relevant augment information from an augment information database based upon the received characteristics information;
• and
• add the selected relevant augment information to the accessed video stream.