# US 2010/0063880 A1 · Providing content responsive to multimedia signals

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0063880 A1
- Document ID: US20100063880A1
- Status: Published application
- Kind: A1
- Application number: 12/403,539
- Filed: 2009-03-13
- Published: 2010-03-11
- Earliest claimed: 2006-09-13
- Assignees: Alon Atsmon
- Inventors: Alon Atsmon; Saar Shai
- Web page: https://patentgrep.com/patent/US20100063880A1

## CPC

- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- G06Q 10/0637: Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0255: {based on user history}
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/25: using position of the lips, movement of the lips or face analysis
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4524: {involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00)}
- H04N 21/6131: {involving transmission via a mobile phone network (wireless downlink channel access H04W74/006)}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method of providing information including providing a communication session of at least one of audio and video media and applying automatic recognition to media transferred on the communication session. An advertisement is selected by a processor, based on the automatic recognition and non-advertisement information is selected by the processor, responsive to the automatic recognition. The selected advertisements and the selected non-advertisement information, are presented during the communication session.

## Claims

### Claim 1

A method of providing information, comprising:
providing a communication session of at least one of audio and video media;
applying automatic recognition to media transferred on the communication session;
selecting an advertisement, by a processor, based on the automatic recognition;
selecting non-advertisement information, by the processor, responsive to the automatic recognition; and
presenting the selected advertisements and the selected non-advertisement information, during the communication session.

### Claim 2 (depends on 1)

A method according to claim 1, wherein providing the communication session comprises providing a communication session of a single human, with an automatic opposite end terminal.

### Claim 3 (depends on 1)

A method according to claim 1, wherein providing the communication session comprises providing a communication session between a plurality of human users.

### Claim 4 (depends on 1)

A method according to claim 1, wherein providing the communication session comprises providing a communication session with at least one instant messaging software end point.

### Claim 5 (depends on 1)

A method according to claim 1, wherein providing the communication session comprises providing a communication session with at least one mobile station end point.

### Claim 6 (depends on 1)

A method according to claim 1, wherein applying automatic recognition to media transferred on the communication session comprises applying the automatic recognition by an end terminal of the communication session.

### Claim 7 (depends on 6)

A method according to claim 6, wherein applying the automatic recognition by an end terminal of the communication session comprises applying the automatic recognition with aid from a remote server.

### Claim 8 (depends on 1)

A method according to claim 1, wherein selecting non-advertisement information comprises selecting a dictionary or encyclopedia entry on a term identified on the communication session by the automatic recognition.

### Claim 9 (depends on 1)

A method according to claim 1, wherein selecting non-advertisement information comprises selecting a map related to a term identified on the communication session by the automatic recognition.

### Claim 10 (depends on 1)

A method according to claim 1, wherein selecting non-advertisement information comprises selecting the non-advertisement information also responsive to information on a human participant in the session, which information was collected by the processor before the communication session began.

### Claim 11 (depends on 1)

A method according to claim 1, wherein presenting the advertisement and non-advertisement information comprises displaying both the advertisement and non-advertisement information on a single display.

### Claim 12 (depends on 1)

A method according to claim 1, wherein presenting the advertisement and non-advertisement information comprises displaying on a display of an end terminal of the communication session.

### Claim 13 (depends on 1)

A method according to claim 1, wherein presenting the advertisement and non-advertisement information comprises conveying at least one of the advertisement and non-advertisement information audibly.

### Claim 14 (depends on 1)

A method according to claim 1, wherein presenting the advertisement and non-advertisement information comprises conveying at least one of the advertisement and non-advertisement information to a human user at least 30 minutes after it is selected.

### Claim 15 (depends on 1)

A method according to claim 1, wherein selecting the non-advertisement information comprises selecting information from a web site of user generated content.

### Claim 16 (depends on 1)

A method according to claim 1, wherein selecting the non-advertisement information comprises selecting a transcription or translation of audio signals passing on the connection.

### Claim 17 (depends on 1)

A method according to claim 1, wherein selecting the non-advertisement information comprises selecting information in a local memory associated with the processor.

### Claim 18 (depends on 1)

A method according to claim 1, wherein selecting the non-advertisement information comprises selecting information retrieved from a remote server.

### Claim 19

A communication terminal, comprising:
a communication interface configured to conduct at least one of audio and video media communication sessions with remote terminals;
a display; and
a processor configured to apply automatic recognition to media transferred through the communication interface, and to select both advertisement and not-advertisement information responsive to the recognition and to display the selected information on the display.

### Claim 20 (depends on 19)

A terminal according to claim 19, wherein the communication interface comprises a wireless interface.

### Claim 21

A method of providing information, comprising:
providing a communication session of at least one of audio and video media;
applying automatic recognition to media transferred on the communication session;
selecting information, by a software running on a processor, based on the automatic recognition; and
downloading the selected information from at least one web site not associated with a manufacturer of the software.

### Claim 22 (depends on 21)

A method according to claim 21, wherein selecting the information comprises displaying a list of the possible information selected responsive to the automatic recognition and receiving an indication of an entry in the list.

### Claim 23 (depends on 21)

A method according to claim 21, wherein selecting the information comprises selecting responsive to selections of information by human users in previous communication sessions.

### Claim 24 (depends on 21)

A method according to claim 21, wherein downloading the selected information from at least one web site comprises downloading from a plurality of non-associated web sites.

### Claim 25

A method of providing information, comprising:
providing a communication session of at least one of audio and video media;
applying automatic recognition to media transferred on the communication session;
displaying a list of possible information selected responsive to the automatic recognition;
receiving an indication of an entry in the list; and
displaying the information corresponding to the entry of the list pointed to by the received indication.

### Claim 26

A method of providing information, comprising:
providing a video stream;
applying automatic image recognition to the video stream;
selecting information responsive to the image recognition; and
displaying the selected information within ten minutes from performing the image recognition leading to selection of the displayed information.

### Claim 27 (depends on 26)

A method according to claim 26, wherein displaying the selected information comprises displaying within ten minutes from acquiring images of the video stream leading to the selection of the information, by a video camera.

### Claim 28 (depends on 26)

A method according to claim 26, wherein providing the video stream comprises providing a video stream acquired by a portable video camera.

### Claim 29 (depends on 26)

A method according to claim 26, wherein providing the video stream comprises providing a video stream acquired by a camera included in a mobile communication terminal.

### Claim 30 (depends on 26)

A method according to claim 26, wherein displaying the selected information comprises displaying advertisements.

### Claim 31

A method of matching information to a word sequence, comprising:
providing a semantic map;
receiving a word sequence, by a processor;
determining locations of words of the sequence in the semantic map;
selecting information for the word sequence, at least partially responsive to the locations of the words of the sequence in the map; and
displaying the selected information.

### Claim 32 (depends on 31)

A method according to claim 31, wherein providing the semantic map comprises providing a map from a web site of user provided content.

### Claim 33 (depends on 31)

A method according to claim 31, wherein selecting the information comprises providing a list of keywords and corresponding information for display and selecting a keyword from the list based on its distance in the semantic map from words of the sequence.

### Claim 34 (depends on 31)

A method according to claim 31, wherein receiving a word sequence comprises receiving a word sequence received from a speech recognition unit.

### Claim 35

A wireless communication terminal, comprising:
a communication session interface configured to conduct at least one of audio and video media communication sessions with remote terminals, over a wireless link;
a display; and
a processor configured to perform media recognition on media passing through the communication interface, to select information responsive to the recognition and to display the selected information on the display.

### Claim 36 (depends on 35)

A terminal according to claim 35, comprising a server interface configured for communicating with a media recognition server, the server interface adapted to operate in parallel with the communication session interface, and wherein the processor is configured to perform at least one of media recognition, selection of information and display of the selected information utilizing information received over the server interface.

### Claim 37 (depends on 36)

A terminal according to claim 36, wherein the processor is configured to download the selected information through the server interface while the communication session interface is carrying a media session.

### Claim 38

A wireless communication terminal, comprising:
a communication session interface configured to conduct at least one of audio and video media communication sessions with remote terminals, over a wireless link;
a display;
an earphone interface; and
a processor configured to display advertisements on the terminal responsive to whether an earphone is coupled to the earphone interface.

### Claim 39 (depends on 38)

A terminal according to claim 38, wherein the processor is configured to display advertisements on the display only when an earphone is coupled to the earphone interface.

### Claim 40 (depends on 38)

A terminal according to claim 38, wherein the processor is configured to track the amount of time that advertisements were displayed while an earphone was coupled to the earphone interface.

### Claim 41

A method of providing a person with information, comprising:
acquiring sub-vocal speech from a person;
identifying words in the acquired sub-vocal speech; and
displaying content to the person responsive to the identified words.

### Claim 42 (depends on 41)

A method according to claim 41, wherein acquiring the sub-vocal speech comprises acquiring by electrodes above the vocal chords of the person.

### Claim 43

A method of acquiring feedback on a commercial setting, comprising:
providing a commercial setting;
positioning a camera or microphone directed at a position from which individuals can view the commercial setting;
acquiring media signals by the camera or microphone;
applying media recognition to the acquired signals; and
generating feedback on the commercial setting having a storage size of less than 10% of a size of the acquired media signals.

### Claim 44 (depends on 43)

A method according to claim 43, wherein generating the feedback comprises providing portions of the media signals including words which may relate to the commercial setting.

### Claim 45 (depends on 43)

A method according to claim 43, wherein providing the commercial setting comprises providing an e-shop.
