Method and System for Maintaining Profiles of Information Channels

A method for maintaining profiles of information channels, comprising the steps of:

• monitoring a channel a first time on a data network during an epoch by a channel pull action at a first monitoring rate to identify channel update events,
• determining a rate of novelty content production in the channel by filtering the update events occurring during the epoch to identify novel update events, wherein filtering comprises disregarding ones of the update events that do not include significant novel information;
• establishing a second monitoring rate by adjusting the first monitoring rate responsively to the rate of novelty content production;
• monitoring the channel a second time during a subsequent epoch at the second monitoring rate;
• and
• recording the novel update events in a channel profile to establish an indication of dynamic textual content of the channel.

A computer software product for maintaining profiles of information channels, including a non-transitory computer-readable storage medium in which computer program instructions are stored, which instructions, when executed by a computer, cause the computer to perform a method comprising the steps of:

• monitoring a channel a first time on a data network during an epoch by a channel pull action at a first monitoring rate to identify channel update events,
• determining a rate of novelty content production in the channel by filtering the update events occurring during the epoch to identify novel update events, wherein filtering comprises disregarding ones of the update events that do not include significant novel information;
• establishing a second monitoring rate by adjusting the first monitoring rate responsively to the rate of novelty content production;
• monitoring the channel a second time during a subsequent epoch at the second monitoring rate;
• and
• recording the novel update events in a channel profile to establish an indication of dynamic textual content of the channel.

A data processing system for maintaining profiles of information channels, comprising:

• a processor;
• a pull protocol adapter linked to the processor;
• a memory accessible to the processor storing programs and data objects therein, the programs including profile management software, wherein execution of the programs causes the processor to perform a method comprising the steps of:
• monitoring a channel a first time on a data network during an epoch by a channel pull action at a first monitoring rate to identify channel update events,
• determining a rate of novelty content production in the channel by filtering the update events occurring during the epoch to identify novel update events, wherein filtering comprises disregarding ones of the update events that do not include significant novel information;
• establishing a second monitoring rate by adjusting the first monitoring rate responsively to the rate of novelty content production;
• monitoring the channel a second time during a subsequent epoch at the second monitoring rate;
• and
• recording the novel update events in a channel profile to establish an indication of dynamic textual content of the channel.