Method, system and apparatus for identifying and parsing social media information for providing business intelligence

An apparatus executing computer instructions for parsing, retrieving and reporting content from at least one Website on a communication network, the apparatus comprising

• a processor,
• a server for executing the steps:
• receiving instructions, via a graphical user interface (GUI) executed by a server, to conduct a search for at least one keyword on the communication network;
• launching a Web crawler, by the server, to search a plurality of Websites for at least one Website having content that includes said at least one keyword;
• identifying Websites comprising at least one comment container, wherein said comment container includes at least one conversation;
• creating a unique xpath, by the server, to said at least one comment container of each identified Website of said Websites, wherein the unique xpath comprises an extraction string dynamically generated to identify at least one of how to find comments, the date of a post on the Website, IP address, user name, and location;
• saving, in a database, the unique xpath created for said at least one comment container of said each identified Website;
• detecting using the unique xpath at least one conversation that includes the at least one keyword from search of a content of said comment container of said each Website accessible only by said unique xpath;
• saving only a portion of the content of said comment container from said each Website that includes the at least one keyword along with information associated to each conversation of said identified conversation;
• assigning, via a server, a categorical topic for said each conversation;
• assigning, via a server, a sentiment for said each conversation;
• and
• generating at least one report, by the server, providing selected information related to said each conversation, along with categorical topic and sentiment for said each conversation,
• wherein the method is computer implemented, and
• said assigning the sentiment comprises assigning a positive or negative value along a range, based on the words comprised in the content of the Website.

A system for parsing, retrieving and reporting content from at least one Website on a communication network, the system comprising:

• a database unit;
• a first client unit;
• a second client unit;
• and
• a server unit comprising a microprocessor executing steps for:
• receiving at least one keyword, via a graphical user interface (GUI) executed on the first client unit, to conduct an Internet search;
• launching a Web crawler to search a plurality of Websites for at least one Website having content that includes said at least one keyword;
• identifying Websites comprising at least one comment container, wherein said comment container includes at least one conversation;
• creating a unique xpath to said at least one comment container of each identified Website of said Websites, wherein the unique xpath comprises an extraction string dynamically generated to identify at least one of how to find comments, the date of a post on the Website, IP address, user name, and location;
• saving, in the database unit, the unique xpath for said at least one comment container of said each identified Website;
• detecting using the unique xpath at least one conversation that includes the at least one keyword from search of a content of said comment container of said each Website accessible only by said unique xpath;
• saving only a portion of the content of said comment container from said each Website having the at least one keyword, in the database unit, along with associated conversation information of said identified conversation;
• assigning a categorical topic for said each conversation;
• assigning a sentiment for said each conversation, said assigning the sentiment comprises assigning a positive or negative value along a range, based on the words comprised in the content of the Website;
• generating at least one report related to selected information for said each conversation, along with categorical topic and sentiment for said each conversation;
• and
• transmitting the at least one report to a second client unit;
• wherein the database unit stores said xpath, said conversation, said topic, said sentiment, and content information for said each Website,
• the first client unit receives at least one of said xpath, said screening and said sentiment information via a graphical user interface, and
• the second client unit provides said report via a display unit.