System and method for cognitive customer interaction
AssigneeInternational Business Machines Corporation
InventorSarbajit K. Rakshit
Life of this patent
Estimating the term…
Abstract
The present invention is a system and method for cognitive customer interaction. The system includes a humanoid robot having a processor operably connected to a camera and a speaker within the robot. The system has a social interactions database connected to the processor. The social interactions database stores interaction patterns representing speech, facial expressions, and body movement. An advanced analytics program, such as Watson Analytics, determines the identity of a customer in a store and performs social content analysis of the customer on social media platforms. The advanced analytics program generates a psycholinguistic profile of the user so gestures and speech of the customer is compared to the psycholinguistic profile and the humanoid robot may response appropriately.
Claims18
A method for implementing cognitive interaction to communicate between a humanoid robot and a user comprising:
- configuring the humanoid robot with a processor configured to perform advanced analytics using an analytics program, a camera connected to the processor, a social interaction database, and internal speakers and motors configured to mimic human expressions;
- capturing, by the camera of the humanoid robot, an image of the user;
- identifying, by the analytics program of the humanoid robot, the user, using facial recognition by searching one or more social networking sites for photographs or other instances of the user's face;
- extracting, by the analytics program of the humanoid robot, a social media data set including information indicative of the user's natural language based interactions with a plurality of associates of the user;
- determining, by the analytics program, an aggregated psycholinguistic profile of the user and the plurality of associates of the user;
- generating, by the analytics program, a first natural language text based in part upon the aggregated psycholinguistic profile;
- communicating, through the internal speakers, the first natural language text to the user;
- and
- continuously analyzing, by the camera of the humanoid robot, movements of the user, including body language and facial pattern, detecting changes in movement of the user and comparing the changes in movement of the user to movement data stored by the social interaction database wherein when a change in movement is matched to movements of the social interaction database, the humanoid robot implements a rule based reaction provided by the social interaction database.
A computer program product (CPP) for implementing cognitive interaction to communicate between a humanoid robot and a user comprising:
- a computer readable storage medium;
- and
- computer code stored on the computer readable storage medium, with the computer code including instructions and data for causing a processor set to perform at least the following operations:
- configuring the humanoid robot with the processor set to perform advanced analytics using an analytics program, a camera connected to the processor, a social interaction database, and internal speakers and motors configured to mimic human expressions;
- capturing, by the camera of the humanoid robot, an image of the user;
- identifying, by the analytics program of the humanoid robot, the user, using facial recognition by searching one or more social networking sites for photographs or other instances of the user's face;
- extracting, by the analytics program of the humanoid robot, a social media data set including information indicative of the user's natural language based interactions with a plurality of associates of the user,
- determining, by the analytics program, an aggregated psycholinguistic profile of the user and the plurality of associates of the user,
- generating, by the analytics program, a first natural language text based in part upon the aggregated psycholinguistic profile,
- communicating, through the internal speakers, the first natural language text to the user;
- and
- continuously analyzing, by the camera of the humanoid robot, movements of the user, including body language and facial pattern, detecting changes in movement of the user and comparing the changes in movement of the user to movement data stored by the social interaction database wherein when a change in movement is matched to movements of the social interaction database, the humanoid robot implements a rule based reaction provided by the social interaction database.
A computer system (CS) of a humanoid robot comprising:
- a processor set configured to perform advanced analytics using an analytics program;
- a camera connected to the processor set;
- internal speakers and motors connected to the processor set, configured to mimic human expressions;
- a computer readable storage medium;
- and
- computer code stored on the computer readable storage medium, with the computer code including instructions and data for causing the humanoid robot to perform at least the following operations:
- capturing, by the camera of the humanoid robot, an image of the user;
- identifying, by the analytics program of the humanoid robot, the user, using facial recognition by searching one or more social networking sites for photographs or other instances of the user's face;
- extracting, by the analytics program of the humanoid robot, a social media data set including information indicative of the user's natural language based interactions with a plurality of associates of the user,
- creating, by the analytics program, an aggregated psycholinguistic profile of user and the plurality of the associates of the user,
- generating, by the analytics program, a first natural language text based in part upon the aggregated psycholinguistic profile,
- communicating, through the internal speakers, the first natural language text to the user, and;
- continuously analyzing, by the camera of the humanoid robot, movements of the user, including body language and facial pattern, detecting changes in movement of the user and comparing the changes in movement of the user to movement data stored by a social interaction database of the humanoid robot, wherein when a change in movement is matched to movements of the social interaction database, the humanoid robot implements a rule based reaction provided by the social interaction database.
Dependencies are inferred from the claim text.