Method and system for providing user notification when personal information is used in voice control device

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• and
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information,
• wherein the personal information of the user is managed based on a grade or score according to at least one of a group for each user, a policy for each service and personal information handling regulations suggested in a corresponding country, and
• determining the suitability comprises determining the suitability of the reference to the personal information based on a grade or score calculated for the reference to the personal information and a grade or score for the personal information of the user.

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• and
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information,
• wherein generating and providing the guide information comprises generating the guide information based on query words defined by the voice service or a personal information usage policy of the voice service, and
• the guide information comprises related service provisions for responding to the user's additional query about the guide information.

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• and
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information,
• wherein a server providing the voice service is configured to:
• recognize the user based on speech information corresponding to the user's query,
• issue a permission key capable of accessing the personal information of the recognized user,
• check user consent and a service policy based on the permission key when a command selected based on the speech information accesses the personal information of the user,
• issue an access token having a grade based on the user consent and the service policy,
• generate a response related to the personal information of the user by confirming the grade of the access token when a service using the access token is invoked.

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information;
• outputting, by the at least one processor, a speech for requesting consent for usage and exposure of the personal information;
• receiving, by the at least one processor, a response to the output speech;
• and
• determining, by the at least one processor, whether consent for the usage and exposure of the personal information has been given based on contents of the received response.

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information;
• and
• providing, by the at least one processor, the user with information on an issue from a personal information generation viewpoint, which is capable of occurring, in advance or at timing when a third party service is provided by an external service provider, when the at least one processor operates in conjunction with the third party service.

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information;
• monitoring, by the at least one processor, a number of times that a response including the personal information is output to the user and sensitivity of the personal information including the output response;
• and
• analyzing, by the at least one processor, the monitored number and sensitivity.

A method of providing user notification in a computer device including at least one processor, the method comprising:

• receiving, by the at least one processor, information monitored for reference to personal information in a process of processing a user's query in a voice service;
• storing, by the at least one processor, a personal information utilization history for each user and for each service based on the monitored information;
• determining, by the at least one processor, suitability of the reference to the personal information based on the monitored information;
• determining, by the at least one processor, whether the personal information is included in a response when generating the response to the user's query;
• generating and providing, by the at least one processor, guide information indicating that the personal information is included in the response if the personal information is included in the response;
• providing, by the at least one processor, the response to the user's query based on feedback from the user for the guide information;
• and
• calculating, by the at least one processor, a number of times that the personal information is exposed through an application and sensitivity of the exposed personal information through matching between permission information of the application installed in a device of the user and a PII provided by a standard organization.

A computer device, comprising:

• at least one processor configured to execute a computer-readable command,
• wherein the at least one processor is configured to:
• receive information monitored for reference to personal information in a process of processing a user's query in a voice service;
• store a personal information utilization history for each user and for each service based on the monitored information;
• determine suitability of the reference to the personal information based on the monitored information;
• determine whether the personal information is included in a response when generating the response to the user's query;
• generate and provide guide information indicating that the personal information is included in the response;
• and
• provide the response to the user's query based on feedback from the user for the guide information,
• wherein the at least one processor is configured to determine whether a service policy has been violated in relation to access to the personal information of the user identified based on the monitored information.

A computer device, comprising:

• at least one processor configured to execute a computer-readable command,
• wherein the at least one processor is configured to:
• receive information monitored for reference to personal information in a process of processing a user's query in a voice service;
• store a personal information utilization history for each user and for each service based on the monitored information;
• determine suitability of the reference to the personal information based on the monitored information;
• determine whether the personal information is included in a response when generating the response to the user's query;
• generate and provide guide information indicating that the personal information is included in the response;
• and
• provide the response to the user's query based on feedback from the user for the guide information,
• wherein the personal information of the user is managed based on a grade or score according to at least one of a group for each user, a policy for each service and personal information handling regulations suggested in a corresponding country, and
• the at least one processor is configured to determine the suitability of the reference to the personal information based on a grade or score calculated for the reference to the personal information and a grade or score for the personal information of the user.