# US 2021/0330528 A1 · Assistance system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0330528 A1 - Document ID: US20210330528A1 - Status: Published application - Kind: A1 - Application number: 17/264,587 - Filed: 2018-08-01 - Published: 2021-10-28 - Earliest claimed: 2018-08-01 - Assignees: Fuji Corporation - Applicants: Fuji Corporation - Inventors: Joji ISOZUMI; Satoshi SHIMIZU - Web page: https://patentgrep.com/patent/US20210330528A1 ## CPC - A61G 7/10: Devices for lifting patients or disabled persons, e.g. special adaptations of hoists thereto - A61B 5/4803: {Speech analysis specially adapted for diagnostic purposes} - A61B 5/7405: {using sound} - B25J 11/009: {Nursing, e.g. carrying sick persons, pushing wheelchairs, distributing drugs} - G16H 10/60: for patient-specific data, e.g. for electronic patient records - G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring - A61B 5/70: {Means for positioning the patient in relation to the detecting, measuring or recording means} - A61B 5/7207: {of noise induced by motion artifacts} - A61B 5/749: {Voice-controlled interfaces} - A61G 2203/18: by patient's head, eyes, facial muscles or voice - B25J 11/0005: {Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means} - A61G: TRANSPORT, PERSONAL CONVEYANCES OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS (appliances for aiding patients or disabled persons to walk A61H3/00); OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES (embalming corpses A01N1/00) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50}) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract An assistance system includes an assistance device configured to assist movement of a care receiver; a microphone provided on the assistance device; a speech analyzer configured to analyze speech of at least one of a caregiver or the care receiver included in sound data acquired by the microphone and acquire information related to an action; an echo analyzer configured to analyze an echo included the sound data and acquire information related to a location; and an action history information generator configured to generate action history information of at least one of the caregiver or the care receiver based on the information related to the action and the information related to the location. ## Claims ### Claim 1 An assistance system comprising: an assistance device configured to assist movement of a care receiver; a microphone provided on the assistance device; a speech analyzer configured to analyze speech of at least one of a caregiver or the care receiver included in sound data acquired by the microphone and acquire information related to an action; an echo analyzer configured to analyze an echo included the sound data and acquire information related to a location; and an action history information generator configured to generate action history information of at least one of the caregiver or the care receiver based on the information related to the action and the information related to the location. ### Claim 2 (depends on 1) The assistance system according to claim 1, wherein the speech analyzer is configured to acquire the information related to the action by, based on a result of speech recognition processing on the sound data, identifying at least one of the care receiver and the caregiver and identifying an assistance operation for the care receiver. ### Claim 3 (depends on 2) The assistance system according to claim 2, wherein the speech analyzer is configured to, by detecting a specified keyword included in the result of the speech recognition processing, identify at least one of the care receiver and the caregiver and identify the assistance operation. ### Claim 4 (depends on 3) The assistance system according to claim 3, wherein the speech analyzer is configured to detect the keyword included in the result of the speech recognition processing based on detection word information registered as the keyword in at least one of a name of the care receiver, a name of the caregiver, a name of an item related to the assistance operation, and a name or verb of an operation performed by the care receiver during the assistance operation. ### Claim 5 (depends on 3) The assistance system according to claim 3, wherein the speech analyzer is configured to, in a case in which a restriction word included in restriction word information that is registered in advance is detected from the result of the speech recognition processing, restrict identifying of the assistance operation or restrict identifying of at least one of the care receiver and the caregiver for a series of conversations including the restriction word based on a detection result of the keyword. ### Claim 6 (depends on 1) The assistance system according to claim 1, wherein the speech analyzer is configured to acquire the information related to the action by identifying at least one of the care receiver and the caregiver based on a voiceprint extracted from the sound data and voiceprint information representing a voiceprint of the caregiver or a voiceprint of the care receiver. ### Claim 7 (depends on 1) The assistance system according to claim 1, wherein the echo analyzer is configured to acquire the information related to the location by identifying a room where the microphone recorded the speech based on a reverberation time or a frequency of a specified repeated sound in the sound data. ### Claim 8 (depends on 1) The assistance system according to claim 1, wherein the assistance device, in addition to assisting various operations including a standing operation and a sitting operation of the care receiver, records an operation history in log data, and the care system is further provided with a log data analyzer configured to acquire the information related to the action by identifying the assistance operation of the care receiver based on the log data. ### Claim 9 (depends on 8) The assistance system according to claim 8, wherein the log data analyzer is configured to detect a transfer operation performed in order of the standing operation and the sitting operation so as to transfer the care receiver or a movement between different rooms in the log data, and to identify the assistance operation based on a result of the detection of the transfer operation. ### Claim 10 (depends on 1) The assistance system according to claim 1, further including a fixed microphone provided in a room or a corridor in the care facility in which the assistance operation is performed, wherein the speech analyzer and the echo analyzer are configured to analyze sound data acquired by the fixed microphone. ### Claim 11 (depends on 1) The assistance system according to claim 1, further including a report generator configured to generate an assistance report including contents of assistance operations received by the care receiver based on the action history information generated by the action history information generator. ### Claim 12 (depends on 11) The assistance system according to claim 11, wherein the report generator is configured to generate the assistance report for each of multiple of the care receivers, and the assistance system further includes a report sending section configured to send the assistance report related to the care receiver to a terminal device possessed by a person concerned with the care receiver.