# US 2019/0320139 A1 · Recording medium on which user assistance program is recorded, information processing device, and user assistance method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0320139 A1 - Document ID: US20190320139A1 - Status: Published application - Kind: A1 - Application number: 16/293,482 - Filed: 2019-03-05 - Published: 2019-10-17 - Earliest claimed: 2018-04-12 - Assignees: Fujitsu Limited - Applicants: Fujitsu Limited - Inventors: Yuushi TOYODA; Koichiro NIINUMA; Ryosuke KAWAMURA - Web page: https://patentgrep.com/patent/US20190320139A1 ## CPC - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 7/15: Conference systems - G06F 9/453: {Help systems} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A recording medium on which a user assistance program is recorded which makes a computer perform: based on image information obtained by photographing a plurality of users who use a given service, calculating state quantities of the plurality of respective users corresponding to the image information; counting, for each time period, a number of users whose amounts of change in the calculated respective state quantities are equal to or more than a given threshold value among the plurality of users; and detecting a time period in which the counted number of users satisfies a given condition. ## Claims ### Claim 1 A non-transitory computer-readable recording medium on which a user assistance program is recorded, the user assistance program making a computer perform: based on image information obtained by photographing a plurality of users who use a given service, calculating state quantities of the plurality of respective users corresponding to the image information; counting, for each time period, a number of users whose amounts of change in the calculated respective state quantities are equal to or more than a given threshold value among the plurality of users; and detecting a time period in which the counted number of users satisfies a given condition. ### Claim 2 (depends on 1) The non-transitory computer-readable recording medium according to claim 1, wherein when the state quantity of a user as a target of assistance is decided not to be equal to or more than a given state quantity threshold value in the time period in which the given condition is satisfied, a message is notified to the user as the target of assistance. ### Claim 3 (depends on 1) The non-transitory computer-readable recording medium according to claim 1, wherein when the state quantity of one of the plurality of users in the time period in which the given condition is satisfied is decided not to be equal to or more than a given state quantity threshold value, a message is notified to the decided user. ### Claim 4 (depends on 1) The non-transitory computer-readable recording medium according to claim 1, wherein input of a weighting factor is received for at least one of the plurality of users, and the number of users whose amounts of change in the calculated state quantities are equal to or more than the given threshold value is counted by performing weighted addition using the weighting factor. ### Claim 5 (depends on 1) The non-transitory computer-readable recording medium according to claim 1, wherein the amounts of change in the state quantities are calculated by temporal differentiation of the calculated state quantities of the respective plurality of users. ### Claim 6 An information processing device comprising: a memory; and a processor coupled to the memory and configured to: calculate, based on image information obtained by photographing a plurality of users who use a given service, state quantities of the plurality of respective users corresponding to the image information; count, for each time period, a number of users whose amounts of change in the calculated respective state quantities are equal to or more than a given threshold value among the plurality of users; and detect a time period in which the counted number of users satisfies a given condition. ### Claim 7 (depends on 6) The information processing device according to claim 6, wherein when the state quantity of a user as a target of assistance is decided not to be equal to or more than a given state quantity threshold value in the time period in which the given condition is satisfied, a message is notified to the user as the target of assistance. ### Claim 8 (depends on 6) The information processing device according to claim 6, wherein when the state quantity of one of the plurality of users in the time period in which the given condition is satisfied is decided not to be equal to or more than a given state quantity threshold value, a message is notified to the decided user. ### Claim 9 (depends on 6) The information processing device according to claim 6, wherein input of a weighting factor is received for at least one of the plurality of users, and the number of users whose amounts of change in the calculated state quantities are equal to or more than the given threshold value is counted by performing weighted addition using the weighting factor. ### Claim 10 (depends on 6) The information processing device according to claim 6, wherein the amounts of change in the state quantities are calculated by temporal differentiation of the calculated state quantities of the respective plurality of users. ### Claim 11 A user assistance method comprising: calculating, by a computer, based on image information obtained by photographing a plurality of users who use a given service, state quantities of the plurality of respective users corresponding to the image information; counting, for each time period, a number of users whose amounts of change in the calculated respective state quantities are equal to or more than a given threshold value among the plurality of users; and detecting a time period in which the counted number of users satisfies a given condition. ### Claim 12 (depends on 11) The user assistance method according to claim 11, wherein when the state quantity of a user as a target of assistance is decided not to be equal to or more than a given state quantity threshold value in the time period in which the given condition is satisfied, a message is notified to the user as the target of assistance. ### Claim 13 (depends on 11) The user assistance method according to claim 11, wherein when the state quantity of one of the plurality of users in the time period in which the given condition is satisfied is decided not to be equal to or more than a given state quantity threshold value, a message is notified to the decided user. ### Claim 14 (depends on 11) The user assistance method according to claim 11, wherein input of a weighting factor is received for at least one of the plurality of users, and the number of users whose amounts of change in the calculated state quantities are equal to or more than the given threshold value is counted by performing weighted addition using the weighting factor. ### Claim 15 (depends on 11) The user assistance method according to claim 11, wherein the amounts of change in the state quantities are calculated by temporal differentiation of the calculated state quantities of the respective plurality of users.