# US 10,771,739 B2 · Information processing device and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,771,739 B2 - Document ID: US10771739B2 - Status: Granted - Kind: B2 - Application number: 16/381,593 - Filed: 2019-04-11 - Published: 2019-08-01 - Granted: 2020-09-08 - Earliest claimed: 2015-09-30 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Shunichi Kasahara; Junichi Rekimoto; Jun Kimura; Taizo Shirai - Web page: https://patentgrep.com/patent/US10771739B2 ## CPC - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor - H04L 65/1069: Session establishment or de-establishment - H04L 65/1089: by adding media; by removing media - H04L 67/306: User profiles - H04L 67/52: specially adapted for the location of the user terminal - H04M 1/00: Substation equipment, e.g. for use by subscribers (subscriber services or facilities provided at exchanges H04M3/00; prepayment telephone coin boxes H04M17/00; current supply arrangements H04M19/08) - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract To perform matching between a user who provides a first person view and a user who views the first person view. An icon indicating a current position of each Body is displayed on a map of a range that is currently specified. A Ghost can select a Body to whom the Ghost desires to perform JackIn by specifying an icon in a desired position by UI operation such as a touch or click. Further, when a keyword for limiting behavior or the like is input to a search field, only Bodies extracted on the basis of the behavior are displayed. Then, when selection is settled, a JackIn request is transmitted from the Ghost to the selected Body. ## Claims ### Claim 1 An information processing device comprising: at least one processor configured to: transmit, based on a start condition set by at least one mobile device, acceptance information to at least one display device via a server, wherein the acceptance information allows the at least one display device to acquire an image that is captured by an imaging unit of the at least one mobile device; receive, from the at least one display device which has received the acceptance information, application for connection to the at least one mobile device, control, based on the received application, the at least one mobile device to start distribution of the image to the display device, and allow, based on permission level settings, one or more actions performed at the display device to control movement of a body part of a user at the information processing device through a drive unit at the information processing device. ### Claim 2 (depends on 1) The information processing device according to claim 1, wherein the at least one display device includes a plurality of display devices, and, wherein the at least one processor is configured to control the at least one mobile device to start distribution of the image to each of the plurality of display devices only in a case where the number of the plurality of display devices satisfies the set start condition. ### Claim 3 (depends on 1) The information processing device according to claim 1, wherein the at least one mobile device is a wearable device, and wherein the acceptance information further allows the at least one display device to control a speaker of the wearable device to output audio based on an audio input from the display device. ### Claim 4 (depends on 3) The information processing device according to claim 3, wherein the wearable device is a head-mounted display, wherein the image is a real-time first-person-view image captured by the imaging unit of the head-mounted display, and wherein the at least one processor is configured to control, based on the received application, the at least one mobile device to start distribution of the real-time first-person-view image to the display device. ### Claim 5 An information processing method comprising: transmitting, based on a start condition set by at least one mobile device, acceptance information to at least one display device via a server, wherein the acceptance information allows the at least one display device to acquire an image that is captured by an imaging unit of the at least one mobile device; receiving, from the at least one display device which has received the acceptance information, application for connection to the at least one mobile device, controlling, based on the received application, the at least one mobile device to start distribution of the image to the display device, and allowing, based on permission level settings, one or more actions performed at the display device to effect movement of a body part of a user at the information processing device using a drive unit at the processing device. ### Claim 6 At least one non-transitory computer-readable medium encoded with instructions which, when executed by at least one processor of a mobile device, cause the mobile device to: transmit, based on a start condition set by the mobile device, acceptance information to at least one display device via a server, wherein the acceptance information allows the at least one display device to acquire an image that is captured by an imaging unit of the mobile device; receive, from the at least one display device which has received the acceptance information, application for connection to the mobile device, control, based on the received application, the mobile device to start distribution of the image to the display device, and allow, based on permission level settings, one or more actions performed at the display device to effect movement of a body part of a user at the information processing device using a drive unit at the processing device. ### Claim 7 (depends on 1) The information processing device according to claim 1, further comprising the at least one processor being configured to receive a position information of a given mobile device. ### Claim 8 (depends on 7) The information processing device according to claim 7, wherein the position information comprises Global Positioning System (GPS) signals. ### Claim 9 (depends on 7) The information processing device according to claim 7, further comprising the at least one processor being configured to transmit the position information to the display device. ### Claim 10 (depends on 1) The information processing device according to claim 1, wherein the drive unit includes an actuator for applying tactile sensations or electrical simulations to the body part of the user. ### Claim 11 (depends on 1) The information processing device according to claim 1, wherein the drive unit comprises a device that drives a powered unit or exoskeleton on the body part of the user. ### Claim 12 (depends on 1) The information processing device according to claim 1, wherein the one or more actions are allowed based on a mission, the mission comprising a range of user activities permitted by the information processing device. ### Claim 13 (depends on 5) The information processing device according to claim 5, further comprising detecting position information of a given mobile device of the at least one mobile device. ### Claim 14 (depends on 13) The information processing device according to claim 13, further comprising transmitting the position information to the display device. ### Claim 15 (depends on 13) The information processing device according to claim 13, further comprising using the position information to select the given mobile device of the at least one mobile device for communicating with the display device.