# US 2014/0195953 A1 · Information processing apparatus, information processing method, and computer program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0195953 A1 - Document ID: US20140195953A1 - Status: Published application - Kind: A1 - Application number: 14/143,064 - Filed: 2013-12-30 - Published: 2014-07-10 - Earliest claimed: 2013-01-07 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Yusuke Sakai; Masayuki Yamada; Shinsuke Noguchi; Tadayoshi Murakami - Web page: https://patentgrep.com/patent/US20140195953A1 ## CPC - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/0485: Scrolling or panning - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer - G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An information processing apparatus includes: a screen which displays information; a coordinate input unit which inputs coordinates instructed by a user to the screen; and a control unit which determines a user instruction based on a track of a user input via the coordinate input unit and controls an operation of the screen in accordance with a determination result. ## Claims ### Claim 1 An information processing apparatus comprising: a screen which displays information; a coordinate input unit which inputs coordinates instructed by a user to the screen; and a control unit which determines a user instruction based on a track of a user input via the coordinate input unit and controls an operation of the screen in accordance with a determination result. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein the control unit determines which one of division of the screen, a size change of divided screens, or another screen operation the user has instructed, based on the track of the user input via the coordinate input unit. ### Claim 3 (depends on 2) The apparatus according to claim 2, wherein a screen size change instructing region is defined within a predetermined width wline around a boundary of the screen, and screen division instructing regions are defined within a predetermined distance Wsplit from both sides of the screen size change instructing region, and wherein the control unit performs screen size changing processing in accordance with the track when a start point of the track is inside the screen size change instructing region, performs screen dividing processing in accordance with the track when the start point of the track is inside the screen division instructing region, and scrolls the screen or performs another behavior when the start point of the track is located further inside the screen than the screen division instructing region. ### Claim 4 (depends on 2) The apparatus according to claim 2, wherein the control unit performs screen dividing processing in accordance with the track when the track starts near the boundary of the screen and the user input moves after stopping at a position of the start point for a period which is equal to or more than a predetermined time, performs screen size changing processing in accordance with the track when the track starts near the boundary of the screen and the user input moves without stopping, and scrolls the screen or performs another behavior when the track starts inside the screen. ### Claim 5 (depends on 2) The apparatus according to claim 2, wherein handles which are for performing an operation of moving the boundary are provided at both ends of the boundary of the screen, and wherein the control unit performs screen size changing processing in accordance with the track when the track starts from the handle, performs screen dividing processing in accordance with the track when the track starts at a part other than the handle on the boundary of the screen, and scrolls the screen or performs another behavior when the track starts inside the screen. ### Claim 6 (depends on 2) The apparatus according to claim 2, further comprising: a locking function which inhibits screen size changing processing, wherein the control unit performs screen dividing processing in accordance with the track when the track starts near the boundary of the screen in a locked state, performs screen size changing processing in accordance with the track when the track starts near the boundary of the screen in an unlocked state, and scrolls the screen or performs another behavior when the track starts from the inside of the screen. ### Claim 7 (depends on 6) The apparatus according to claim 6, further comprising: an indicator which displays whether or not a current state is the locked state. ### Claim 8 (depends on 2) The apparatus according to claim 2, wherein the control unit performs size changing processing on the respective divided screens by displacing a position of an intersection of a plurality of boundaries for dividing the screen in accordance with the track when the track starts from the intersection. ### Claim 9 (depends on 2) The apparatus according to claim 2, wherein when a size of a screen among a plurality of divided screens approaches a predetermined size during size changing processing of the plurality of screens, the control unit causes the size of the screen to be adsorbed to the predetermined size. ### Claim 10 (depends on 2) The apparatus according to claim 2, wherein when the screen is divided into two parts by a first boundary to obtain a first screen and a second screen, and the first screen and the second screen are respectively further divided by a second boundary and a third boundary, and the second boundary and the third boundary are superimposed on each other on a straight line, the control unit allows screen size changing processing for each of the two line segments obtained by dividing the first boundary by the straight line. ### Claim 11 (depends on 2) The apparatus according to claim 2, wherein an instructing unit which instructs states of the new screens in accordance with a direction of the track with respect to a dividing line of the screen is displayed on the dividing line, and wherein the control unit displays a home screen of an original screen in the new screen in a deviation direction and generates a clone of the original screen in the other new screen when the track deviates from the dividing line, and generates clones of the original screen in the new screens on both sides of the dividing line when the track is along the dividing line. ### Claim 12 (depends on 2) The apparatus according to claim 2, wherein the control unit causes a screen, size changing processing of which has been instructed such that the size of the screen becomes equal to or smaller than a predetermined minimum width wclose, to be closed. ### Claim 13 (depends on 2) The apparatus according to claim 2, wherein the control unit displays at least one of a dividing line of the screen during dividing processing, the boundary of the screen during size changing processing, and the screen during scroll processing in an emphasized manner. ### Claim 14 (depends on 2) The apparatus according to claim 2, wherein the control unit causes a menu relating to the divided screens to appear in an appearance direction in response to a user operation of swiping one of the divided screens with a first number of fingers in the appearance direction. ### Claim 15 (depends on 14) The apparatus according to claim 14, wherein the control unit hides the menu in a direction opposite to the appearance direction when no operation is performed on the menu for a period which is equal to or more than a predetermined time or in response to a user operation of swiping the screen in the opposite direction. ### Claim 16 (depends on 2) The apparatus according to claim 2, wherein the control unit saves states of a plurality of divided screens in response to a user operation of grabbing the screens, displays a list of the saved screen states on the screen, and restores a screen state selected by the user on the screen. ### Claim 17 (depends on 2) The apparatus according to claim 2, wherein the control unit changes an orientation of one of divided screens in a swiping direction in response to a user operation of swiping the screen with a second number of fingers. ### Claim 18 (depends on 1) The apparatus according to claim 1, wherein the control unit causes a home screen to appear from a side opposite to a screen swiping direction toward the swiping direction in response to a user operation of swiping the screen with a third number of fingers. ### Claim 19 An information processing method comprising: inputting coordinates instructed by a user to a screen; and determining a user instruction based on a track of a user input in the inputting of the coordinates and controlling an operation of the screen in accordance with a determination result. ### Claim 20 A computer program which is described in a computer readable format so as to cause a computer to function as: a coordinate input unit which inputs coordinates instructed by a user to the screen; and a control unit which determines a user instruction based on a track of a user input via the coordinate input unit and controls an operation of the screen in accordance with a determination result.