# US 10,503,364 B2 · Information processing apparatus and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,503,364 B2 - Document ID: US10503364B2 - Status: Granted - Kind: B2 - Application number: 15/779,221 - Filed: 2016-09-21 - Published: 2018-12-06 - Granted: 2019-12-10 - Earliest claimed: 2015-12-15 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Motoki Sasaki - Web page: https://patentgrep.com/patent/US10503364B2 ## CPC - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G08C 17/00: Arrangements for transmitting signals characterised by the use of a wireless electrical link - H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G08C 2201/30: User interface - G08C 2201/92: Universal remote control - H04L 2012/2849: {Audio/video appliances} - H04L 2012/285: {Generic home appliances, e.g. refrigerators} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Provided is a user interface easy to customize. An information processing apparatus is an information processing apparatus including a control unit. The control unit included in this information processing apparatus displays an operation screen on a display surface of a display unit in a case where an operation of editing a plurality of operation elements placed on the operation screen is performed to place each operation element on an edit screen. In addition, while displaying the operation screen on the display surface of the display unit, this control unit displays a part of an image indicating a placement location on the edit screen of each operation element on the display surface. ## Claims ### Claim 1 An information processing apparatus, comprising: a display unit configured to display a module selection screen; and a control unit configured to: control the display unit to display an operation screen on the module selection screen, wherein the operation screen includes a plurality of operation elements; control an edit operation on the plurality of operation elements of the operation screen; control the display unit to display a plurality of images on the module selection screen based on the edit operation on plurality of operation elements; and control the display unit to display an edit screen based on the edit operation on plurality of operation elements, wherein the edit screen includes the plurality of operation elements, a part of each of the plurality of images represents placement information of a corresponding operation element of the plurality of operation elements, and the placement information of the part of each of the plurality of images indicates a placement location of the corresponding operation element on the edit screen. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the control unit is further configured to: control the display unit to display the plurality of operation elements in a sequence, wherein the sequence is in a specific direction; and control the display unit to display the part of each of the plurality of images in a display region of the module selection screen, wherein the display region is adjacent to the operation screen in an orthogonal direction orthogonal to the specific direction. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the control unit is further configured to adjust a size of each image of the plurality of images based on a size of the corresponding operation element in the specific direction, the size of each image of the plurality of images is adjusted in the specific direction, and the size of each image of the plurality of images is one of same or substantially same as the size of the corresponding operation element. ### Claim 4 (depends on 2) The information processing apparatus according to claim 2, wherein the control unit is further configured to control the display unit to display a specific image of each of the plurality of images on the module selection screen, the specific image of each of the plurality of images indicates a degree of occupancy of the corresponding operation element on the edit screen, and the specific image of each of the plurality of images is displayed as a corresponding part of each of the plurality of images. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the control unit is further configured to: receive an input to select the plurality of operation elements on the operation screen; and control the display unit to display the part of each of the plurality of images in a sequence, wherein the sequence is based on an order of the selection of the plurality of operation elements. ### Claim 6 (depends on 5) The information processing apparatus according to claim 5, wherein the control unit is further configured to control the display unit to display a mark in a display region of the module selection screen, the mark represents a position where a first part of a first image of the plurality of images next to a second part of a second image of the plurality of images. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the control unit is further configured to: assign same identification information to the corresponding operation element and a corresponding part of each of the plurality of images. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, wherein the control unit is further configured to one of delete or replace at least one operation element of the plurality of operation elements on the edit screen based on one of a deletion operation or a replacement operation for the part of at least one of the plurality of images on the module selection screen. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein the control unit is further configured to: select at least one operation element from the plurality of operation elements on the operation screen based on a user operation; and control the display unit to display the at least one operation element on the edit screen. ### Claim 10 (depends on 1) The information processing apparatus according to claim 1, wherein the operation screen includes a plurality of sub-screens to operate an electronic instrument via wireless communication, and the control unit is further configured to control the display unit to display at least one sub-screen of the plurality of sub-screens on the module selection screen based on a user operation. ### Claim 11 (depends on 1) The information processing apparatus according to claim 1, wherein one of a size of the module selection screen is equal to or smaller than a threshold size, or a size of the information processing apparatus is a specific size. ### Claim 12 An information processing method, comprising: displaying an operation screen on a module selection screen, wherein the operation screen includes a plurality of operation elements; controlling an editing operation on the plurality of operation elements on the operation screen; displaying a plurality of images on the module selection screen based on the editing operation on the plurality of operation elements; and displaying an edit screen based on the editing operation on the plurality of operation elements, wherein the edit screen includes the plurality of operation elements, a part of each of the plurality of images represents placement information of a corresponding operation element of the plurality of operation elements, and the placement information of the part of each of the plurality of images indicates a placement location of the corresponding operation element on the edit screen. ### Claim 13 A non-transitory computer-readable medium having stored thereon computer-readable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising: controlling a display unit to display an operation screen on a module selection screen, wherein the operation screen includes a plurality of operation elements; controlling an editing operation on the plurality of operation elements on the operation screen; controlling the display unit to display a plurality of images on the module selection screen based on the editing operation on the plurality of operation elements; and controlling the display unit to display an edit screen based on the editing operation on the plurality of operation elements, wherein the edit screen includes the plurality of operation elements, a part of each of the plurality of images represents placement information of a corresponding operation element of the plurality of operation elements, and the placement information indicates a placement location of the corresponding operation element on the edit screen.