# US 2014/0192086 A1 · Camera-based device and method of augmenting data displayed on a display device using the camera-based device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192086 A1 - Document ID: US20140192086A1 - Status: Published application - Kind: A1 - Application number: 14/149,063 - Filed: 2014-01-07 - Published: 2014-07-10 - Earliest claimed: 2013-01-07 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Muthukumar SUBRAMANIAN; Annapoorani KANAGARAJ - Web page: https://patentgrep.com/patent/US20140192086A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/005: {Input arrangements through a video camera} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06V 20/20: in augmented reality scenes - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method of augmenting data that is displayed on a display device by using a camera-based device, and the camera-based device are provided. The method includes configuring a network setting of the camera-based device to enable communication between the camera-based device and the display device; performing calibration to capture an initial boundary in the display device; capturing data that is displayed on the display device; associating the captured data with additional data; and displaying the additional data on the display device. The camera-based device includes a communication interface; and a processor that configures a network setting to enable communication between the camera-based device and the display device, perform calibration in order to capture an initial boundary in the display device; capture data that is displayed on the display device, associate the captured data with additional data; and display the additional data on the display device. ## Claims ### Claim 1 A method of using a camera device to augment data that is displayed on a display device, the method comprising: configuring a network setting of the camera-based device to enable communication between the camera-based device and the display device; performing calibration to capture an initial boundary in the display device; capturing data that is displayed on the display device; associating the captured data with additional data; and displaying the additional data on the display device. ### Claim 2 (depends on 1) The method of claim 1, further comprising calculating a gesture boundary that corresponds to a gesture associated with the camera-based device, according to the initial boundary. ### Claim 3 (depends on 2) The method of claim 2, further comprising determining the gesture associated with the camera-based device, based on a position of the gesture boundary. ### Claim 4 (depends on 1) The method of claim 1, further comprising locating at least one of the displayed data and the additional data on the display device, based on a gesture associated with the camera-based device. ### Claim 5 (depends on 1) The method of claim 1, wherein the displaying of the additional data is performed by transmitting a display command to the display device or projecting the additional data to the display device. ### Claim 6 A camera-based device for augmenting data that is displayed on a display device, the camera-based device comprising: a communication interface configured to establish communication between the camera-based device and the display device; a memory for storing instructions; and a processor that accesses the stored instructions, wherein the processor, in response to the accessing the stored instructions, is configured to establish a network setting to enable communication between the camera-based device and the display device; perform calibration in order to capture an initial boundary in the display device; capture data that is displayed on the display device; associate the captured data with additional data, and display the additional data on the display device. ### Claim 7 (depends on 6) The camera-based device of claim 6, wherein the processor is configured to calculate a gesture boundary that corresponds to a gesture associated with the camera-based device, according to the initial boundary, in response to accessing the stored instructions. ### Claim 8 (depends on 7) The camera-based device of claim 7, wherein the processor is configured to determine the gesture associated with the camera-based device, based on a position of the gesture boundary, in response to accessing the stored instructions. ### Claim 9 (depends on 6) The camera-based device of claim 6, wherein the processor is configured to locate at least one of the displayed data and the additional data on the display device, based on a gesture associated with the camera-based device in response to accessing the stored instructions. ### Claim 10 (depends on 6) The camera-based device of claim 6, wherein the displaying of the additional data is performed by transmitting a display command to the display device or projecting the additional data to the display device. ### Claim 11 A non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor of a computer, causes the computer to use a camera-based device to perform a method of augmenting data that is displayed on a display device, the method comprising: configuring a network setting of the camera-based device to enable communication between the camera-based device and the display device; performing calibration to capture an initial boundary in the display device; capturing data that is displayed on the display device; associating the captured data with additional data; and displaying the additional data on the display device. ### Claim 12 A camera-based device for augmenting data that is displayed on a display device, the camera-based device comprising: a communication interface configured to establish communication between the camera-based device and the display device; and a processor configured to access stored instructions and establish a network setting to enable communication between the camera-based device and the display device, wherein the processor is configured to perform calibration in order to capture an initial boundary in the display device; capture data that is displayed on the display device and associate the captured data with additional data, and wherein the processor is configured to calculate a gesture boundary that corresponds to a gesture associated with the camera-based device, according to the initial boundary, in response to accessing the stored instructions. ### Claim 13 (depends on 12) The camera-based device of claim 12, further comprising a memory for storing the instructions. ### Claim 14 (depends on 12) The camera-based device of claim 12, wherein the processor is configured to display the additional data on the display device. ### Claim 15 (depends on 12) The camera-based device of claim 12, wherein the processor is configured to determine the gesture associated with the camera-based device, based on a position of the gesture boundary in response to accessing the stored instructions.