Memo processing device based on augmented reality, system, and method therefor
AssigneeChangwon National University Industry Academy Cooperation Corps
InventorsChang Soon Kang, Su Gyun Lee, Myo Jeong Kim
Life of this patent
Estimating the term…
Abstract
The disclosure relates to a memo processing device is configured to include a camera for filming videos, a memo acquisition unit for specifying a subject to which a memo is to be attached in the filmed video and storing the subject and the memo in a memory, and a memo presentation unit for displaying a memo stored in the memory as an overlay on a screen when the camera faces the subject. The memo processing device may be appropriately adopted by a portable terminal device such as a smartphone, or a mobile device of various kinds, such as Google Glass or a head-mounted display that is worn on the body, such as the head, as appropriate.
Claims11
A memo processing device based on augmented reality, comprising:
- a camera that films a video;
- a user interface that specifies a subject to which a memo is to be attached in the filmed video and stores the subject and the memo in a memory;
- and
- a controller displays the memo stored in the memory in an overlay form when the camera faces the subject, wherein
- the controller further:
- uses a keypoint matching algorithm,
- calculates a homography if a degree of matching between a keypoint in a camera frame and a keypoint in one of candidate memos is greater than or equal to a threshold value when the camera faces the subject, and
- then displays an image rendered of the memo as an overlay on a screen.
A memo processing method of, based on augmented reality, writing a memo by a mobile device, and copying and viewing the memo, the method comprising:
- attaching a memo to a designated subject filmed by the mobile device and storing in a storage;
- and
- displaying the memo stored in the storage as an overlay when the mobile device faces the subject, wherein
- a subject to which the memo is to be attached is specified using a keypoint extraction algorithm,
- the memo is displayed on a screen using a keypoint matching algorithm, and
- the displaying of the memo on the screen comprises:
- matching a keypoint in a camera frame with a keypoint in one of candidate memos when the camera of the mobile device faces the subject;
- determining if a degree of the matching is greater than or equal to a predetermined threshold;
- calculating, if the degree is greater than or equal to the predetermined threshold, a homography between the keypoint in the camera frame and the keypoint in one of the candidate memos;
- and
- displaying an image rendered of the memo as the overlay on the screen according to a result of the calculation.
Dependencies are inferred from the claim text.