US 2023/0141680 A1 · MULTI-USER COLLABORATIVE INTERFACES FOR STREAMING VIDEO

Abstract

The present disclosure provides systems and methods of providing multi-user collaborative interfaces. A computing system may receive a video stream. The video stream may have an overlay interface defined along a first plane. The computing system may identify, in at least one frame, a region defined on a second plane on which a user's hand is oriented. The computing system may determine that a set of features associated with the user's hand within the region corresponds to a draw command. The computing system may identify, from the region, a first coordinate for the draw command based on at least one of the set of features. The computing system may translate the first coordinate to a second coordinate defined on the first plane to which to apply the draw command. The computing system may render a visual element at the second coordinate in the overlay interface.

Claims20

Dependent claims

A method of providing multi-user collaborative interfaces, comprising:

receiving, by a computing system via a camera, a video stream having a plurality of frames of a user's hand, the video stream having an overlay interface defined along a first plane;
identifying, by the computing system, in at least one of the plurality of frames, a region defined on a second plane on which the user's hand is oriented;
determining, by the computing system, that a set of features associated with the user's hand within the region defined on the second plane corresponds to a draw mode;
identifying, by the computing system, from the region defined on the second plane, a first coordinate for the draw mode based on at least one of the set of features;
translating, by the computing system, the first coordinate defined on the second plane to a second coordinate defined on the first plane of the overlay interface to which to apply the draw mode;
and
rendering, by the computing system, a visual element at the second coordinate in the overlay interface of the video stream.

4 more elements

A system for providing multi-user collaborative interfaces, comprising:

a computing system having one or more processors coupled with memory, configured to:
receive, via a camera, a video stream having a plurality of frames of a user's hand, the video stream having an overlay interface defined along a first plane;
identify, in at least one of the plurality of frames, a region defined on a second plane on which the user's hand is oriented;
determine that a set of features associated with the user's hand within the region defined on the second plane indicates a draw mode;
identify, from the region defined on the second plane, a first coordinate for the draw mode based on at least one of the set of features;
translate the first coordinate defined on the second plane to a second coordinate defined on the first plane of the overlay interface to which to apply the draw mode;
and
render a visual element at the second coordinate in the overlay interface of the video stream.

5 more elements

Dependencies are inferred from the claim text.

Multi-user collaborative interfaces for streaming video

Life of this patent

Multi-user collaborative interfaces for streaming video

Life of this patent

Abstract

Claims20