CareAR Assist - Version: 23.01

Release 23.01 of CareAR Assist delivers the following new features and capabilities:

• Pause and Annotate on Video Feed from CareAR Browser App

Pause and Annotate for CareAR Assist for Browser

1.1    Overview

With our current implementation of Assist, a host can pause the live video stream and annotate on that paused frame when the streaming participant is using the native mobile/desktop app, the smart glasses app, or the drone app. When the streaming participant is using the Assist for mobile browser app, the “pause and annotate” function is not available.

This feature extends the pause and annotate capability for the scenario where the streaming participant is using Assist for mobile browser. The functionality supported with streaming participants using the CareAR Assist for Smart Glasses will be extended to the browser app.

1.1.1   Host Experience

The host of an Assist session, using release 23.01 of the CareAR Assist app, shall now be able to pause the live video stream and annotate on that paused frame when the streaming participant is using the Assist for mobile browser app.

When the video feed from the browser app is paused, all the annotation tools and recording tools (snapshot and video) shall be available to the host.

1.1.2   Streaming Guest Behavior

When the host pauses the video feed, the streaming party using the Assist for mobile browser app will see the paused video frame and observe the annotations as they are made on that video feed.

Note that the streaming browser app user may not make any annotations on their experience.

If there are other guests in the session (who are not streaming and not on a browser app), the host may take action to approve them to collaborate via the pass the ball feature. Once approved, they will be permitted to annotate on the paused frame coming from the browser app.

As with the scenario where the streaming guest can use the native app to stream in either portrait or landscape mode, so shall the streaming guest be able to stream from the browser in either portrait or landscape made and the shared, composited content that is streamed into the session is adapted.

1.1.3   Non-Streaming Guest Behavior

Our existing behavior allows for any number of participants to exist in an Assist session. Also, when a guest is part of a session and a different guest (who has joined using the browser app) is streaming into the session, then the non-streaming guest shall be able to view all the visual activity happening in the Assist session.

Today, when the non-streaming guest has joined via a native app, they may be given permission by the host to collaborate (the host taps the pen icon next to the non-streaming guest). However, with today’s behavior, the non-streaming guest may not pause and annotate on the stream coming from a browser app-based guest.

This new feature allows the non-streaming guest to use the native Assist app to be able to pause and annotate, per the passing the ball functionality. Meaning, once another (non-streaming, native app user) participant has permission from the host to annotate, they will be able to annotate on the paused video frame.

1.1.4    Reference Table of Annotation Tools Enabled with Release 23.01

1.2    Benefits

These enhancements expand the capabilities of the CareAR Assist solution and add to the overall options that are available for remote solve.

1.3    Configuration

No configuration is required to enable this enhancement.

1.4    Backwards Compatibility

To make use of this feature, the host needs to be using a release 23.01 version of the CareAR Assist app. Older versions of the CareAR Assist app will not support pause and annotate on video feed from browser app.