CareAR Instruct is an app used to provide step-by-step instructions for users to self-serve through visual guidance. Instruct content can include Augmented Reality, i3D, and 2D content consisting of text, images, and video. CareAR Instruct content is produced with the help of CareAR professional services team.
Overview of Release 23.01
Release 23.01 of CareAR Instruct app delivers the following:
- Language Localization
- App localization
- Experience localization
- Video subtitles
- Experience Builder support
- Advanced Content
- Experience Builder content
- Intelligent Search configuration
- Intelligent Search UI updates
- Flashlight (iOS only)
- Web API Support
- Object & State Detection inference update
The CareAR Instruct app has gone through several updates to better support users who speak a variety of languages. This includes language localization support of the app, experiences (Instruct content), and subtitle support for videos.
The CareAR Instruct app has been updated to support 11 languages including:
- Brazilian Portuguese
- Simplified Chinese
When a user opens the Instruct app, it will detect which language the user’s mobile device is configured to use. It will then provide the best match to that language. The app buttons and menu items will be presented to the user in the supported language.
Experience localization support
Content creators can now make their content available in a variety of languages for their end users. The Instruct app now supports content created in eleven languages (see list above). Experiences can also be created in multiple languages allowing users to view the Instruct Experience in their preferred language.
When a user first opens an experience, the Instruct app will check to see if there is a matching translation in the user’s language. If a match is found, it will open the experience with the matching language. If there is not a match, the experience will open in the default translation as defined in the Experience Builder.
To reuse video content for users that speak a variety of languages, the CareAR Instruct app now supports video subtitles. When content is created, video subtitles can be made available to users allowing them to select subtitles for the video and choose their preferred language. Users can turn subtitles on and select the preferred language for the subtitles presented on screen.
Experience Builder support
The Instruct app now works fully integrated into the CareAR Experience Builder.
Publishing Instruct Experiences
All CareAR Instruct Experiences, the content accessed inside Instruct, are now published through the Experience Builder in the CareAR web portal. Admins and Content Creators can log into the web portal and access the Experience Builder to create, manage, and publish content. This includes both content created in the Experience Builder and content that uses advanced feature functionality known as Advanced Content.
Experience Builder content
Experiences that were created in the Experience Builder can now be opened in the Instruct app. Content entirely authored within the Experience Builder is browser compatible and can be opened in the mobile device’s web browser or in the Instruct app. When publishing an experience, the Admin or Content Creator can choose the desired behavior for opening the experience. This includes opening in browser, opening in the Instruct app, or giving the user the option to choose. If a user opens an experience using the inbuilt QR code scanner in the Instruct app, the experience will open in the app regardless of the experience settings.
Experiences that use advanced features of the Instruct app are called Advanced Content. While advanced content cannot be authored in the Experience Builder, it is still published through the Experience Builder. Advanced Content is created through CareAR professional services and can include features such as 3D animations, 3D object outlines, AR overlay, object and state detection. When an experience is published that contains advanced content, it can only be opened in the Instruct app. Users scanning the QR code will be directed to install the Instruct app if it isn’t installed.
Intelligent Search configuration
The setup and configuration of Intelligent Search for Instruct app is now configured in the Experience Builder. This Intelligent Search configuration now works for both experiences authored in the Experience Builder and for Advanced Content.
Intelligent Search Behavior Update
The Intelligent Search landing page now does not automatically perform a search until the user enters a search query. This reduces confusion for the user by only showing them search results based on their search query.
In QR code scanning and AR overlay modes that use the camera, the user can now enable the mobile phone flashlight. This should improve the camera performance when using the Instruct app in low light situations.
NOTE: Flashlight is only supported on iOS
Web API Support
The Instruct app now supports the CareAR web API. Using the web API, you can launch the Instruct app with a specified experience. Optional parameters can be used to provide a BACK button enabling users to return from the Instruct app to the originating app or web page. NOTE: The HTTP POST portion of the web API is not currently supported.
Object & State Detection inference update
The Object & State Detection inference code has been updated for better accuracy and performance. For experiences that use the AI powered object and state detection, the detection accuracy will be improved.