EP 4211539 A1 20230719 - CONTROLLING A 2D SCREEN INTERFACE APPLICATION IN A MIXED REALITY APPLICATION
Title (en)
CONTROLLING A 2D SCREEN INTERFACE APPLICATION IN A MIXED REALITY APPLICATION
Title (de)
STEUERUNG EINER 2D-BILDSCHIRMSCHNITTSTELLENANWENDUNG IN EINER ANWENDUNG DER GEMISCHTEN REALITÄT
Title (fr)
COMMANDE D'UNE APPLICATION D'INTERFACE D'ÉCRAN 2D EN APPLICATION DE RÉALITÉ MIXTE
Publication
Application
Priority
- US 202063075749 P 20200908
- EP 20207457 A 20201113
- EP 2021074087 W 20210901
Abstract (en)
[origin: EP3964929A1] The present invention relates to controlling a 2D application in a mixed reality application. In order to provide further simplification in terms of operating devices and equipment for the medical personnel, a device (10) for controlling a 2D application in a mixed reality application is provided. The device comprises a 2D application interface (12), a processor (14), a mixed reality application interface (16) and a control interface (18). The 2D application interface receives data representative of a 2D application. The application comprises interactive elements providing commands for user control of the 2D application. The processor identifies and extracts the interactive elements based on the data representative of the 2D application. The processor also translates the interactive elements to user interface features of a mixed reality display application. The processor further generates data for presenting the mixed reality display application and maps user input to commands for user control of the 2D application. The mixed reality application interface provides the mixed reality display application to a user as mixed reality. The control interface receives input from the user for the user interface features and provides the commands to the 2D application in order to control the 2D application. Hence, augmented reality interfaces are mapped to traditional 2D screen interfaces. This allows to integrate applications that only provided the interaction on a monitor with a mouse or the like to be operated in today's augmented reality environment.
IPC 8 full level
G06F 3/01 (2006.01); A61B 34/00 (2016.01); A61B 34/10 (2016.01); A61B 90/00 (2016.01); G02B 27/00 (2006.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01)
CPC (source: EP US)
A61B 34/25 (2016.02 - EP); A61B 90/36 (2016.02 - EP); G02B 27/00 (2013.01 - EP); G02B 27/0093 (2013.01 - EP); G02B 27/0172 (2013.01 - EP); G06F 3/011 (2013.01 - EP); G06F 3/017 (2013.01 - EP); G06F 3/04815 (2013.01 - US); G06F 3/0484 (2013.01 - US); G06T 11/00 (2013.01 - US); G06V 10/77 (2022.01 - US); G06V 10/945 (2022.01 - US); A61B 2017/00203 (2013.01 - EP); A61B 2017/00207 (2013.01 - EP); A61B 2017/00216 (2013.01 - EP); A61B 2090/365 (2016.02 - EP); A61B 2090/372 (2016.02 - EP); A61B 2090/376 (2016.02 - EP); A61B 2090/502 (2016.02 - EP); G06F 3/0304 (2013.01 - US); G06T 2200/24 (2013.01 - US)
Citation (search report)
See references of WO 2022053363A1
Designated contracting state (EPC)
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated extension state (EPC)
BA ME
Designated validation state (EPC)
KH MA MD TN
DOCDB simple family (publication)
EP 3964929 A1 20220309; CN 116075277 A 20230505; EP 4211539 A1 20230719; JP 2023540127 A 20230921; US 2024019980 A1 20240118; WO 2022053363 A1 20220317
DOCDB simple family (application)
EP 20207457 A 20201113; CN 202180061658 A 20210901; EP 2021074087 W 20210901; EP 21766498 A 20210901; JP 2023515151 A 20210901; US 202118021247 A 20210901