EP 3435284 A1 20190130 - NEURAL NETWORK FOREGROUND SEPARATION FOR MIXED REALITY
Title (en)
NEURAL NETWORK FOREGROUND SEPARATION FOR MIXED REALITY
Title (de)
VORDERGRUNDTRENNUNG EINES NEURONALEN NETZWERKS FÜR GEMISCHTE REALITÄT
Title (fr)
SÉPARATION D'AVANT-PLAN DE RÉSEAU NEURONAL DE RÉALITÉ MIXTE
Publication
Application
Priority
US 201715661964 A 20170727
Abstract (en)
A head wearable device, a method, and a system. The head wearable device may include a display, a camera, a convolutional neural network (CNN) processor, and a processor. The CNN processor may be configured to: receive real scene image data from the camera; identify and classify objects in a real scene image; and generate object classification and position data. The processor may be configured to receive the real scene image data; receive the object classification and position data from the CNN processor; perform an image segmentation operation on the real scene image to fill in the objects; generate filled-in object data indicative of filled-in objects; generate a pixel mask; receive virtual scene image data; create mixed reality scene image data; and output the mixed reality scene image data to the display for presentation to a user.
IPC 8 full level
G02B 27/00 (2006.01); G06F 3/01 (2006.01); G06T 19/00 (2011.01); G06V 10/764 (2022.01)
CPC (source: CN EP US)
G02B 27/00 (2013.01 - US); G02B 27/01 (2013.01 - US); G02B 27/017 (2013.01 - EP US); G06F 3/011 (2013.01 - EP US); G06F 18/24 (2023.01 - CN); G06F 18/24143 (2023.01 - US); G06F 18/2433 (2023.01 - US); G06F 18/41 (2023.01 - US); G06T 3/4038 (2013.01 - CN); G06T 5/50 (2013.01 - CN); G06T 7/13 (2016.12 - CN); G06T 7/194 (2016.12 - CN US); G06T 11/60 (2013.01 - US); G06T 19/006 (2013.01 - EP US); G06V 10/449 (2022.01 - CN); G06V 10/764 (2022.01 - EP US); G06V 10/82 (2022.01 - EP US); G06V 20/10 (2022.01 - US); G06V 20/20 (2022.01 - EP US); G02B 2027/0134 (2013.01 - EP US); G02B 2027/0138 (2013.01 - EP US); G02B 2027/014 (2013.01 - EP US); G02B 2027/0187 (2013.01 - EP US); G06F 3/012 (2013.01 - US); G06F 3/013 (2013.01 - US); G06T 2207/10021 (2013.01 - CN); G06T 2207/20081 (2013.01 - US); G06T 2207/20221 (2013.01 - CN); G06T 2210/12 (2013.01 - US)
Citation (search report)
- [A] BRUDER G ET AL: "Enhancing Presence in Head-Mounted Display Environments by Visual Body Feedback Using Head-Mounted Cameras", CYBERWORLDS, 2009. CW '09. INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 7 September 2009 (2009-09-07), pages 43 - 50, XP031542169, ISBN: 978-1-4244-4864-7
- [A] MARK MCGILL ET AL: "A Dose of Reality", HUMAN FACTORS IN COMPUTING SYSTEMS, ACM, 2 PENN PLAZA, SUITE 701 NEW YORK NY 10121-0701 USA, 18 April 2015 (2015-04-18), pages 2143 - 2152, XP058068274, ISBN: 978-1-4503-3145-6, DOI: 10.1145/2702123.2702382
Designated contracting state (EPC)
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated extension state (EPC)
BA ME
DOCDB simple family (publication)
EP 3435284 A1 20190130; EP 3435284 B1 20210602; CN 109345556 A 20190215; CN 109345556 B 20211224; US 10269159 B2 20190423; US 2019035125 A1 20190131
DOCDB simple family (application)
EP 18184700 A 20180720; CN 201810821708 A 20180724; US 201715661964 A 20170727