EP 4125045 A3 20230405 - METHOD AND SYSTEM FOR GENERATING 3D MESH OF A SCENE USING RGBD IMAGE SEQUENCE
Title (en)
METHOD AND SYSTEM FOR GENERATING 3D MESH OF A SCENE USING RGBD IMAGE SEQUENCE
Title (de)
VERFAHREN UND SYSTEM ZUR ERZEUGUNG EINES 3D-NETZES EINER SZENE UNTER VERWENDUNG EINER RGBD-BILDSEQUENZ
Title (fr)
PROCÉDÉ ET SYSTÈME POUR GÉNÉRER UN MAILLAGE 3D D'UNE SCÈNE À L'AIDE D'UNE SÉQUENCE D'IMAGES RGBD
Publication
Application
Priority
IN 202121033776 A 20210727
Abstract (en)
Traditional machine learning (ML) based systems used for scene recognition and object recognition have the disadvantage that they require huge quantity of labeled data to generate data models for the purpose of aiding the scene and object recognition. The disclosure herein generally relates to image processing, and, more particularly, to method and system for generating 3D mesh generation using planar and non-planar data. The system extracts planar point cloud and non-planar point cloud from each RGBD image in a sequence of RGBD images fetched as input, and then generates a planar mesh and a non-planar mesh for planar and non-planar objects in the image. A mesh representation is generated by merging the planar mesh and the non-planar mesh. Further, an incremental merging of the mesh representation is performed on the sequence of RGBD images, based on an estimated camera pose information, to generate representation of the scene.
IPC 8 full level
G06T 17/20 (2006.01)
CPC (source: EP US)
G06T 7/11 (2017.01 - EP); G06T 7/174 (2017.01 - EP); G06T 7/33 (2017.01 - EP); G06T 7/55 (2017.01 - EP); G06T 7/70 (2017.01 - US); G06T 17/20 (2013.01 - EP US); G06T 2207/10016 (2013.01 - EP); G06T 2207/10024 (2013.01 - EP US); G06T 2207/10028 (2013.01 - EP); G06T 2207/30244 (2013.01 - EP); G06T 2210/56 (2013.01 - EP)
Citation (search report)
- [YA] GREG TURK ET AL: "Zippered polygon meshes from range images", SIGGRAPH 94 CONFERENCE PROCEEDINGS : JULY 24 - 29, 1994, [ORLANDO, FLORIDA]; [COMPUTER GRAPHICS : ANNUAL CONFERENCE SERIES ; 1994], GLASSNER ANDREW S, NEW YORK, NY : ACM, 24 July 1994 (1994-07-24), pages 311 - 318, XP058162619, ISBN: 978-0-89791-667-7, DOI: 10.1145/192161.192241
- [YA] MA LINGNI ET AL: "Planar simplification and texturing of dense point cloud maps", 2013 EUROPEAN CONFERENCE ON MOBILE ROBOTS, IEEE, 25 September 2013 (2013-09-25), pages 164 - 171, XP032548214, DOI: 10.1109/ECMR.2013.6698837
- [YA] YANG HANG ET AL: "3DPMNet: Plane Segmentation and Matching for Point Cloud Registration", 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 27 November 2020 (2020-11-27), pages 439 - 444, XP093001368, ISBN: 978-1-7281-8025-0, Retrieved from the Internet <URL:https://ieeexplore.ieee.org/stampPDF/getPDF.jsp?tp=&arnumber=9274884&ref=aHR0cHM6Ly9zY2hvbGFyLmdvb2dsZS5jb20v> [retrieved on 20221123], DOI: 10.1109/ICUS50048.2020.9274884
- [A] THANH NGUYEN ET AL: "Structural Modeling from Depth Images", IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, vol. 21, no. 11, 15 November 2015 (2015-11-15), USA, pages 1230 - 1240, XP055406467, ISSN: 1077-2626, DOI: 10.1109/TVCG.2015.2459831
- [A] HU WENQIANG ET AL: "Research and implementation of mesh mergence from multi-view point cloud", INFORMATION AND AUTOMATION, 2009. ICIA '09. INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 22 June 2009 (2009-06-22), pages 670 - 674, XP031512753, ISBN: 978-1-4244-3607-1
Designated contracting state (EPC)
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated extension state (EPC)
BA ME
Designated validation state (EPC)
KH MA MD TN
DOCDB simple family (publication)
EP 4125045 A2 20230201; EP 4125045 A3 20230405; US 11941760 B2 20240326; US 2023063722 A1 20230302
DOCDB simple family (application)
EP 22177444 A 20220607; US 202217807339 A 20220616