No Detail Found!

Deep ConvBi-LSTM: A Robust 3D Room Layout Estimation Model for Indoor Environment

Author(s)
Narendra Mohan GLA University, Department of Computer Engineering and Applications,India
Manoj Kumar GGV University, Department of Information Technology, Bilaspur, Chhattisgarh, India,
Abstract
Room layout estimation is importance in recent times due to its extended application area. This process is highly challenging due to several factors affecting the room image such as clutter, occlusions, illuminations, etc. It is important to accurately identify the 3D layout of the room from a single 2D room image. The available techniques focused on determining the 3D layout but with limited number of features. It is important for a model to be fed with large number of features to result in successful predictions. To this extent, the proposed model introduced a robust 3D layout estimation framework for indoor environment. Initially, the input image is preprocessed and then subjected to layout estimation where our proposed model predicted both the edge maps and semantic labels for the image. For prediction, the proposed framework utilized the Deep ConvBi-LSTM model and a score function is defined and maximized by remora optimization algorithm (ROA) to obtain the optimal 2D layout from the candidate set. Finally, the 3D output is reconstructed from the 2D layout based on the layout coordinates and camera orientations. The experimental results of the proposed model proved the efficiency of the model in providing the desired performance.
Publication Details
Page(s) 142-169
DOI DOI not available
Published Journal: International Journal of Communication Networks and Information Security, Volume: 16, Issue: 4, Year: 2024

Request the full text from PASTIC

Keywords
deep ConvBi-LSTM, 3D reconstruction, Indoor scene, semantic label, remora optimization algorithm, edge map, layout estimation
References
Mathew Bincy P. .2020 ."Review on room layout estimation from a single image.". Int. J. Eng. Res. Technol, 9(6) : 1068-1073.
Chen Xuehui,Wu Xuehui .2019 ."A Fast End-to-End Method with Style Transfer for Room Layout Estimation.". In 2019 IEEE International Conference on Multimedia and Expo (ICME), : 964-969.
Hirzer Vincent,Lepetit PETER,ROTH PETER .2020 ."Smart hypothesis generation for efficient and robust room layout estimation.". In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, : 2912-2920.
Yao Jun,Chu Jun .2023 ."3D layout estimation of general rooms based on ordinal semantic segmentation." IET Computer Vision (. , : .
Choi .2020 .. Dongho. "3D Room Layout Estimation Beyond the Manhattan World Assumption." arXiv preprint arXiv:2009, 02857 : .
Stekovic Vincent,Lepetit Vincent,Compare Vincent .2020 .". In European Conference on Computer Vision, : 187-203.
Chen Guoliang,Fan Guoliang .2023 ."Indoor Camera Pose Estimation from Room Layouts and Image Outer Corners.". IEEE Transactions on Multimedia, : .
Hsiao ,Hwann-Tzong Chen .2019 ."Flat2layout: Flat representation for estimating layout of general room types." arXiv preprint arXiv:. , 12571 : .
Zou ,Jheng-Wei Su,Chi-Han Peng,Wonka Peter,Hung-Kuo Chu Derek,Hoiem Derek .2019 ."3d manhattan room layout reconstruction from a single 360 image."CoRR. , : .
Chen .2023 ."A Fast Method for Identifying Room Configurations from Unit Boundaries in Existing Residential Buildings. " Buildings, 13(2) : 357.
Sun ,Chi-Wei Hsiao,Hwann-Tzong Chen Hsiao .2019 ."Horizonnet: Learning room layout with 1d representation and pano stretch data augmentation.". In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, : 1047-1056.
Huang ,Rong-Ze ,Qing-HaoMeng .2020 ."Indoor Layout Estimation by Fusing Monocular RGB Image Features Extracted with HRNet.". In 2020 39th Chinese Control Conference (CCC), : 7412-7417.
Zhang Yibin,Li Yibin .2020 ."From Edge to Keypoint: An End-to-End Framework for Indoor Layout Estimation.". IEEE Transactions on Multimedia, : .
Yang ,Shang-Ta ,Fu-En Wang,Chi-Han Peng,Wonka Peter,Hung-Kuo Chu Peter .2019 ."Dula-net: A dual-projection network for estimating room layouts from a single rgb panorama.". In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, : 3363-3372.
Huang ,Tai-Jiang Mu .2020 ."WallNet: Reconstructing General Room Layouts from RGB Images.". Graphical Models, 111 : 101076.
Li Mingyang,Wang Yuehua,Zhou Zhong .2019 ."3d room reconstruction from a single fisheye image.". In 2019 International Joint Conference on Neural Networks (IJCNN), : 1-8.
Fernandez-Labrador ,Guerrero .2020 ."Corners for layout: End-to-end layout recovery from 360 images.". IEEE Robotics and Automation Letters, 5(2) : 1255-1262.
Albanis Dimitrios,Zarpalas Dimitrios .2023 ."An AI-Based System Offering Automatic DR-Enhanced AR for Indoor Scenes.". In Advanced Intelligent Virtual Reality Technologies: Proceedings of 6th International Conference on Artificial Intelligence and Virtual Reality (AIVR, : 187-199.
Li ,Jieyu and Robert L.,Stevenson and Robert L. .2020 ."Indoor layout estimation by 2d lidar and camera fusion. " Electronic Imaging, 14 : 391-1.
Boniardi Wolfram,Burgard Wolfram .2019 ."Robot localization in floor plans using a room layout edge extraction network.". In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), : 5291-5297.
Jiali ,Shen Shuhan .2023 ."FloorUSG: Indoor floorplan reconstruction by unifying 2D semantics and 3D geometry.". ISPRS Journal of Photogrammetry and Remote Sensing, 196 : 490-501.
Zhang Jason,Gu Jason .2019 ."Edge-semantic learning strategy for layout estimation in indoor environment. " IEEE transactions on cybernetics 50, (6) : 2730-2739.
Zhang Jianxiong,Xiao Jianxiong .2015 ."Large-scale scene understanding challenge: Room layout estimation.". In CVPR Workshop, : .
Lee ,Chen-Yu Andrew,Rabinovich Andrew .2017 ."Roomnet: End-to-end room layout estimation.". In Proceedings of the IEEE International Conference on Computer Vision, : 4865-4874.
Zhao and Li,Zhang and Li .2017 ."Physics inspired optimization on semantic transfer features: An alternative method for room layout estimation.". In Proceedings of the IEEE conference on computer vision and pattern recognition, : 10-18.
Xu Tony,Tung Tony .2017 ."Pano2cad: Room layout from a single panorama image." In 2017 IEEE winter conference on applications of computer vision. , : 354-362.
Zou Derek,Hoiem Derek .2018 ."Layoutnet: Reconstructing the 3d room layout from a single rgb image.". In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, : 2051-2059.
Shariati Bernd,Pfrommer Camillo J.,Taylor Camillo J. .2018 ."Predictive and semantic layout estimation for robotic applications in manhattan worlds." arXiv preprint arXiv:. , 07442 : .
Liu Yasutaka,Furukawa Yasutaka .2018 ."Planenet: Piece-wise planar reconstruction from a single rgb image.". In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, : 2579-2588.
Wang Yaochen,Li Ming,Zeng Ziwei,Wang Ziwei .2019 ."Bottom-up Estimation of Geometric Layout for Indoor Images.". In 2019 IEEE International Conference on Unmanned Systems (ICUS), : 848-853.
Kruzhilov Mikhail,Romanov Anton,Konushin Anton .2019 ."Double refinement network for room layout estimation. ", : .
Nie ,Shi-Min Hu .2020 ."Shallow2Deep: Indoor scene modeling by single image understanding. " Pattern Recognition, 103 : 107271.
Purkait Christopher,Zach Ian,Reid Ian .2020 ."SG-VAE: Scene Grammar Variational Autoencoder to generate new indoor scenes.". In European Conference on Computer Vision, : 155-171.
Pintore Marco,Agus Enrico,Gobbetti Enrico .2020 ."AtlantaNet: Inferring the 3D Indoor Layout from a Single 3600 Image Beyond the Manhattan World Assumption.". In European Conference on Computer Vision, : 432-448.
Avetisyan Matthias,Nießner Matthias .2020 ."Scenecad: Predicting object alignments and layouts in rgb-d scans." In Computer Vision-ECCV. Part XXII 16, (28) : 596-612.
Zhang Yinda,Zhang Yinda .2020 ."GeoLayout: Geometry driven room layout estimation based on depth maps of planes.". In European Conference on Computer Vision, : 632-648.
Ren Jie,Zhou Jie .2020 ."Spatial Geometric Reasoning for Room Layout Estimation via Deep Reinforcement Learning.". In European Conference on Computer Vision, : 550-565.
Yan RuixinNing,Xu Feng .2020 ."3D room layout estimation from a single RGB image.". IEEE Transactions on Multimedia, 11 : 3014-3024.
Sun ,Hwann-Tzong Chen .2021 ."Hohonet: 360 indoor holistic understanding with latent horizontal features.". In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, : 2573-2582.
Nigam N. Sai,Shankar K. Madhava,Krishna K. Madhava .2021 ."RackLay: Multi-Layer Layout Estimation for Warehouse Racks.". arXiv preprint arXiv:2103.09174, : .
Zhao ,HongbinZha. "Transferable .2021 .. end Room Layout Estimation via Implicit Encoding." arXiv preprint arXiv:2112.11340, : .
Pintore Enrico,Gobbetti Enrico .2021 ."Deep3DLayout: 3D reconstruction of an indoor layout from a spherical panoramic image." ACM Transactions on Graphics (TOG) 40. , (6) : 1-12.
Zioulis .2021 .PetrosDaras. "Single-shot cuboids: Geodesics-based end-to-end Manhattan aligned layout estimation from spherical panoramas. " Image and Vision Computing, 110 : 104160.
Dasgupta Silvio,Savarese Silvio .2016 ."Delay: Robust spatial layout estimation for cluttered indoor scenes.". In Proceedings of the IEEE conference on computer vision and pattern recognition, : 616-624.
Amin ShuiHua,Wang ShuiHua .2021 .CONTINUA 68. , (2) : 2693-2709.
Naveen P.,Sivakumar P. .2021 ."Adaptive morphological and bilateral filtering with ensemble convolutional neural network for pose-invariant face recognition. " Journal of Ambient Intelligence and Humanized Computing, 11 : 10023-10033.
Zhang Jason,Gu Jason .2016 ."Learning to predict high-quality edge maps for room layout estimation. " IEEE Transactions on Multimedia, 19(5) : 935-943.
Hedau Derek,Hoiem David,Forsyth David .2009 ."Recovering the spatial layout of cluttered rooms.". In 2009 IEEE 12th international conference on computer vision, : 1849-1856.
Jia Chunbo,Lang Chunbo .2021 ."Remora optimization algorithm. " Expert Systems with Applications, 185 : 115665.
Zioulis Petros,Daras Petros .2022 ."Monocular spherical depth estimation with explicitly connected weak layout cues.". ISPRS Journal of Photogrammetry and Remote Sensing, Elsevier, 183 : 269-285.
Farin Wolfgang,Effelsberg Wolfgang,Peter HN de With Wolfgang .2007 ."Floor-plan reconstruction from panoramic images.". In Proceedings of the 15th ACM international conference on Multimedia, : 823-826.
0

Citations

0

Downloads

67

Views