Deep Learning Model for A Driver Assistance System to Increase Visibility on A Foggy Road

Volume 5, Issue 4, Page No 314-322, 2020

Author’s Name: Samir Allach^a), Mohamed Ben Ahmed, Anouar Abdelhakim Boudhir

View Affiliations

LIST Laboratory, FSTT, UAE University, Tangier 90000, Morocco

^a)Author to whom correspondence should be addressed. E-mail: allach.samir@gmail.com

Adv. Sci. Technol. Eng. Syst. J. 5(4), 314-322 (2020); DOI: 10.25046/aj050437

Keywords: ADAS, Deep learning, Image dehazing, Foggy road, Object detection

Download Now!

376 Downloads

Export Citations

Abstract

For many years, a lot of researches have been made to develop Advanced Driver Assistance Systems (ADAS) that are based on integrated systems. The main objective is to help drivers. Hence, keeping them safe under different driving conditions. Visibility for drivers remains the biggest problem faced on the road in an atmosphere of fog. In this paper, we examine a system that can be employed to substantially enhance visibility through using deep neural networks. Researches done recently- which are based on deep learning for eliminating image fog- have made clear that an end-to-end proposed system is such an effective model. However, it becomes a must to extend the idea to end-to-end real-time video deshazing. In this paper, we introduce a model of image dehazing. It is based on Convolutional Neural Networks (CNN) as a basis for developing the video dehazing model. As in addition, we concatenate our model with the faster RCNN for detecting objects on the road in real time. The experimental results on our image datasets shows the performance of our model with regard to Peak Signal to Noise Ratio (PSNR=19.823) and Structural Similarity (SSIM =0.8501). On the dataset of the synthesized videos, our model achieved a performance of PSNR = 21.4032 and SSIM = 0.9354. Moreover, with the concatenation of our dehazing model with Faster R-CNN (regions with convolutional neural networks), our proposed system displays desirable visual quality and a remarkable progress of the object detection achievement on blurred images with mean Average Precision (mAP) equal to 0.933 during the day and 0.804 during the night.

Received: 22 May 2020, Accepted: 13 July 2020, Published Online: 28 July 2020

References (33)

B.Li, X.Peng, Z.Wang, J.Xu, D. Feng, “Aod-net: All-in-one dehazing network.” In Proceedings of the IEEE International Conference on Computer Vision, 4770-4778, 2017. DOI: 10.1109/ICCV.2017.511
B.Cai, X.Xu, K.Jia, C.Qing, D. Tao, “Dehazenet: An end-to-end system for single image haze removal.” IEEE Transactions on Image Processing, 25(11), 5187-5198, 2016. DOI: 10.1109/TIP.2016.2598681
C.Dong, C. C.Loy, K.He, X.Tang, “Image super-resolution using deep convolutional networks.” IEEE transactions on pattern analysis and machine intelligence, 38(2), 295-307, 2015. DOI: 10.1109/TPAMI.2015.2439281
F.Hussain, J. Jeong, “Visibility enhancement of scene images degraded by foggy weather conditions with deep neural networks.” Journal of Sensors, 2016. https://doi.org/10.1155/2016/3894832.
C.Li, J.Guo, F.Porikli, H.Fu, Y.Pang, “A cascaded convolutional neural network for single image dehazing.” IEEE Access, 6, 24877-24887,2018. DOI: 10.1109/ACCESS.2018.2818882
B.Li, X.Peng, Z.Wang, J.Xu, D.Feng, “An all-in-one network for dehazing and beyond.” arXiv preprint, 2017. https://arxiv.org/abs/1707.06543
Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., & Yang, M. H. “Single image dehazing via multi-scale convolutional neural networks.” In 2016Springer/Cham, European conference on computer vision, 154-169,2016. https://doi.org/10.1007/978-3-319-46475-6_10
J. H.Kim, W. D.Jang, J. Y.Sim, C. S. Kim, “Optimized contrast enhancement for real-time image and video dehazing.” Journal of Visual Communication and Image Representation, 24(3), 410-425, 2013. http://dx.doi.org/10.1016/j.jvcir.2013.02.004
A.Kappeler, S.Yoo, Q.Dai, A. K. Katsaggelos, “Video super-resolution with convolutional neural networks.” IEEE Transactions on Computational Imaging, 2(2), 109-122, 2016. DOI: 10.1109/TCI.2016.2532323
S.Su, M.Delbracio, J.Wang, G.Sapiro, W.Heidrich, O.Wang, “Deep video deblurring for hand-held cameras.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1279-1288, 2017. DOI: 10.1109/CVPR.2017.33
A.Karpathy, G.Toderici, S.Shetty, T.Leung, R.Sukthankar, L. Fei-Fei, “Large-scale video classification with convolutional neural networks.” In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 1725-1732, 2014. https://doi.org/10.1109/CVPR.2014.223
H.Shen, S.Han, M.Philipose, A.Krishnamurthy, “Fast video classification via adaptive cascading of deep models.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 3646-3654, 2017. DOI: 10.1109/CVPR.2017.236
D.Chen, J.Liao, L.Yuan, N.Yu, G.Hua, “Coherent online video style transfer.” In Proceedings of the IEEE International Conference on Computer Vision, 1105-1114, 2017. DOI: 10.1109/ICCV.2017.126
D.Liu, Z.Wang, Y.Fan, X.Liu, Z.Wang, S.Chang, T. Huang, “Robust video super-resolution with learned temporal dynamics.” In Proceedings of the IEEE International Conference on Computer Vision, 2507-2515, 2017. DOI: 10.1109/ICCV.2017.274
S.Albawi, T. A.Mohammed, S.Al-Zawi, “Understanding of a convolutional neural network.” In 2017IEEE International Conference on Engineering and Technology (ICET), 1-6, 2017. DOI: 10.1109/ICEngTechnol.2017.8308186
Y.Xu, G.Yu, Y.Wang, X.Wu, Y. Ma, “Car detection from low-altitude UAV imagery with the faster R-CNN.” Journal of Advanced Transportation, 2017. https://doi.org/10.1155/2017/2823617
E. J. McCartney, “Optics of the atmosphere: scattering by molecules and particles.” New York, John Wiley and Sons, Inc., 421, 1976. https://doi.org/10.1063/1.3037551
S. G.Narasimhan, S. K. Nayar, “Chromatic framework for vision in bad weather.” In 2000 Proceedings IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, 598-605, 2000. DOI: 10.1109/CVPR.2000.855874
B.Li, X.Peng, Z. Wang, J.Xu, D. Feng, “End-to-end united video dehazing and detection.” In 2018 AAAI Thirty-Second Conference on Artificial Intelligence, 2018. https://arxiv.org/abs/1709.03919
K.He, X.Zhang, S.Ren, J. Sun, “Deep residual learning for image recognition.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 770-778, 2016. DOI: 10.1109/CVPR.2016.90
W.Liu, D.Anguelov, D.Erhan, C.Szegedy, S.Reed, C. Y.Fu, A. C. Berg, “Ssd: Single shot multibox detector.” In 2016 Springer/Cham, European conference on computer vision, 21-37, 2016. https://doi.org/10.1007/978-3-319-46448-0_2
S.Ren, K.He, R.Girshick, J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks.” In Advances in neural information processing systems, 91-99, 2015. DOI: 10.1109/TPAMI.2016.2577031
Z.Li, P.Tan, R. T.Tan, D.Zou, S.Zhiying Zhou, L. F. Cheong, “Simultaneous video defogging and stereo reconstruction.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 4988-4997, 2015. DOI: 10.1109/CVPR.2015.7299133
M.Sulami, I.Glatzer, R.Fattal, M.Werman, “Automatic recovery of the atmospheric light in hazy images.” In 2014 IEEE International Conference on Computational Photography (ICCP), 1-11, 2014. DOI: 10.1109/ICCPHOT.2014.6831817
G.Meng, Y.Wang, J.Duan, S.Xiang, C.Pan, “Efficient image dehazing with boundary constraint and contextual regularization.” In Proceedings of the IEEE international conference on computer, 617-624, 2013. DOI:10.1109/ICCV.2013.82
D.Berman, T.Treibitz, S.Avidan, “Air-light estimation using haze-lines.” In 2017 IEEE International Conference on Computational Photography (ICCP), 1-9, 2017. DOI: 10.1109/ICCPHOT.2017.7951489
J. P. Tarel, N. Hautiere, “Fast visibility restoration from a single color or gray level image.” In 2009 IEEE 12th International Conference on Computer Vision, 2201–2208, 2009. DOI: 10.1109/ICCV.2009.5459251
K.He, J.Sun, X. Tang, “Single image haze removal using dark channel prior.” IEEE transactions on pattern analysis and machine intelligence, 33(12), 2341-2353, 2010. DOI: 10.1109/TPAMI.2010.168
Q.Zhu, J.Mai, L.Shao, “A fast single image haze removal algorithm using color attenuation prior.” IEEE transactions on image processing, 24(11), 3522-3533, 2015. DOI: 10.1109/TIP.2015.2446191
J.Sturm, N.Engelhard, F.Endres, W.Burgard, D.Cremers, “A benchmark for the evaluation of RGB-D SLAM systems.” In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, 573-580, 2012. DOI: 10.1109/IROS.2012.6385773
F. Mal, S. Karaman “Sparse-to-dense: Depth prediction from sparse depth samples and a single image.” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 1-8, 2018. DOI: 10.1109/ICRA.2018.8460184
B.Cai, X.Xu, D. Tao, “Real-time video dehazing based on spatio-temporal mrf.” In 2016 Springer/Cham, Pacific Rim Conference on Multimedia, 315-325,2016. DOI: 10.1007/978-3-319-48896-7_31
C.Sakaridis, D.Dai, L. Van Gool, “Semantic foggy scene understanding with synthetic data.” International Journal of Computer Vision, 126(9), 973-992, 2018. https://doi.org/10.1007/s11263-018-1072-8

Deep Learning Model for A Driver Assistance System to Increase Visibility on A Foggy Road