Deep Learning Model for A Driver Assistance System to Increase Visibility on A Foggy Road

Deep Learning Model for A Driver Assistance System to Increase Visibility on A Foggy Road

Volume 5, Issue 4, Page No 314-322, 2020

Author’s Name: Samir Allacha), Mohamed Ben Ahmed, Anouar Abdelhakim Boudhir

View Affiliations

LIST Laboratory, FSTT, UAE University, Tangier 90000, Morocco

a)Author to whom correspondence should be addressed. E-mail: allach.samir@gmail.com

Adv. Sci. Technol. Eng. Syst. J. 5(4), 314-322 (2020); a  DOI: 10.25046/aj050437

Keywords: ADAS, Deep learning, Image dehazing, Foggy road, Object detection

Share
327 Downloads

Export Citations

Abstract

For many years, a lot of researches have been made to develop Advanced Driver Assistance Systems (ADAS) that are based on integrated systems. The main objective is to help drivers. Hence, keeping them safe under different driving conditions. Visibility for drivers remains the biggest problem faced on the road in an atmosphere of fog. In this paper, we examine a system that can be employed to substantially enhance visibility through using deep neural networks. Researches done recently- which are based on deep learning for eliminating image fog- have made clear that an end-to-end proposed system is such an effective model. However, it becomes a must to extend the idea to end-to-end real-time video deshazing. In this paper, we introduce a model of image dehazing. It is based on Convolutional Neural Networks (CNN) as a basis for developing the video dehazing model. As in addition, we concatenate our model with the faster RCNN for detecting objects on the road in real time. The experimental results on our image datasets shows the performance of our model with regard to Peak Signal to Noise Ratio (PSNR=19.823) and Structural Similarity (SSIM =0.8501). On the dataset of the synthesized videos, our model achieved a performance of PSNR = 21.4032 and SSIM = 0.9354. Moreover, with the concatenation of our dehazing model with Faster R-CNN (regions with convolutional neural networks), our proposed system displays desirable visual quality and a remarkable progress of the object detection achievement on blurred images with mean Average Precision (mAP) equal to 0.933 during the day and 0.804 during the night.

Received: 22 May 2020, Accepted: 13 July 2020, Published Online: 28 July 2020

References (33)

  1. B.Li, X.Peng, Z.Wang, J.Xu, D. Feng, “Aod-net: All-in-one dehazing network.” In Proceedings of the IEEE International Conference on Computer Vision, 4770-4778, 2017. DOI: 10.1109/ICCV.2017.511
  2. B.Cai, X.Xu, K.Jia, C.Qing, D. Tao, “Dehazenet: An end-to-end system for single image haze removal.” IEEE Transactions on Image Processing, 25(11), 5187-5198, 2016. DOI: 10.1109/TIP.2016.2598681
  3. C.Dong, C. C.Loy, K.He, X.Tang, “Image super-resolution using deep convolutional networks.” IEEE transactions on pattern analysis and machine intelligence, 38(2), 295-307, 2015. DOI: 10.1109/TPAMI.2015.2439281
  4. F.Hussain, J. Jeong, “Visibility enhancement of scene images degraded by foggy weather conditions with deep neural networks.” Journal of Sensors, 2016. https://doi.org/10.1155/2016/3894832.
  5. C.Li, J.Guo, F.Porikli, H.Fu, Y.Pang, “A cascaded convolutional neural network for single image dehazing.” IEEE Access, 6, 24877-24887,2018. DOI: 10.1109/ACCESS.2018.2818882
  6. B.Li, X.Peng, Z.Wang, J.Xu, D.Feng, “An all-in-one network for dehazing and beyond.” arXiv preprint, 2017. https://arxiv.org/abs/1707.06543
  7. Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., & Yang, M. H. “Single image dehazing via multi-scale convolutional neural networks.” In 2016Springer/Cham, European conference on computer vision, 154-169,2016. https://doi.org/10.1007/978-3-319-46475-6_10
  8. J. H.Kim, W. D.Jang, J. Y.Sim, C. S. Kim, “Optimized contrast enhancement for real-time image and video dehazing.” Journal of Visual Communication and Image Representation, 24(3), 410-425, 2013. http://dx.doi.org/10.1016/j.jvcir.2013.02.004
  9. A.Kappeler, S.Yoo, Q.Dai, A. K. Katsaggelos, “Video super-resolution with convolutional neural networks.” IEEE Transactions on Computational Imaging, 2(2), 109-122, 2016. DOI: 10.1109/TCI.2016.2532323
  10. S.Su, M.Delbracio, J.Wang, G.Sapiro, W.Heidrich, O.Wang, “Deep video deblurring for hand-held cameras.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1279-1288, 2017. DOI: 10.1109/CVPR.2017.33
  11. A.Karpathy, G.Toderici, S.Shetty, T.Leung, R.Sukthankar, L. Fei-Fei, “Large-scale video classification with convolutional neural networks.” In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 1725-1732, 2014. https://doi.org/10.1109/CVPR.2014.223
  12. H.Shen, S.Han, M.Philipose, A.Krishnamurthy, “Fast video classification via adaptive cascading of deep models.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 3646-3654, 2017. DOI: 10.1109/CVPR.2017.236
  13. D.Chen, J.Liao, L.Yuan, N.Yu, G.Hua, “Coherent online video style transfer.” In Proceedings of the IEEE International Conference on Computer Vision, 1105-1114, 2017. DOI: 10.1109/ICCV.2017.126
  14. D.Liu, Z.Wang, Y.Fan, X.Liu, Z.Wang, S.Chang, T. Huang, “Robust video super-resolution with learned temporal dynamics.” In Proceedings of the IEEE International Conference on Computer Vision, 2507-2515, 2017. DOI: 10.1109/ICCV.2017.274
  15. S.Albawi, T. A.Mohammed, S.Al-Zawi, “Understanding of a convolutional neural network.” In 2017IEEE International Conference on Engineering and Technology (ICET), 1-6, 2017. DOI: 10.1109/ICEngTechnol.2017.8308186
  16. Y.Xu, G.Yu, Y.Wang, X.Wu, Y. Ma, “Car detection from low-altitude UAV imagery with the faster R-CNN.” Journal of Advanced Transportation, 2017. https://doi.org/10.1155/2017/2823617
  17. E. J. McCartney, “Optics of the atmosphere: scattering by molecules and particles.” New York, John Wiley and Sons, Inc., 421, 1976. https://doi.org/10.1063/1.3037551
  18. S. G.Narasimhan, S. K. Nayar, “Chromatic framework for vision in bad weather.” In 2000 Proceedings IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, 598-605, 2000. DOI: 10.1109/CVPR.2000.855874
  19. B.Li, X.Peng, Z. Wang, J.Xu, D. Feng, “End-to-end united video dehazing and detection.” In 2018 AAAI Thirty-Second Conference on Artificial Intelligence, 2018. https://arxiv.org/abs/1709.03919
  20. K.He, X.Zhang, S.Ren, J. Sun, “Deep residual learning for image recognition.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 770-778, 2016. DOI: 10.1109/CVPR.2016.90
  21. W.Liu, D.Anguelov, D.Erhan, C.Szegedy, S.Reed, C. Y.Fu, A. C. Berg, “Ssd: Single shot multibox detector.” In 2016 Springer/Cham, European conference on computer vision, 21-37, 2016. https://doi.org/10.1007/978-3-319-46448-0_2
  22. S.Ren, K.He, R.Girshick, J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks.” In Advances in neural information processing systems, 91-99, 2015. DOI: 10.1109/TPAMI.2016.2577031
  23. Z.Li, P.Tan, R. T.Tan, D.Zou, S.Zhiying Zhou, L. F. Cheong, “Simultaneous video defogging and stereo reconstruction.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 4988-4997, 2015. DOI: 10.1109/CVPR.2015.7299133
  24. M.Sulami, I.Glatzer, R.Fattal, M.Werman, “Automatic recovery of the atmospheric light in hazy images.” In 2014 IEEE International Conference on Computational Photography (ICCP), 1-11, 2014. DOI: 10.1109/ICCPHOT.2014.6831817
  25. G.Meng, Y.Wang, J.Duan, S.Xiang, C.Pan, “Efficient image dehazing with boundary constraint and contextual regularization.” In Proceedings of the IEEE international conference on computer, 617-624, 2013. DOI:10.1109/ICCV.2013.82
  26. D.Berman, T.Treibitz, S.Avidan, “Air-light estimation using haze-lines.” In 2017 IEEE International Conference on Computational Photography (ICCP), 1-9, 2017. DOI: 10.1109/ICCPHOT.2017.7951489
  27. J. P. Tarel, N. Hautiere, “Fast visibility restoration from a single color or gray level image.” In 2009 IEEE 12th International Conference on Computer Vision, 2201–2208, 2009. DOI: 10.1109/ICCV.2009.5459251
  28. K.He, J.Sun, X. Tang, “Single image haze removal using dark channel prior.” IEEE transactions on pattern analysis and machine intelligence, 33(12), 2341-2353, 2010. DOI: 10.1109/TPAMI.2010.168
  29. Q.Zhu, J.Mai, L.Shao, “A fast single image haze removal algorithm using color attenuation prior.” IEEE transactions on image processing, 24(11), 3522-3533, 2015. DOI: 10.1109/TIP.2015.2446191
  30. J.Sturm, N.Engelhard, F.Endres, W.Burgard, D.Cremers, “A benchmark for the evaluation of RGB-D SLAM systems.” In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, 573-580, 2012. DOI: 10.1109/IROS.2012.6385773
  31. F. Mal, S. Karaman “Sparse-to-dense: Depth prediction from sparse depth samples and a single image.” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 1-8, 2018. DOI: 10.1109/ICRA.2018.8460184
  32. B.Cai, X.Xu, D. Tao, “Real-time video dehazing based on spatio-temporal mrf.” In 2016 Springer/Cham, Pacific Rim Conference on Multimedia, 315-325,2016. DOI: 10.1007/978-3-319-48896-7_31
  33. C.Sakaridis, D.Dai, L. Van Gool, “Semantic foggy scene understanding with synthetic data.” International Journal of Computer Vision, 126(9), 973-992, 2018. https://doi.org/10.1007/s11263-018-1072-8

Cited By

Citations by Dimensions

Citations by PlumX

Google Scholar

(Click Here)

Scopus

(Click Here)

Metrics