摘要
充分运用大气光学的理论知识,研究了夜晚和不同恶劣天气条件下引起视频图像退化的成因机理,归纳了夜晚和大雾、大雨、沙尘等恶劣天气条件下图像退化的特征。总结和分析了采用基于退化模型的图像恢复方法存在的难度和不足,以及采用图像增强方法的优点。详细讨论了目前常用的图像增强技术在处理夜晚和不同恶劣天气条件下退化图像时存在的问题或不足,研究了基于Retinex理论的图像增强方法的特点。指出利用Retinex理论克服不同条件下由于光照影响造成图像退化的可行性,并基于Retinex理论提出适合夜晚和大雾、大雨、沙尘等恶劣天气条件下退化图像的增强方法。通过优化本文提出的图像增强方法,基于DSP平台,研制了一种新型视频图像增强系统,可以完善和提高原有的视频监控系统。
The cause and mechanism of degradation of video images captured in night and bad weathers are studied by making full use of the theory of the atmosphere optics. The characteristics of images captured in night, fog, rain and dusty weather are concluded. The difficulties and insufficiencies of image restoration techniques based on the degradation models and the merits of image enhancement techniques are summarized and analyzed. The insufficiencies of current widely used image enhancement techniques are discussed in detail when these techniques are used to process night images and bad weathers degraded images and the characteristics of image enhancement techniques based on Retinex theory are researched. The feasibility of applying Retinex theory to overcome degradation by different illumination is pointed out and two enhancement methods based on Retinex theory respectively suit for night images and images captured in bad weathers, such as fog, rain and dust, are proposed in this paper. A real-time video images enhancement system based on DSP paltform is developed by optimizing the proposed image enhancement methods, which will perfect and enhance original video surveillance system.
引文
1. Shree K. Nayar, Srinivasa G. Narasimhan. Vision in bad weather. Proceedings of IEEE International Conference on Computer Vision,1999,2:820~827
2. Srinivasa G. Narasimhan, Shree K. Nayar. Vision and the atmosphere. International Journal of Computer Vision,2002,48(3):233~254
3. Norman S. Kopeika. A system engineering approach to imaging. SPIE Optical Engineering Press,1998:225~286
4. Yitzhak Yitzhaky, Itai Dror, Norman S. Kopeika. Restoration of atmospherically blurred images according to weather-predicted atmospheric modulation transfer function. Optical Engineering,1997,36:3064~3072
5. E. J. McCartney, Optics of the Atmosphere:scattering by molecules and particles. Physics Today,30(5):1~76
6. John P. Oakley, Brenda L. Satherley. Improving image quality in poor visibility conditions using a physical model for contrast degradation. IEEE Trans. Image Processing,1998,7(2): 167~179
7. Kok keong Tan, John P. Oakley. Enhancement of color images in poor visibility conditions. International Conference on Image Processing,2000,2:30~33
8. Srinivasa G. Narasimhan. Shree K. Nayar. Chromatic framework for vision in bad weather. Proceedings of IEEE Conference on Computer Vision and Patern Recognition,2000,1: 598~605
9. M. J. Rakovic, G. W. Kattawar, M. Mehrubeoglu. Light backscattering polarization patterns from turbid media:theory and experiment. Applied Optics,1999.38(15):3399~3408
10. Yoav Y. Schechner, Srinivasa G. Narasimhan, Shree K. Nayar. Instant dehazing of images using polarization. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition,2001,1:1325-1332
11. Yoav Y. Schechner, Srinivasa G. Narasimhan, Shree K. Nayar. Polarization based vision through haze. Applied Opitics,2003,42(3):511~525
12. Srinivasa G. Narasimhan, Shree K. Nayar. Removing weather effects from monochrome images. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2001,2:186~193
13. Srinivasa G. Narasimhan, Shree K. Nayar. Interactive (de)weathering of an image using physical models. International Conference on Computer Graphics and Interactive Techniques, 2008
14.武风霞,王章野,彭群生.最小失真意义下雾化图像复原.系统仿真学报,2006,18(1):363~365
15. Richard A. Young. The Gaussian derivative model for spatial vision:I. Retinal mechanisms. 1987,2(4):273~293
16. Fried D L. Optical resolution through a randomly inhomogeneous medium for very long and very short exposures. Journal of the Optical Society of America.1966,56(10):1372~1379
17.祝培,朱虹,钱学明.一种有雾天气图像景物影像的清晰化方法.中国图象图形学报,2004,9(1):124~128
18.艾明晶,戴隆忠,曹庆华.雾天环境下自适应图像增强云雾方法研究.计算机仿真,2009, (7):244~247
19.王萍,张春,罗颖昕.一种雾天图像低对比度增强的快速算法.计算机应用,2006,26(1):152~154
20. Kim Joung-Youn, Kim Lee-Sup, Hwang Seung-Ho. An advanced contrast enhancement using partially overlapped sub-block histogram equalization. IEEE Transactions on Circuits and Systems for Video Technology.2001,11(4):475~484
21.沈文水,周新志.基于同态滤波的遥感薄云去除算法.强激光与粒了束,2010,22(1):45~48
22.朱锡芳,吴峰,庄燕滨.小波变换在遥感图像云雾处理的应用.微电子学与计算机,2006,23(12):138~141
23.曾好德,张韧.基于小波分解的薄云薄雾模糊图像的恢复与增强.解放军理工大学学报(自然科学版),2005,6(1):76~80
24.倪雪,李庆武,陈小刚.基十第二代Curvelet变换的低对比度图像增强.计算机工程与应用,2008,44(17):188~190
25.翟艺书,柳晓鸣,涂雅瑗.基于模糊逻辑的雾天降质图像对比度增强算法.计算机应用,2008,28(3):662~664
26.芮义斌,李鹏,孙锦涛.基于色彩恒常理论的图像去雾技术.南京理工大学学报,2006,30(5):622~625
27.芮义斌,李鹏,孙锦涛.一种图像去薄雾方法.计算机应用,2006,26(1):154~156
28.李鹏.薄半雾退化图像的处理研究.南京理工大学硕士学位论文,2005:20~55
29.周树道,邵啸,朱涛.薄雾影响下的退化彩色图像处理力方法.解放军理工大学学报,2008,9(2):142~45
30.刘治群.薄雾条件下降质图像清晰化方法的研究.合肥工业大学硕士学位论文,2009:30~55
31.金伟其,王岭雪,赵源萌.彩色也是成像处理算法的新进展.红外与激光工程,2008,37(1):147~150
32. Paul E. Debevec, Jitendra Malik. Recovering high dynamic range radiance maps from photographs. Proceedings of Annual Conference Series on Computer Graphics,1997: 369-378
33. Jing Li, Stan Z. Li, Quan Pan. Illumination and motion based video enhancement for night surveillance. Proceedings of 2nd Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance,2005,1:169~175
34.刘骊,申卫昌,李磊.一种新的暗背景图像增强算法.西北大学学报,2008,6(5):39~42
35.张宇,王希勤,彭应宁.一种用于夜问图像增强的算法.清华大学学报(自然科学版),1999,39(9):79~80
36.沈嘉励,张宇,王秀坛.一种仪视图象处理的新算法.中国图象图形学报,2000,5(6):479~483
37.江巨浪,胡林生,蕾.亮度保持的夜景图像增强算法.合肥工业大学学报(自然科学版),2007,30(9):1083~1086
38.孙韶媛,王利平,张保民等.基于二维直方图分析的二元子图微光图像增强处理.红外与毫米波学报,2003,22(3):220~224
39. Fr'edo Durand, Julie Dorsey. Fast bilateral filtering for the display of high-dynamic-range images. Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques.2002,21(3):249~256
40. Raanan Fattal, Dani Lischinski, Michael Werman. Gradient domain high dynamic range Compression. Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques,2002,21(3):257~266
41. Jack Tumblin, Greg Turk. LCIS:A boundary hierarchy for detail-preserving contrast reduction. Proceedings of Annual Conference Series on Computer Graphics,1999:83~90
42. Jian Zhang, Sei-ichro Kamata. An adaptive tone mapping algorithm for high dynamic range images. Computational Color Imaging Lecture Notes in Computer Science,2009,5646: 207~215
43.汪孔桥.数字图像的质量评价.测控技术,2000,19(5):14~16
44.桂芳,李祖枢,成卫.基于视觉感知的融合图像质量评价.计算机应用,2004,24(5):69~75
45.杨军,张延生.图像质量主客观评价的相关性分析.军械工程学院学报,2003,15(1)29~33
46.刘明晶,刘国栋,一种基于视觉感知的图像质量评价方法.计算机工程与设计,2005,26(2):470~478
47.徐鲁安,章琦.一种新的图像质量评价方法.计算机工程与设计,2004,25(3):418~420
48.丁绪星,朱日宏,李建欣.一种基于人眼视觉特性的图像质量评价.中国图象图形学报,2004,9(2):190~194
49.吴援明,梁恩志.一种基于墒的放大后图像质量的评价方法.信号处理,2004,20(2)190~193
50.王虹,潘晓露,李一民.一种基于梯度幅度值的图像质量客观评价方法.光学与光电技术,2004,2(6):23~58
51.冈萨雷斯.数字图像处理.阮秋琦,阮宇智译.北京:电子工业出版社,2003:152~196
52.阮秋琦.数字图像处理学.第1版.北京:电子工业出版社,2001:180~212
53.朱秀昌,刘峰,胡栋.数字图像处理与图像通信.北京:北京邮电大学出版社,2002:67~95
54. Gastleman K. R数字图像处理.朱志刚等译.北京:电子工业出版社,1998:75~76
55. Zia-ur Rahman, Glenn A. Woodell, Daniel J. Jobson. A comparison of the multiscale retinex with other image enhancement techniques. Proceedings of the IS&T 50th Anniversary Conference,1997
56.李方慧,王飞,何佩琨.TMS320C6000系列DSPs原理与应用(笫二版).北京:电子工业出版社,2005
57. L. Pirodda. Enhancing visibility through fog. Optics & Laser Technology,1997,29 (6): 293~299
58. Cozman F., Krotkov E.. Depth from scattering. Proceedings of the Conference on Computer Vision and Pattern Recognition.1997:801-806
59.李鹏.薄尘雾退化图像的处理研究.南京理工大学硕士论文,2005:8~11
60. V. Digalakis, D. G. Manolakis, V. K. Ingle. Automatic adaptive contrast enhancement for radiological imaging. Proceedings of IEEE International Symposium on Circuits System, 1993,1:810-813
61. T.-L. Ji, M. K. Sundareshan, H. Roehrig. Adaptive image contrast enhancement based on human visual properties. IEEE Transactions on Medical Imaging,1994,13:573~586
62. J. D. Fahnestock, R. A. Schowengerdt. Spatially variant contrast enhancement using local range modification. Optical Engineering,1983,22(3):378~381
63. Tae Keun Kim,Joon Ki Paik. Bong Soon Kang. Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering. IEEE Transactions on Consumer Electronics,1998,44(1):82~87
64. Joung Youn Kim, Lee Sup Kim, Seung Ho Hwang. An advanced contrast enhancement using partially overiapped sub-Block histogram equalization. IEEE Transactions on Circuits and Systems for Video technology.2001,11(4):475~484
65.王猛,白洪亮.同态滤波器在水下图像对比度增强中的应用.应用科技,2003,30(7):15~17
66.闻莎,游志胜.性能优化的同态滤波空域算法计算机应用研究,2000,(3):62~65
67.朱述龙.基于小波理论的影像增强技术.测绘通报,1996,(2):12~13
68.吴颖谦,施鹏飞.基十小波变换的低对比度图像增强.红外与激光工程,2003,32(1):4~7
69.张新明,沈兰荪.基于小波和统计特性的自适应图像增强.信号处理,2001,(3):227~231
70.赵登峰,许纯新,王国强.小波分析在数字图像处理中的的应用.同济大学学报,2001,(9):1054~1057
71. Daniel J. Jobson, Rahman Zia-ur, Glenn A. Woodell. The statistics of visual representation. SPIE.2002,4736:25~35
72.陶纯堪,陶纯匡.光学信息论.北京:科学出版社,2004:24
73.王鸿南,钟文,汪静.图像清晰度评价方法研究.中国图象图形学报,2004,9(7):828~831
74. Edwin H. Land, John J. McCann. Lightness and Retinex theory. Journal of the Optical Society of America,1971,61(1):1~11
75. Edwin H. Land. An alternative technique for the computation of the designator in the retinex theory of color vision. Proceedings of the National Academy of Science,1986,83(10): 3078~3080
76. TruView. http://www.truview.com
77. David H. Brainard, Brain A. Wandell. Analysis of the retinex theory of color vision. Journal of the Optical Society of America,1986,3(10):1651~1661
78. Daniel J. Jobson, Zia-ur Rahman, Glenn A. Woodell. Properties and performance of a center/surround retinex. IEEE Transactions on Image Processing,1997,6(3).451~463
79. Anya Hurlbert. Formal connections between lightness algorithms. Journal of the Optical Society of America,1986,3:1684-1693
80. Berthold K. P. Horn. Determining lightness from an image. Computer Vision Graphics and Image Processing,1974,3:277~299
81. Andrew Blake. Boundary conditions of lightness computation in mondrian world. Computer Vision Graphics and Image Processing,1985,32(3):314~337
82. Funt B. V., Drew M. S., Brockington M. Recovering shading from color images. Proceedings of European Conference on Computer Vision,1993:134~133
83. Jonathan A. Frankle, John J. McCann. Method and apparatus for lightness imaging, United States Patent.1983, (4):384~336
84. Brian Funt, Florian Ciurea. John McCann. Tuning Retinex Parameters. SPIE,2002.4662: 358~366
85. John J. McCann. Lessons learned from mondrians applied to real images and color gamuts. Proceedings of the IS&T 7th Color Imaging Conference,1999:1-8
86. Brian Funt, Florian Ciurea. Retinex in matlab. Journal of Electronic Imaging.2004,13(1): 48~57
87. Ron Kimmel, Michael Elad, Doron Shaked. A variational framework for retinex. International Journal of Computer Vision,2003,52(1):7-23
88. Michael Elad, Ron Kimmel, Doron Shaked. Reduced complexity retinex algorithm via the variational approach. Journal of Visual Communication and Image Representation,2003, 14(4):369~388
89. Zia-ur Rahman. Properties of a center/surround retinex, part one:signal processing design. NASA Contractor Report 198194,1995
90. Daniel J. Jobson, Glenn A. Woodell. Properties of a center/surround retinex, part two: surround design. NASA Technical Memorandum 110188,1995
91. Zia-ur Rahman, Daniel J. Jobson, Glenn A. Woodell. Woodell. A multiscale retinex for bridging the gap between color images and the human observation of senses. IEEE Transaetions on Image Processing.1997.1(7):965~976
92. Zia-ur Rahman, Daniel J. Jobson, Glenn A. Woodell. Retinex processing for automatic image enhancement. Journal of the Electron Imaging,2004,13(1):100~110
93. Daniel J. Jobson, Rahman Zia-ur, Glenn A. Woodell. A multiscale retinex for bridging the gap between color images and the human observatio n of scenes. IEEE Transactions on Image Processing,1997,6(7):965~976
94. Zia-ur Rahman, Daniel J. Jobson, Glenn A. Woodell. A multiscale retinex for color rendition and dynamic range compression. SPIE,1996,2847:183-191
95.沈嘉励,张宇,王秀坛.一种夜视图像处理的新算法.中国图象图形学报,2000,5(6):479~483
96.赵晓霞,王汝琳,张莉莉.恶劣天气下降质图像增强算法研究.微计算机信息,2010,26(8-2):3~4
97. Dah-Chung Chang, Wen-Rong Wu. Image contrast enhancement based on a histogram transformation of local standard deviation. IEEE Transactions on Medical Imaging,1998, 17(4):518-531
98. Jae Ho Jang, Boorym Choi, Sung Deuk Kim. Sub-band decomposed multiscale retinex with space varying gain. IEEE International Conference on Image Processing,2008:3168-3171
99. M. Ashikhmin. A tone mapping algorithm for high contrast images. Proceedings of 13th Eurographics Workshop on Rendering,2002:145~156
100. Reinhard E., Stark M., Shirley P. Photographic tone reproduction for digital images. ACM Transactions on Graphics,2002,21(3):267~276
101. G. J. Braun, M. D. Fairchild. Image lightness rescaling using sigmoidal contrast enhancement functions. Journal of Electron Imaging,1999,8:380~393
102. J. Holm. Photographic tone and color reproduction goals. Proceedings of CIE Expert Symposium'96 on Color Standards for Image Technology,1996:51~56
103. G. Ward, H. Rushmeier, C. Piatko. A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Transactions on Computer Vision Graphics and Image Processing.1997,3:291~306
104. Perona P., Malik J. Scale-space and edge detection using anisotropic diffusion. IEEE PAMI. 1990,12(7):629~639
105. M. J. Black. G. Sapiro. D. Marimont. Robust anisotropic diffusion. IEEE Transactions on Image Processing,1998.7(3):421-432
106. C. Bajaj, G. Xu. Anisotropic diffusion of surfaces and functions on surfaces. ACM Transactions on Computer Graphics,2003,22(1):4-32
107. D. Barash. A fundamental relationship between bilateral filtering, adaptive smoothing and nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,24(6):844~850
108. C. Tomasi, R. Manduchi. Bilateral filtering of gray and colored images. Proceedings of IEEE International Conference on Computer Vision,1998:836-846
109. J. Tumblin, H. Rushmeier. Tone reproduction for realistic images. IEEE Computer Graphics and Applications,1993,13(6):42~48
110. Prasun Choudhury, Jack Tumblin. The trilateral filter for contrast images and meshs. Eurographics Symposium on Rendering,2003:1~11
111.刘衡生,沈建冰.基十亮度分层的快速三边滤波器色调映射算法.2011,23(1):85~90
112. Glenn Hines, Zia-ur Rahman, Daniel J. Jobson. DSP implementation of the Retinex image enhancement algorithm. SPIE,2004,5438:13~24
113. Glenn D. Hines, Zia-ur Rahman, Daniel J. Jobson. Real-time enhanced vision system. SPIE, 2005,5802:127~134
114. Glenn D. Hines, Zia-ur Rahman, Daniel J. Jobson. Multi-image registration for an enhanced vision system. SPIE,2003,5108:231-241
115. Glenn Woodell, Daniel J. Jobson, Zia-ur Rahman. Enhancement of imagery in poor visibility conditions. SPIE,2005,5778:673-683
116.王彦臣.基十多尺度数字×光图像增强方法的研究.中国科学院研究生院(长春光学精密机械与物理研究所)博士论文,2005:87~89
117.程凌峰,黄本雄TMS320C64X DSP的程序设计与优化.今,2004,(5):100~03
118.王小刚,张殉,左建政.远程医疗图像增强技术在DM6437上的应用.电子器件,2010,33(1):109~113
119. Nathaniel J. McCaffrey, Francis S. Pantuso. Very low cost real time histogram based contrast enhancer utilizing Fixed-point DSP Processing. SPIE,3303:36~43
120. Jeremiah Golston. Satish Arora, Ratna Reddy. Optimized video decoder architecture for TMS320C64x DSP generation. SPIE,2003,5022:719~726