用户名: 密码: 验证码:
脉冲耦合神经网络关键特性的理论分析及应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
脉冲耦合神经网络(PCNN, Pulse Coupled Neural Network)是一种有着生物学背景的新一代人工神经网络模型,它模拟了哺乳动物视觉皮层中神经元的信息处理机制。它在图像处理等领域得到了很好的运用,并显示了独特的优越性。然而,PCNN模型一直以来缺乏系统地理论分析,这使其在具体应用中面临神经元参数难以自动设定的问题。因此,本文对脉冲耦合神经网络的几个关键特性进行了深入地理论分析,并将其理论分析结果应用到了实际应用中。总的说来,本文所做研究工作的内容及进展主要在以下几个方面:
     一、在PCNN和S-PCNN模型中,对神经元的动力学特性进行了定性的数学分析。在非外部脉冲耦合的自激励脉冲发放情形下,围绕神经元脉冲发放的周期和时间相位,给出了神经元自激励脉冲发放周期的数学描述;给出了PCNN神经元进入稳定自激励脉冲发放周期时的开始时间相位的数学描述;给出了S-PCNN神经元自激励脉冲发放时间相位的数学描述。在外部脉冲耦合情形下,给出了神经元的捕获期和不应期对应的数学描述。实验仿真验证了有关分析结论的正确性。
     二、以动力学特性分析结果为基础,对神经元脉冲统计特性进行了分析,并将其理论成果应用于人脸识别和彩色图像增强。在理论分析中,围绕两种形式的脉冲统计方法:振荡时间序列OTS和脉冲振荡频图OFG,对OTS的不变性进行了分析,并从捕获特性角度将OTS分解为自激励OTS (S-OTS)和捕获性OTS (C-OTS);对OFG的区域特征聚类特性进行了分析,进而提出利用振荡频图序列OFGS来作为区域聚类演化的一种描述;给出了PCNN神经元参数的一种估计方法。在理论结果的应用中,利用PCNN提取的OTS特征实现了人脸识别;利用S-PCNN提取的OTS的分解特征X-OTS (OTS、 C-OTS和S-OTS)提出了一种人脸识别方法;基于S-PCNN和OFGS,结合高维空间中的矢量运算方法,提出了一种有效的彩色图像增强算法。实验仿真结果验证了相关应用的有效性。
     三、以动力学特性分析结果为基础,对神经元脉冲同步振荡相关特性进行了分析,并将其理论成果应用于图像分割和椒盐噪声滤波。在理论分析中,给出了S-PCNN神经元产生同步振荡的必要条件,进而解释了PCNN神经元实现脉冲同步振荡的原因;对神经元脉冲同步振荡的时空相关性进行了分析;对利用神经元脉冲同步振荡的时间相位进行特征聚类的局限性进行了分析,进而分析了脉冲振荡频率进行特征聚类的合理性。在理论结果的应用中,利用PCNN神经元的脉冲振荡频率信息,提出了一种有效的图像分割方法,其中给出了一种神经元参数估计方法;利用S-PCNN神经元的脉冲同步振荡相关的原理实现了椒盐噪声的检测,其中给出了一种神经元的参数估计方法,同时针对噪声检测后的滤波需求,提出了扩展窗口中值滤波EWMF方法。实验仿真结果验证了相关应用的有效性。
     四、以动力学特性分析的结果为基础,对神经元的脉冲波传播特性进行了分析,并将理论结果应用于多约束QoS路由求解。在理论分析中,给出了S-PCNN网络能形成脉冲波传播的环境条件和参数约束条件;然后根据参数约束条件的数学描述,实验分析了链接权和链接强度对脉冲波传播特性的影响。在理论结果的应用中,为了利用脉冲波传播来求解路由优化,提出了竞争型脉冲耦合神经网络CPCNN模型,并推导了该模型神经元参数的约束条件,进而基于脉冲波任务的产生、分解和状态转换理论,实现了多约束QOS路由问题的求解。实验仿真验证了相关应用的有效性。
Pulse Coupled Neural Network (PCNN) is a new generation of artificial neural network simulated the mechanism of information processing in the neurons of mammalian visual cortex. The PCNN has been successfully applied in image processing and other areas, and shows the unique superiority. However, the applications using PCNN always face the difficulty of neuron parameters estimation due to lack of fairly through theoretical analysis for PCNN. So this dissertation will theoretical analyze several characteristics for PCNN, and apply the analysis results to some practical applications. On the whole, the content and progress of the research work mainly in the following four aspects.
     First, in the PCNN and the simplified PCNN (S-PCNN), the dynamic characteristics of neurons have been qualitatively analyzed. In a situation that a neuron without external coupling pulses firing self-stimulating pulses, the mathematical descriptions of the self-stimulating pulse period for PCNN and S-PCNN neurons, of the initial firing-pulse time phase in the state self-stimulating pulse period for PCNN neurons, and of the pulse time phase for S-PCNN neurons, have been obtained. On the other hand, in a situation that a neuron receives external coupling pulses, the mathematical descriptions of the captures-period and the refractory-period have been obtained. The experimental simulation to verify the correctness of the analysis conclusions.
     Second, based on the analysis of the dynamic characteristics, analyzed the pulse statistical characteristics of neurons, and applied the theoretical analysis results to face recognition and color image enhancement. In the theoretical process, around two pulse statistical methods:Oscillation time sequences (OTS) and pulse oscillation frequency map (OFG), analyzed the invariance of the OTS, and divided the OTS into self-stimulating OTS (S-OTS) and captured OTS (C-OTS). Analyzed the clustering characteristics of regional features for the OFG, and using OFG sequences (OFGS) as a description of the evolution process of features clustering. Given a PCNN neuron parameters estimation method. In the practical applications, using the OTS in PCNN to realize face recognition, and using the X-OTS (OTS, C-OTS and S-OTS) in S-PCNN to realize face recognition. Based on S-PCNN and OFGS, combined with high-dimensional space vector operation, proposed an effective color image enhancement algorithms. Simulation results verify the validity of the applications.
     Third, based on the analysis of the dynamic characteristics, analyzed the pulse oscillation correlative characteristics of neurons, and applied the theoretical analysis results to image segmentation and pulse noise filtering. In the theoretical process, given the necessary conditions of S-PCNN neurons firing synchronous pulses, and then obtained the causes of PCNN neuron realizing pulse synchronous oscillation. Analyzed the temporal correlations of neurons pulsing, and the limitation of using pulse oscillation time phase as the description feature clustering, and analyzed the reasonableness of using pulse oscillation frequency as the description of feature clustering. In the practical applications, based on the pulse oscillation frequency in PCNN, proposed an efficient image segmentation method with a neuron parameters estimation method. Used the synchronous pulse oscillation correlation in S-PCNN to realize impulse noise detection wih a neuron parameters estimation method and a filtering method called extended window median filter (EWMF). Simulation results verify the validity of the applications.
     Fourth, based on the analysis of the dynamic characteristics, analyzed the pulse wave propagation characteristics of neurons, and applied the theoretical analysis results to multi-constrained QoS route problem. In the theoretical process, given the environment conditions and the parameters conditions constrained for occurring pulse wave propagation in S-PCNN, then based on the parameters condition constrained, using experimental methods to analyze the influences on pulse wave propagation characteristics for parameters. In the applications of the theoretical results, in order to solve route optimization using pulse wave propagation, proposed competitive pulse coupled neural network (CPCNN) model, and derived parameters condition constrained for neurons, and then combined with the theory of pulse task generation, decomposition and state transition, implemented the solution of multi-constrained QoS route problem. Simulation results verify the validity of the applications.
引文
[1]R Eckhorn, R Bauer, M Brosch, et al. Coherent oscillations:A mechanism of feature linking in the visual cortex? [J]. Multiple Electrode and Correlation Analysesnin the Cat Biological Cybernetics,1988,12(60):121-130.
    [2]R Eckhorn, H J Reitboeck, M Ardnt, et al. Feature Linking via stimulus-evoked oscillations:Experimental results from cat visual cortex and functional implications from a network model [J]. Neural Networks, IJCNN,1989, 6(1):723-730.
    [3]R Eckhorn, H J Reitboeck, M Arndt, P Dicke. Feature linking via synchronization among distributed assemblies:Simulation of result from cat visual cortex [J]. Neutral Comput,1990,2(3):293-307.
    [4]Johnson J L. Pulse-Coupled Neural Nets:Translation, rotation, scale, distortion, and intensity signal invariances for images [J]. Appl.,1994,33(26):6239-6253.
    [5]A L Hodgkin, A F Huxley. A quantitative description of new membrance current and its application to condition and exciation in nerve [J]. J. Physical.1952,117: 500-544.
    [6]FitzHugh R.Impulse and physiological states in theoretical models of nerve membrane [J]. Biophysics J,1961,1:445-466.
    [7]Charlesm M Gray, Peter Konig, Andreas K Engel, Wolf Singer. Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properities [J]. Nature,1989,3(23):334-337.
    [8]顾晓东,余道衡PCNN的原理及其应用[J].电路与系统学报,2001,6(3):45-50.
    [9]H S Ranganath, G Kuntimad, J L Johnson. Pulse coupled networks for image processing [C]. Proceedings of IEEE Southeast Raleih, NC,1995,3(26-29):37-43.
    [10]Lzhikevich, M Eugene. Theoretical foundations of pulse-coupled models [C]. Proceedings of the 1998 IEEE International Joint Conference on Neural Networks, Anchorage, AK, USA,1998,3:2547-2550.
    [11]Lzhikevich, M Eugene. Class 1 neural excitability, conventional synapses, weakly connected networks, and mathematical foundations of pulse-coupled models [J].IEEE Transactions on Neural Networks,1999,10(3):499-507.
    [12]P C Bressloff, S Coombes. Symmetry and phase-locking in a ring of pulse-coupled oscillators with distributed delays [J]. Physica D,1999,126:99-122.
    [13]H. Haken. Effect of delay on phase locking in a pulse coupled neural network [J]. The European Physical Journal B,2000,18(3):545-550
    [14]A N Burkitt, G M Clark. New recnique for analyzing integrate and fire neurons [J]. Neurocomputing,1999,26-27:93-99.
    [15]余江波,陈后金,余巍等.脉冲耦合神经网络在图像处理中的参数确定[J].电子学报,2008,36(1):81-85,99.
    [16]H S Ranganath, G Kuntimad. Image segmentation using pulse coupled neural networks [C]. IEEE Word Congress on Computational Intelligence,1994,2(27): 1285-1290.
    [17]G Kuntimad, H S Ranganath. Perfect image segmentation using pulse coupled neutral networks[J]. IEEE Trans on Neutral Networks,1999,10(3):591-598.
    [18]姚畅,陈后金,李居朋.改进型脉冲耦合神经网络在图像处理中的动态行为分析[J].自动化学报,2008,34(10):1291-1297.
    [19]R D Stewart, I Fermin, et al. Region growing with pulse-coupled neural networks: an alternative to seeded region growing[J]. IEEE Trans On Neural Networks,2002, 13(6):1557-1562.
    [20]毕英伟,邱天爽.一种基于简化PCNN的自适应图像分割方法[J].电子学报,2005,33(4):647-650.
    [21]Y Chen, S K Park, Y, Ma et al. A new automatic parameter setting method of a simplified PCNN for image segmentation [J]. Neural Networks, IEEE Transactions on,2011,22(6):880-892.
    [22]马义德,戴若兰,李廉.一种基于脉冲耦合神经网络和图像熵的自动图像分割方法[J].通信学报,2002,23(1):46-51.
    [23]聂仁灿,周冬明,赵东风.基于Unit-Linking PCNN和图像熵的图像分割新方[J].系统仿真学报,2008,20(1):222-227.
    [24]A L Barbieri, G F De Arruda, F A Rodrigues, et al. An entropy-based approach to automatic image segmentation of satellite-images[J]. Physica A:Statistical Mechanics and its Applications,2011,390(3):512-518.
    [25]S Wei, Q Hong, M Hou. Automatic image segmentation based on PCNN with adaptive threshold time constant [J]. Neurocomputing,2011,74(9):1485-1491.
    [26]N Yang, H Chen, Y LI, et al. Coupled parameter optimization of PCNN model and vehicle image segmentation[J]. Journal of Transportation Systems Engineering and Information Technology,2012,12(1):48-54.
    [27]X D Yue, D Q Miao, N Zhang, et al. Multiscale roughness measure for color image segmentation[J]. Information Sciences,2012,216:93-112.
    [28]C Gao, D Zhou, Y Guo. Automatic iterative algorithm for image segmentation using a modified pulse-coupled neural network[J]. Neurocomputing,2013.
    [29]M Li, W Cai, Z Tan. A region-based multi-sensor image fusion scheme using pulse-coupled neural network [J]. Pattern Recognition Letters,2006,27(16): 1948-1956.
    [30]苗启广,王宝树.一种自适应PCNN多聚焦图像融合新方法[J].电子与信息学报,2006,28(3):466-470.
    [31]闫敬文,许建航,屈小波.改进基于小波变换的PCNN图像融合算法[J].厦门理工学院学报,2006,14(4):13-18.
    [32]H Wei, L J Zhong. Multi-focus image fusion using pulse coupled neural network [J]. Pattern Recognition Letters, In Press, Corrected Proof, Available online 8 February 2007.
    [33]Z B Wang,Y D Ma.Medical image fusion using m-PCNN [J]. Information Fusion, 2008,9(2):176-185.
    [34]X B Qu, J W Yan, H Z Xiao, et al. Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain[J]. Acta Automatica Sinica,2008,34(12):1508-1514.
    [35]S Y Yang, M Wang, Y X Lu et al. Multi-focus image fusion using pulse coupled neural network [J]. Signal Processing,2009,89:2596-2608.
    [36]Y Chai, H F Li, M Y Guo. Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain[J].Optics Communications,2011,284(5),1146-1158.
    [37]邹北骥,胡艺龄,辛国江.基于小波分解和PCNN的图像融合方法[J].计算机工程与科学.2011,33(2):102-107.
    [38]李建锋,邹北骥,辛国江,李玲芝,蔡美玲.一种自适应PCNN图像融合方法[J].中南大学学报.2011,42(7):2004-2010.
    [39]S Y Yang, M Wang, L H Jiao. Contourlet hidden Markov Tree and clarity-saliency driven PCNN based remote sensing images fusion. Applied Soft Computing [J], 2012,12(1):228-237.
    [40]X Luo, J Zhang, Q Dai. A regional image fusion based on similarity characteristics [J]. Signal Processing,2012,92(5):1268-1280.
    [41]J Lang, Z Hao. Novel image fusion method based on adaptive pulse coupled neural network and discrete multi-parameter fractional random transform[J]. Optics and Lasers in Engineering,2014,52:91-98.
    [42]W Kong, Y Lei. Technique for image fusion between gray-scale visual light and infrared images based on NSST and improved RF[J]. Optik-International Journal for Light and Electron Optics,2013,124 (23):6423-6431.
    [43]L Xu, J Du, Q Li. Image Fusion Based on Nonsubsampled Contourlet Transform and Saliency-Motivated Pulse Coupled Neural Networks[J]. Mathematical Problems in Engineering,2013,1-10.
    [44]B Zhang, C Zhang, J Wu, et al. A medical image fusion method based on energy classification of BEMD components [J]. Optik-International Journal for Light and Electron Optics,2013,125 (1):146-153.
    [45]J. L. Johson. Pulse-coupled neural nets:translation, rotation, scale, distortion, and intensity signal invariance for images, Applied Optics,33(26) (1994) 6239-6253.
    [46]C. Raul. Murean. Pattern recognition using pulse-coupled neural networks and discrete Fourier transforms, Neuro Computing 51 (2003) 487-493.
    [47]Y D Ma, L Liu, K Zhan et al. Pulse-coupled neural networks and one-class support vector machines for geometry invariant texture retrieval [J]. Image and Vision Computing 2010,28(11):1524-1529.
    [48]张绍堂,杨丽云.基于PCNN的景象匹配和图像拼接[J].计算机仿真,2009,11:061.
    [49]何佳若,曾向阳.声信号的可视化特征提取方法[J].电声技术,2011,35(7):61-63.
    [50]石美红,张军英,朱欣娟等.基于PCNN的图像高斯噪声滤波的方法[J].计算机应用,2002,26(2):1-4.
    [51]顾晓东,程承旗,余道衡.结合脉冲耦合神经网络与模糊算法进行四值图像去噪[J].电子与信息学报,2003,25(12):1585-1590.
    [52]马义德,史飞.一种基于脉冲耦合神经网络的脉冲噪声滤波器设计[J].生物医学工程杂志,2004,21(6):1019-1023.
    [53]L P Ji, Y Zhang. A mixed noise image filtering method using weighted-linking PCNNs. Neurocomputing,2008,71(13-15):2986-3000.
    [54]D Zhang, T H Nishimura. Pulse coupled neural network based anisotropic diffusion method for 1/f noise reduction[J]. Mathematical and Computer Modelling,2010, 52(11):2085-2096.
    [55]H Y Li, Y Ma, Y F Zhang, et al. Noise and speckle reduction in ultrasound Doppler blood flow spectrograms by using MP-PCNN][J]. Sheng wu yi xue gong cheng xue za zhi= Journal of biomedical engineering= Shengwu yixue gongchengxue zazhi,2011,28(5):886.
    [56]X D Gu, D H Yu. Image Contrast Enhancement Using Rough Set and Pulse Coupled Neural Network.The 7th annual joint workshop on modern electronic technology and applications,Kyungpook National University, Taegu, Korea and Peking University, China,2002,11-120.
    [57]张军英,卢涛,通过脉冲耦合神经网络来增强图像.计算机工程与应用,2003.19:93-95.
    [58]李国友,李惠光,吴惕华,董敏.PCNN和Otsu理论在图像增强中的应用[J].光电子·激光,2005,16(3)358—362.
    [59]石美红等,一种新的低对比度图像增强的方法,计算机应用研究,2005,1:235-238.
    [60]武尔维,周冬明,赵东风,聂仁灿.基于双层PCNN的多级灰度图像增强[J].云南大学学报(自然科学版),2007,29(5):33-38.
    [61]H J Caufield, J M Kinser. Finding shortest path in the shortest time using PCNN's [J]. IEEE Trans On Neural Networks,1999,10(3):604-606.
    [62]张军英,王德峰,石美红.输出-阈值耦合神经网络及基于此的最短路问题求解[J].中国科学(E),2003,33(6):522-530.
    [63]张军英,苏健.一种求解TSP问题的新型人工神经网络方法[J].计算机仿真,2004,21(6):118-121
    [64]顾晓东,余道衡,张立明.时延PCNN及其用于求解最短路径[J].电子学报,2004,32(9):1441-1443
    [65]宋寅卯,袁端磊.基于PCNN的迷宫最短路径求解算法[J].电路与系统学报,2005,10(3):72-75.
    [66]纪其进.一种基于脉冲耦合神经网络的最短路径算法[J].小型微型计算机系 统,2005,26(5):827-829.
    [67]Q Hong, Y Zhang. A new algorithm for finding the shortest paths using PCNNs [J]. Chaos, Solitons & Fractals,2007,33(4):1220-1229.
    [68]D M Zhou, R C Nie, D F Zhao. A new algorithm for finding the shortest path tree using competitive pulse coupled neural network[C]. ICIC 2008, Springer-Verlag Berlin Heidelberg,2008,5227:9-18.
    [69]X Li, Y Ma, X Feng. Self-adaptive autowave pulse-coupled neural network for shortest-path problem[J]. Neurocomputing,2013.
    [70]D M Zhou, R C Nie, D F Zhao. Analysis of autowave characteristics for competitive pulse coupled neural network and its application. Neurocomputing, 2009,72(10-12):2331-2336.
    [71]赵丽红,孙宇舸,蔡玉等.基于核主成分分析的人脸识别[J].东北大学学报(自然科学版,2006,27(8):847-850.
    [72]伍行素,余为益.改进的2DPCA人脸识别算法[J].计算机系统应用,2011,20(6):21-215.
    [73]袁宝华,王欢,任明武.LBP与LNMF特征融合的人脸识别[J].计算机工程与应用,2013,49(5):166-169.
    [74]郭志强.基于子空间分析的人脸识别算法研究[D].武汉理工大学,2011,100.
    [75]王玮,黄非非,李见为等.使用多尺度LBP特征与识别人脸[J].光学精密工程,2009,16(4):696-705.
    [76]程万里,李伟生.基于Gabor-2DLDA方法的人脸识别研究[J].计算机工程与应用,2008,44(35):179-181.
    [77]王守觉,王柏南.人工神经网络的多维空间几何分析及其理论[J].电子学报,2002,30(1):1-4.
    [78]张熠东,王水花,周振宇等.基于HVS与PCNN的彩色图像增强[J].中国科学,2010,40(7):909-924.
    [79]R W Rodieck, J J Stone. Analysis of receptive field of cat retina ganglion cells. Journal of Neurophysiology,1965,28:833-849.
    [80]YEN J C, CHANG F J, etc. A new criterion for automatic multilevel thresholding [J]. IEEE Trans on Image Processing,1995,4(3):233-260.
    [81]张素兵,吕国英,刘泽民.基于蚂蚁算法的QoS路由调度算法[J].电路与系统学 报,2000,5(1):1-5.
    [82]FENG X, LI J Z, WANG J V, et al. QoS routing based on genetic[J]. Computer Communications,1999,22 (15-16):1392-1399.
    [83]CHOTIPATP, GOUTAMC, NORIOS. Neural network approach to multicast routing in real-time communication networks[A].Proc International Conference on Network Protocols [C].1995,332-339.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700