用户名: 密码: 验证码:
基于支持向量机的文本分类算法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
支持向量机作为一种基于统计学习理论的新型机器学习方法,较好地解决了非线性、高维数、局部极小点等实际问题,是机器学习领域新的研究热点。文本分类是基于内容的自动信息管理的核心技术。文本向量稀疏性大、维数高、特征之间具有较大的相关性,支持向量机对于特征相关性和稀疏性不敏感,处理高维数问题具有较大的优势,因此,支持向量机在文本分类中具有很大的应用潜力。但是,由于文本分类具有类别和样本数目多等特点,因此,支持向量机用于文本分类时仍有许多尚未完全解决的问题。例如,增量学习、兼类分类、训练和分类速度较慢等。本文主要针对支持向量机在文本分类等实际应用中存在的一些问题进行深入研究,主要工作如下:
     1.对支持向量机兼类分类算法进行了研究。针对规模较小、类别数较多的兼类样本集,提出了一种基于l-a-r方法的兼类分类算法。该算法用l-a-r方法训练模糊子分类器,对待分类样本,通过子分类器得到其对应的隶属度向量,依据隶属度向量判定其所属类别。针对规模较大、类别数较少的兼类样本集,提出了一种基于l-a-l方法的兼类分类算法。该算法用l-a-l方法训练模糊子分类器,对于待分类样本,通过子分类器得到其对应隶属度矩阵,依据隶属度矩阵每行元素和判定该样本所属类别。针对规模较大、类别数较多的兼类样本集,提出了一种超球支持向量机兼类分类算法。该算法对每一类样本分别训练球超,通过计算待分类样本到各超球球心的距离确定其类别。实验表明,三种算法都能有效地实现兼类分类,扩展了支持向量机的分类能力。
     2.对支持向量机增量学习算法进行了研究。提出了一种加权类增量学习算法,该算法是对CIL算法的改进,通过加入类权值,解决了因两类训练样本不平衡而造成的小类别分类精度较低的问题。实验证明,与CIL算法相比,该算法在不降低分类速度的前提下,提高了小类别的分类精度。同时,提出了一种新的类增量学习算法,该算法利用超球支持向量机进行分类。增量学习过程中,先对新增类别训练超球,然后对新增样本兼有的历史类别重新训练超球。在很小的样本集,很小的空间代价下实现类增量学习,同时保留了历史训练结果。该算法对单号样本和多标号样本都适用,便于改进和扩充。实验证明,该算法具有较高的训练速度、分类速度和分类精度,增强了支持向量机的学习能力。
     3.对支持向量机快速分类算法进行了研究。在分析了现有支持向量集缩减方法的基础上,提出了一种支持向量机快速分类算法,该算法是对FCSVM算法的改进。该算法利用二分法选取支持向量子集,然后采用变换的方式,用选取的支持向量子集代替全部支持向量进行分类计算。实验结果表明,该算法在不损失分类精度的前提下,进一步缩减了决策函数中的支持向量,提高了支持向量机的分类速度。
     4.对模糊支持向量机训练算法进行了研究。针对大规模训练集,提出了一种利用最大违反对选择工作集训练模糊支持向量机的算法。在此基础上,又提出了一种利用目标函数的二阶近似信息选取工作集训练模糊支持向量机的算法。实验表明,两种算法都能实现模糊支持向量机的快速训练。两种算法相比,第二种算法的训练速度更快,训练样本集规模越大,效果越明显。
Support vector machines (SVMs), as a new machine learning method based on statistical learning theory, have attracted more and more attention and became a hot issue in the field of machine learning, because they can well resolve such practical problems as nonlinearity, high dimension and local minima. Text categorization is a key technique in content-based automatic information management. Text vectors are high dimensional and extremely sparse, and have numbers of relevant features. SVMs are particularly suited for text categorization and have great potential in text categorization, as SVMs are not sensitive to relevant features and sparse data, and have advantages in dealing with high dimensional problems. However, text categorization is characterized with a high number of classes and training examples, therefore there are still many ongoing research issues to SVMs in text categorization application, such as incremental learning, multi-label classification, and lower speed in training and classification etc. This paper mainly focuses on the drawbacks of SVMs in the practical application including text categorization, and the main work is as follows:
     1. Multi-label classification algorithms for SVMs are studied. For the training set with more samples and fewer classes, based on 1-a-1 method, a multi-label categorization algorithm is presented. The algorithm uses 1-a-1 method to train fuzzy sub-classifiers. For the sample to be classified, the sub-classifiers are used to obtain the membership matrix, and then the sum of every row of membership matrix are used to confirm the classes the sample. For the training set with fewer samples and more classes, based on 1-a-1 method, a multi-label categorization algorithm is presented. The algorithm uses 1-a-r method to train fuzzy sub-classifiers. For the sample to be classified, the sub-classifiers are used to obtain the membership vector, and then the membership vector is used to confirm the classes of the sample. For the training set with more samples and more classes, based on hyper sphere, a multi-label categorization algorithm is presented. For every class, the hyper-sphere that contains most samples of the class is trained. For the sample to be classified, the distances from it to the centre of every hyper-sphere are used to confirm the classes of the sample. Experimental results indicate the algorithms have better performance on multi-label classification.
     2. Incremental learning algorithms for SVMs are studied. A weighted class incremental learning algorithm is presented, which improves the CIL algorithm. The algorithm adds the weighs of class to training samples. Experimental results indicate that, compare with CIL algorithm, the method increases precision of the class with fewer samples in the condition that the classification speed does not decrease. Besides, based on hyper sphere SVMs, a new class incremental learning algorithm is presented. The hyper spheres of the new classes are trained, and the primal hyper spheres that they classes exist in new incremental samples are retrained. The class incremental learning is realized in a small training set and a small memory space, the history results are saved at the same time. The algorithm is suitable for both single-label training set and multi-label training set. It is convenience to improvement and extension. Experimental results indicate that the algorithm has a high performance on training speed, classification speed and precision.
     3. Fast classification algorithm for SVMs is studied. Several existing methods of reducing support vectors set are analyzed. Then, a method of reducing support vectors set is presented, which improves FCSVM algorithm. The method uses dichotomy to select a subset of support vectors. After the transformation on the full set of support vectors, the subset of support vectors is used in classification. The experimental results indicate that, compared with FCSVM algorithm, the method reduces the number of support vectors to the greatest grade and increases classification speed of SVMs in the condition that the correct rate does not decrease.
     4. Fast training algorithms for fuzzy SVMs are studied. For the training set with a number of samples, a method of working set selection using maximal violating pair for training fuzzy SVMs is proposed. Besides, a method of working set selection using second order information for training fuzzy SVMs is proposed. Experimental results indicate that two methods realize fast training of fuzzy SVMs. Of the two the latter is far better than the former, especially in the case of large number of training samples.
引文
[1]Sebastiani F.Machine Learning in automated text categorization.ACM Computing Surveys,2002,34(1):1-47.
    [2]Wu A D,Jiang Z X.Word segmentation in sentence analysis.In Proceedings of International Conference on Chinese Information Processing,Beijing,China,1998:169-180.
    [3]应志伟,柴佩琪,陈其晖.文语转换系统中基于语料的汉语自动分词研究.计算机应用,2000,20(2):8-11.
    [4]Salton G,Wong A,Yang C.A vector space model for automatic indexing.Communications of the ACM,1975,18(5):613-620.
    [5]Salton G,Buckley C.Term-weighting approaches in automatic text retrieval.Information Processing and Management,1988,24(5):513-523.
    [6]Yang Y,Pedersen J.A comparative study on feature selection in text categorization.In Proceedings of the 14th International Conference on Machine Learning,Nashville,USA 1997:412-420.
    [7]Mladenic D,Grobelnik M.Feature selection for unbalanced class distribution and naive bayes.In Proceedings of the 16th International Conference on Machine Learning,San Francisco,USA,1999:258-267.
    [8]陈涛,谢阳群.文本分类中的特征降维方法综述.情报学报,2005,24(6):690-695.
    [9]Ng H,Goh W,Low K.Feature selection,perceptron learning,and a usability case study for text categorization.In Proceedings of 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval,New York:ACM Press,1997:67-73.
    [10]周茜,赵明生,扈曼.中文文本分类中的特征选择研究.中文信息学报,2004,18(3):17-23.
    [11]秦进,陈笑蓉,汪维家等.文本分类中的特征抽取.计算机应用,2003,23(2):45-46.
    [12]代六玲,黄河燕,陈肇雄.中文文本分类中特征抽取方法的比较研究.中文信息学报,2004,18(1):26-32.
    [13]黄萱箐,吴立德,石崎洋之等.独立于语种的文本分类方法.中文信息学报,2000,14(6):1-7.
    [14]李辉,史忠植,许卓群.运用文本领域的常识改善基于支持向量机的文本分类器性能.中文信息学报,2002,16(2):7-13.
    [15]Monica R,Yang Y.High-performing feature selection in text categorization.In Proceedings of International Conference on Information and Knowledge Management,Yirginia:ACM Press,2002:659-661.
    [16]Schapire R,Singer Y.BoosTexter:a boosting-based system for text categorization.Machine Learning,2000,39(2/3):135-168.
    [17]Mccallum A,Nigam K.A comparison of event models for naive bayes text classification.In Proceedings of AAAI-98 Workshop on Learning for Text Categorization,Madison:AAAI Press,1998:509-516.
    [18]Han J,Kamber M.Data mining:concepts and techniques.Beijing:Higher Education Press,2001.
    [19]林士敏,田凤占,陆玉吕.贝叶斯学习、贝叶斯网络与数据采掘.计算机科学,2000,27(10):69-72.
    [20]Larkey L S,Croft W B.Combining classifiers in text categorization.In Proceedings of 19th ACM International Conference on Research and Development in Information Retrieval,Zurich,Switzerland,1996:289-297.
    [21]Li Y,Jain A.Classification of text documents.The Computer Journal,1998,41(8):537-546.
    [22]Robertson S E,Harding P.Probabilistic automatic indexing by learning from human indexers.Journal of Documentation,1984,40(4):264-270.
    [23]Yang Y.An evaluation of statistical approaches to text categorization.Journal of Information Retrieval,1999,1:69-90.
    [24]Joachims T.Text categorization with support vector machines:learning with many relevant features.In Proceedings of the lOth European Conference on Machine Learning,Berlin,Germany,1998:137-142.
    [25]Apte C,Damerau F,Weiss S.Text mining with decision rules and decision trees.In Proceedings of the Conference on Automated Learning and Discovery,Pittsburgh,USA,1998:62-68.
    [26]许建华,张学工,李衍达.支持向量机的新发展.控制与决策,2004,19(5):481-484.
    [27]Shin C S,Kim K I,Park M H et al.Support vector machine-based text detection in digital video.In Proceeding of the IEEE Workshop on Neural Networks for Signal Processing,Sydney,Australia,2000:634-641.
    [28]Mustafa H,Doroslovacki M.Digital modulation recognition using support vector machine classitier.In Proceedings of the 38th Asilomar Conference on Signals,Systems and Computers,California,USA,2004:2238-2242.
    [29]Oliveira L S,Sabourin R.Support vector machines for handwritten numerical string recognition.In Proceeding of International Workshop on Frontiers in Handwriting Recognition,Tokyo,Japan,2004:39-44.
    [30]Peng B B,Liu W Y,Liu Y et al.An SVM-based incremental learning algorithm for user adaptation of sketch recognition.International Journal of Pattern Recognition and Artificial Intelligence,2004,18(3):1529-1550.
    [31]Tran Q,Li X,Duan H X.Efficient performance estimate for one-class support vector machine,Pattern Recognition Letters,2005,26(8):1174-1182.
    [32]Justino E,Bortolozzi F,Sabourin R.A comparison of SVM and HMM classifiers in the off-line signature verification.Pattern Recognition Letters,2005,26(9):1377-1385.
    [33]Guo G,Li S,Chan K.Support vector machines for face recognition.Image and Vision Computing,2001,8(19):631-638.
    [34]Ng J,Gong S.Composite support vector machines for detection of faces across views and pose estimation.Image and Vision Computing,2002,20(5):359-368.
    [35]Pang S,Kim D,Bang S.Membership authentication in the dynamic group by face classification using SVM ensemble.Pattern Recognition Letters,2003,24(1):215-225.
    [36]王守觉,曲延锋,李卫军等.基于仿生模式识别与传统模式识别的人脸识别效果比较研究.电子学报,2004,32(7):1057-1061.
    [37]Li Y,Gong S,Sherrah J et al.Support vector machine based multi-view face detection and recognition.Image and Vision Computing,2004,22(5):413-427.
    [38]Dumais S,Platt J,Heckerman D et al.Inductive learning algorithm and representations for text categorization.In Proceedings of the 7th International Conference on Information and Knowledge Management,New York,USA,1998:148-155.
    [39]Ji He,Ah-Hwee Tan,Chew-Lim Tan.A comparative study on chinese text categorization methods.In Proceedings of PRICAI'2000 International Workshop on Text and Web Mining,Melbourne,Australia,2000:24-35.
    [40]李晓黎,刘继敏,史忠植。基于支持向量机与无监督聚类相结合的中文网页分类器.计算机学报,2001,24(1):62-68.
    [41]Shi Y F,Zhao Y P.Comparison of text categorization algorithm.Wuhan University Journal of Natural Sciences,2004,9(5):798-804.
    [42]孙晋文,肖建国.基于SVM的中文文本分类反馈学习技术的研究.控制与决策,2004,19(8):927-930.
    [43]Kim H,Howland P,Park H.Dimension reduction in text tlassification with support vector machines.Journal of Machine Learning Research,2005,6:37-53.
    [44]Liu F Y,Wu K,Zhao H et al,Fast text categorization with min-max modular support vector machines.In Proceeding of International Joint Conference on Neural Networks.Montreal,Quebec,2005:570-575.
    [45]Jack L B,Nandi A K.Fault detection using support vector machines and artifical neural networks,augmented by genetic algorithms.Mechanical Systems and Signal Processing,2002,16(3):373-390.
    [46]忻栋,杨莹春,吴朝晖.基于SVM-HMM混合模型的说话人确认.计算机辅助设计与图形学学报,2002,14(11):1080-1082.
    [47]王欢良,韩纪庆,张磊.基于支持向量机的变异语音分类研究.哈尔滨工业大学学报,2003,35(4):389-393.
    [48]Samanta B.Gear fault detection using artificial neural networks and support vector machines with genetic algorithms.Mechanical Systems and Signal Processing,2004,18(3):625-644.
    [49]Ge M,Du R,Zhang G C et al.Fault diagnosis using support vector machine with an application in sheet metal stamping operations.Mechanical Systems and Signal Processing,2004,18(1):143-159.
    [50]白亮,老松杨,陈剑.基于支持向量机的音频分类与分割.计算机科学,2005,32(4):87-90.
    [51]崔国勤,高文.基于双层虚拟视图和支持向量机的人脸识别方法.计算机学报,2005,28(3):368-376.
    [52]Wang P,Ma Y F,Zhang H J et al.A people similarity based approach to video indexing.In Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing,apos,2003:693-696.
    [53]Lin X.Decision combination in speech metadata extraction.In Proceeding of 37th Asilomar Conference on Signals,Systems and Computers,California,USA,2003:560-564.
    [54]Wang P G,William S Y.Tone recognition of continuous cantonese speech based on support vector machines.Speech Communication,2005,45(1):49-62.
    [55]Xin D,Wu Z.Speaker recognition using continuous density support vector machines.Electronics Letters,2001,37(17):1099-1101.
    [56]任建峰,郭雷,李刚.多类支持向量机的自然图像分类.西北工业大学学报,2005,23(3):295-298.
    [57]付岩,王耀威,王伟强等.SVM用于基于内容的自然图像分类和检索.计算机学报,2003,26(10):1261-1265.
    [58]Wang L,Xue P,Chan K L.Incorporating prior knowledge into svmfor image retrieval.In Proceeding of 17th International Conference on Pattern Recognition,Cambridge,England,2004:981-984.
    [59]Pan C,Yan X G,Zheng C X.Fast training of SVM for color-based image segmentation.In Proceeding of International Conference on Machine Learning and Cybernetics.Shanghai,China,2004:3820-3825.
    [60]Patnaik L M.Daubechies 4 wavelet with a support vector machine as an efficient method for classification of brain images.Journal of Electronic Imaging,2005,14(1):1-7.
    [61]Tsai C F.Training support vector machines based on stacked generalization for image classification.Neurocomputing,2005,64(1):497-503.
    [62]David A,Lerner B.Support vector machine-based image classification for genetic syndrome diagnosis.Pattern Recognition Letters,2005,26(8):1029-1038.
    [63]Reyna R A,Hernandez N,Esteve D et al.Segmenting images with vector machines.In Proceedings of the International Conference on Image Processing,Vancouver,Canada,2000:820-823.
    [64]张学工.关于统计学习理论与支持向量机.自动化学报,2000,26(1):32-42.
    [65]Burges C J C.A tutorial on support vector machines for pattern recognition.Data Mining and Knowledge Discovery,1998,2(2):121-167.
    [66]董春曦,杨绍全,饶鲜等.支持向量机推广能力估计方法比较.电路与系统学报,2004,9(4):86-95.
    [67]Lewis D,Ringuette M.A comparison of two learning algorithms for text categorization.In Proceedings of 3rd Annual Symposium on Document Analysis and Information Retrieval,Las Vegas,USA,1994:81-93.
    [68]Cohen W W,Singer Y.Context-sensitive learning methods for text categorization.ACM Transactions on Information Systems,1999,17(2):141-173.
    [69]Dumais S.Using SVMs for text categorization.IEEE Intelligent Systems,1998,13(4):21-23.
    [70]Ynag Y,Liu X.A re-examination of text categorization methods.In Proceedings of ACM SGIR Conference on Research and Development in Information Retrieval,Berkeley,USA,1999:42-49.
    [71]Tong S,Koller D.Support vector machine active learning with applications to text classification.Journal of Machine Learning Research,2002,2(1):45-66.
    [72]卢增祥,李衍达.交互SVM学习算法及其在文本信息过滤中的应用.清华大学学报(自然科学版),1999,39(7):93-97.
    [73]Joachims T.Transductive inference for text classification using support vector machines.In Proceeding of the 16th International Conference OnMachine Learning,San Francisco,USA,1999:200-209.
    [74]陈毅松,汪国平,董士海.基于支持向量机的渐进直推式分类学习算法.软件学报,2003,14(3):451-460.
    [75]Leopold E,Kindermann J.Text classification with support vector machines:how to represent text in input space?.Machine Learning,2002,46(1/3):423-444.
    [76]Siolas G,Florence D.Support vector machines based on a semantic kernel for text classification.In Proceedings of the International Joint Conference on Neural Networks,Como,Italy,2000:205-209.
    [77]Cristianini N,Shawe-Taylor J,Lodhi H.Latent semantic kernels.Journal of Intelligent Information Systems,2002,18(2/3):127-152.
    [78]Sassano M.Virtual examples for text classification with support vector machines.In Proceedings of the Conference on Empirical Methods in Natural Language Processing,Sapporo,Japan,2003:208-215.
    [79]Liu H.Fuzzy transductive support vector machines for hypertext classification.International Journal of Uncertainty:Fuzziness and Knowledge- Based Systems.2004,12(1):21-36.
    [80]Joachims T.Make large-scale support vector machine learning practical.In Scholkopf B,Burges C,Smola A et al.Advances in kernal methods-support vector learning.Cambridge,MA:MIT Press,1999:185-208.
    [81]Joachims T.Estimating the generalization performance of a SVM efficiently.In Proceedings of the International Conference on Machine Learning,San Francisco,USA,2000:431-438.
    [82]都云琪.基于支持向量机的中文文本自动分类研究.计算机工程,2002,28(11):137-139.
    [83]Shen X,Boutell M,Luo J et al,Multi-label machine learning and its application to semantic scene classification.In Proceedings of the 2004 International Symposium on Electronic Imaging,San Jose,USA,2004:18-22.
    [84]王晔,黄上滕.基于支持向量机的文本兼类标注.计算机工程与应用,2006,42(2):182-185.
    [85]Syed N,Liu H,Sung K.Handing concept drifts in incremental learning with support vector machines.In Proceedings of the First International Conference on Knowledge Discovery and Data Mining,San Diego,USA,1999:317-321.
    [86]曾文华,马健,一种新的支持向量机增量学习算法.厦门大学学报(自然科学版),2002,41(6):687-691.
    [87]萧嵘,王继成,孙正兴,张福炎.一种SVM增量学习算法.南京大学学报(自然科学版),2002,28(2):152-157.
    [88]萧嵘,王继成,孙正兴.一种SVM增量学习算法α-ISVM.软件学报,2001,12(12):1818-1824.
    [89]Ralaivola L,d'Alch-Buc F.Incremental support vector machine learning:a local approach.In Proceedings of the International Conference on Artificial Neural Networks,Vienna,Austria,2001:322-330.
    [90]Cauwenberhs G,Poggio T.Incremental and decremental support vector machine.In:Leen T,Dietterich T,Tresp V et al.Advances in Neural Information Processing Systems.Cambridge,MA:MTT Press,2001.409-415.
    [91]Domeniconi C,Gunopulos D.Incremental support vector machine construction.In Proceeding of First IEEE International Conference on Data Mining,San Jose,USA,2001:589-592.
    [92]Wen Y M,Lu B L.Incremental learning of support vector machines by classifier combining.In Proceeding of 11th Pacific-Asia Conference on Knowledge Discovery and Data Mining,Nanjing,China,2007:904-911.
    [93]Zhan Y,Shen D.Design efficient support vector machine for fast classification.Pattern Recognition,2005,23(2):157-161.
    [94]刘向东,陈兆乾.一种快速支持向量机分类算法的研究.计算机研究与发展,2004,41(8):1327-1332.
    [95]Burges C J C.Simplified support vector decision rules.In Proceedings of the Thirteenth International Conference on Machine Learning,Bari,Italy,1996:71-77.
    [96]Burges C J C,Scholekopf B.Improving speed and accuracy of support vector learning machines.In:Mozer M,Jordan M,Petsche T,et al.Advances in neural information proceeding systems.Cambridge,MA:MIT Press,1997:375-381.
    [97]Downs T,Gates K,Masters A.Exact simplification of support vector solutions.Journal of Machine Learning Research,2001,2(2):293-297.
    [98]Osuna E,Girosi F.Reducing the run-time complexity of support vector machines.In:Scholkopf B,Burges C,Smola A,et al.Advances in kernel methods-support vector learning.Cambridge,MA:MIT Press,1999:271-283.
    [99]Thies T,Weber F.Optimal reduced-set vector for support vector machines with a quadratic kernel.Neural Computation,2004,16(11):1769-1777.
    [100]Keerthi S,Shevade S,Bhattacharyya C et al.Improvements to Platt SMO algorithm for SVM classifier design.Neural Computation,2001,13(3):637-649.
    [101]赵晖,荣莉莉.一种支持向量集合的精简算法.大连理工大学学报,2006,46(5):735-740.
    [102]Platt J.Fast training of support vector machines using sequential minimal optimization.In:Scholkopf B,Burges C,Smola A et al.Advances in kernel methods-support vector learning.Cambridge,MA:M1T Press,1999:185-208.
    [103]Platt J.Using analytic QP and sparseness to speed training of support vector machines.In:Kearns M,Solla S,Cohn D et al.Advances in neural information processing systems.Cambridge,MA:MIT Press,1999:557-563.
    [104]Fan R,Chen P,Lin C.Working set selection using second order information for training support vector machines.Journal of Machine Learning Research,2005,6:1889-1918.
    [105]Nello Cristianini,John Shawe-Taylor著.李国正,王猛,增华军译.支持向量机导论.北京:电子工业出版社,2004.
    [106]邓乃扬,田英杰.数据挖掘新方法—支持向量机.北京:科学出版社,2004.
    [107]Zhu Y S,Wang C D,Zhang Y Y.Experimental study on the performance of support vector machine with squared cost function.Chinese Journal of Computers,2003,26(8):982-989.
    [108]Poutil M,Verri A.Properties of support vector machines.Neural Computation,1998,10(4):955-974.
    [109]Mangasarian O L,Musicant D R.Lagrangian support vector machines.Journal of Machine Learning Research,2001,1:161-177.
    [110]Boser B,Guyon I,Vapnik V.A training algorithm for optimal margin classifiers,ln Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory.New York:ACM Press,1992:144-152.
    [111]Osuna E,Frenud R,Girosi F.An improved training algorithm for support vector machines.In Proceedings of IEEE Workshop on Neural Networks for Signal Processing,New York,USA,1997:276-285.
    [112]Flake G,Lawrence S.Efficient SVM regression training with SMO.Machine Learning,2002,46(1/3):271-290.
    [113]张浩然,韩正之.回归支持向量机的改进序列最小优化算法.软件学报,2003,14(12):2006-2013.
    [114]李建民,张钹,林福宗.序贯最小优化的改进算法.软件学报,2003,14(5):918-924.
    [115]孙剑,郑南宁,张志华.一种训练支撑向量机的改进贯序最小优化算法.软件学报,2002,13(10):2007-2012.
    [116]Vapnik V.The nature of statistical learning.Berlin:Springer,1995.
    [117]Vapnik V.Statistical learning theory.New York:John Wiley&Sons,1998.
    [118]Friess T T,Cristianimi N,Campbell C.The kernel adatron algorithm:a fast and simple learning procedure for support vector machines.In Proceeding of 15th International Conference on Machine Learning,Morgan Kaufman,1998:188-196.
    [119]Mangasarian O L,Musicant D R.Successive over relxation for support vector machines.IEEE Transactions on Neural Networks.1999,10(5):1032-1037.
    [120]Scholkopf B,Smola A,Williamson R C et al.New support vector algorithms.Neural Computation,2000,12(5):1207-1245.
    [121]Scholkopf B,Plat J,Shawe-Taylor J et al.Estimating the support of a high-dimensional distribution.Neural Computation,2001,13(7):1443-1471.
    [122]Tax D,Duin R,Data domain description by support vectors.In Proceeding of European Symposium on Artificial Neural Networks,Belgium,1999:251-256.
    [123]Chew H G,Bogner R E,Lim C C.Dual nu-support vector machine with error rate and training size biasing.In Proceeding of 26th International Conference on Optimization,Techniques and Applications,Salt Lake City,USA,2001:1269-1272.
    [124]Lin C F,Wang S D.Fuzzy support vector machines.IEEE Transactions on Neural Networks,2002,13(2):464-471.
    [125]Suykens J,Vandewalle J,Least square support vector machine classfiers.Neural Proceeding Letters,1999,9(3):293-300.
    [126]Bennett K P.Combining support vector and mathematical programming methods for classification.Advances in kernel methods:support vector learning.Cambridge,MA:MIT Press,1999:307-326.
    [127]Krebel U G.Pairwise classification and support vector machines,advances in kernel methods:support vector learning.Cambridge,MA:MIT Press,1999:255-268.
    [128]Platt J,Cristianini N,Shawe-Taylor J.Large margin dags for multiclass classification,advances in neural information processing systems.Cambridge,MA:MIT Press,2000,12:547-553.
    [129]滕月阳,唐焕文,张海霞.一种新的支持向量机增量学习算法.计算机工程与应用,2004,36:77-80
    [130]王晓丹,郑春颖,吴崇明,张宏达.一种新的SVM对等增量学习算法.计算机应用,2006,26(10):2440-2443.
    [131]毛建洋,黄道.一种新的支持向量机增量算法.华东理工大学学报(自然科学版),2006,32(8):989-991.
    [132]申晓勇,雷英杰,史朝辉,王坚,呼玮.一种SVM增量学习淘汰算法.计算机工程与应用,2007,43(6):171-173.
    [133]李忠伟,张健沛,杨静.基于支持向量机的增量学习算法研究.哈尔滨工程大学学报,2005,26(5):87-90.
    [134]孔锐,张冰.一种快速支持向量机增量学习算法.控制与决策,2005,20(10):1129-1132.
    [135]孔波,刘小茂,张钧.基于中心距离比值的增量支持向量机.计算机应用,2006,26(6):1434-1436.
    [136]李东晖,杜树新,吴铁军.基于壳向量的线性支持向量机快速增量学习算法.浙江大学学报,2006,40(2):202-206.
    [137]王玲,穆志纯,郭辉.一种基于聚类的支持向量机增量学习算法.北京科技大学学报,2007,29(8):855-858.
    [138]李凯,黄厚宽.支持向量机增量学习算法研究.北方交通大学学报,2003,27(5):34-37.
    [139]杨静,张健沛,刘大听.基于多支持向量机分类器的增量学习算法研究.哈尔滨工程大学学报,2006,27(1):103-106.
    [140]朱美琳,杨佩.基于支持向量机的多分类增量学习算法.计算机工程,2006,32(17):77-79.
    [141]Zhang B F,Su J S,Xu X.A class-incremental learning method for multi-class support vector machines in text classification.In Proceedings of International Conference On Machine Learning and Cybernetics,Dal Jan,China,2006:2581-2585.
    [142]李建民,张钹,林福宗.支持向量机的训练算法.清华大学学报(自然科学版),2003,43(1):120-124.
    [143]张浩然,汪晓东.支持向量机的学习方法综述.浙江师范大学学报(自然科学版),2005,28(3):283-288.
    [144]张铃.支持向量机理论与基于规划的神经网络学习算法.计算机学报,2001,24(2):113-118.
    [145]王晓丹,王积勤.支持向量机训练和实现算法综述.计算机工程与应用,2004,40(13):75-78.
    [146]Yang M H,Ahuja N.A geometric approach to train support vector machines.In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition,Hilton Head Island,2000:430-437.
    [147]Hush D,Scovel C.Ploynomial-time decomposition algorithms for support vector machines.Machine Learning,2003,51(1):51-71.
    [148]Chang C C,Hsu C W,Lin C J.The analysis of decomposition methods for support vector machines.IEEE Transactions on Neural Networks.2000,11(4):1003-1008.
    [149]Lin C.On the convergence of the decomposition method for support vector machines.IEEE Transactions on Neural Networks,2001,12(6):1288-1298.
    [150]Huang H P,Liu Y H.Fuzzy support vector machines for pattern recognition and data mining.International Journal of Fuzzy Systems,2002,4(3):826-835.
    [151]Wang Y Q,Wang S Y.A new fuzzy support vector machine to evaluate credit risk.IEEE Transactions on Fuzzy System,2005,13(6):820-831.
    [152]Inoue T,Abe S.Fuzzy support vector machines for pattern classification.In Proceedings of International Joint Conference on Neural Networks,Washington,USA,2001:1449-1454.
    [153]Tsujinishi D,Abe S.Fuzzy least squares support vector machines for multiclass problems.Neural Networks,2003,16(5-6):785-792.
    [154]李昆仑,黄厚宽,田盛丰.模糊多类支持向量机及其在入侵检测中的应用.计算机学报,2005,28(2):274-280.
    [155]Chen P H,Fan R E,Lin C J.A study on SMO-type decomposition methods for support vector machines.IEEE Transactions on NeuralNetworks,2006,17(4):893-908.
    [156]张翔,肖小玲,徐光祜.基于样本之间紧密度的模糊支持向量机方法.软件学报,2006,17(5):951-958.
    [157]Chang C,Lin C.LIBSVM:a library for support vector machines[J/OL].http://www.csie.ntu.tw/~cjlin/libsvm,2005.
    [158]Lee Y,Mangasarian O L.RSVM:reduced support vector machines.In proceedings of the First SIAM International Conference on Data Mining,Chicago,USA,2001:00-07.
    [159]Weston J,Watkins C.Support vector machines for multi-class pattern recognition.In Proceedings of the European Symposium on ArtiEcial Neural Networks,Bruges,Belgium,1999:219-224.
    [160]Hsu C,Lin C J.A comparison of methods for multi-class support vector machines.IEEE Transactions on Neural Networks.2002,13(2):415-425.
    [161]Cheong S,Oh S H,Lee S Y.Support vector machines with binary tree architecture for multi-class classification.Neural Information Processing,2004,2(3):47-51.
    [162]Takahashi F,Abe S.Decision-tree-based multiclass support vector machines.In Proceedings of the Ninth International Conference on Neural Information Processing,Singapore,2002(3):1418-1422.
    [163]Schwenker F.Hierarchical support vector machines for multi-class pattern recognition.In Proceedings of the IEEE Fourth International Conference on Knowledge-Based Intelligence Engineering System and Applied Technologies,Brighton,England,2000:561-565.
    [164]Schwenker F,Palm G.Tree-structured support vector machines for multi-class pattern recognition.In:Kittler J,Roll Fed al.Multiple classifier systems.Springer,2001:409-417.
    [165]Tax D,Duin R.Outliers and data descriptions.In Proceeding of Seventh Annual Conference of the Advanced School for Computing and Imaging,Delft,Holand,2001:234-241.
    [166]李凌均,张周锁,何正嘉等.基于支持向量数据描述的机械故障诊断研究.西安交通大学学报,2003,37(9):910-913.
    [167]Maneivitz L M,Yousef M.One-class SVMs for document classification.Jounal of Machine Leaning Reasearch,2002,(2):139-154.
    [168]唐发明,王仲东,陈绵云.支持向量机多类分类算法研究.控制与决策,2005,20(7):746-749.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700