用户名: 密码: 验证码:
基于内容的视频情感语义分析关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着多媒体技术的不断发展,数字视频近年来逐渐成为信息记录和传播的一种重要方式。传统的人工标注方法不能适应急速增长的视频数据分类和检索需求。在这种情况下,人们开始研究基于内容的视频语义分析技术,希望通过建立视频低层物理特征空间和高层语义空间的映射关系,从视频内容中提取能反映人类主观概念中的语义信息,自动对视频语义内容进行标注。情感语义是视频中最高层的语义信息,如何提取和描述视频所表达的情感语义信息是目前视频语义分析中重要研究方向之一。
     基于内容的视频情感语义分析有很高的技术综合性,其主要的关键技术包括情感语义模型构建、认知层语义分析技术、情感层语义分析技术以及基于情感内容的视频检索技术等,本文在这几方面做了深入的分析和研究,所做工作及主要创新成果如下:
     (1)设计了一种新的情感空问模型。根据情感产生的基本原理以及视频情感信息的特点,用“情感直方图”的方式来表达视频情感空间。该模型能够有效地进行情感类型描述和情感强度表达。
     (2)设计了一种基于本体论的视频情感语义分析框架。根据视频语义内容呈现的基本规律和本体论的研究成果,对视频本体的概念进行了定义,建立了一套函数体系和推理关系,并根据此框架设计了视频情感语义分析的整体流程。
     (3)提出了一套认知层语义分析的算法,认知层语义分析是情感识别的基础和重要步骤,本文对认知层语义分析中的视频对象分割算法、视频对象识别分类算法以及对象运动轨迹检测算法进行了研究,提出了一套改进的算法并进行了对比分析。
     (4)提出了视频“情感语义对象”的概念,分析了人类视觉系统(HVS)的注意机制,对视频内能够引起人们注意并产生情感反应的主要对象进行了识别和判定。将人工神经网络技术引入视频情感分析领域,构建了一种从认知层语义到情感层语义的映射模型。
     (5)设计了一套基于情感内容的视频检索系统,利用面向对象技术和关系型数据库技术,将视频分析获取的情感层语义内容采用结构化的方式进行存储和组织,提供有效的用户接口实现基于情感内容的视频检索。
With the continuous development of multimedia technology, digital video in recent years has gradually become an important way of information documentation and dissemination. The traditional manual annotation methods can not adapt to the rapid growth of video data classification and retrieval needs. In this case, people began to study the content-based video semantic analysis technology, through the establishment of the video low-level physical characteristics of space and high-level semantic space mapping, obtain the video semantic content description of video automatically. Extracted from the video content can reflect the human subjective concept of semantic information, how to describe the emotion expressed by the video information are becoming the new focus of the video content analysis, is one of the important research directions in the video content analysis.
     Content-based video emotional semantic analysiscombines a number of technologies, the major critical technologies including emotional semantic modeling, cognitive level semantic analysis, emotional layer semantic analysis and the emotional content-based video retrieval technique, this paperthese aspects in-depth analysis and research, the work done and the major innovations are as follows:
     (1) Design a new emotional space model.By the basic theory and the video characteristics of emotional information, usingemotional histogram way to express the emotions generated video emotional space, the model can effectively carry out the description of the emotional type and emotionalintensity of expression.
     (2) Design ontology-based video emotionalsemantic analysis framework.By the basic law of semantic content presented in the video and the research results of the ontology, this paper deifned the concept of the video ontology, and built a function system and reasoning relations. According to this framework,this paperdesign a video emotional semantic analysis of the overall process.
     (3) Proposed a cognitive level semantic analysis algorithms, cognitive level semantic analysis is an important step of the emotion recognition, the cognitive level semantic analysis include video object segmentation algorithm, the classification algorithm of video object recognition and object tracking algorithm, the study proposed a set of improved algorithms and thus a comparative analysis.
     (4) Proposed the concept of the video "emotional semantic object". This paper analyzes the human visual system (HVS) attention mechanisms, and to draw attention and generate emotional response to the main object identification to determine the video. Artificial neural network technology into the video field of sentiment analysis, and constructed a set of semantics from a cognitive layer to the emotional layer of semantic mapping model.
     (5) Designed a set of emotional content-based video retrieval system. Using object-oriented technology and relational database technology, the semantic content of the video analysis to obtain the emotional layer structured way to store and organize, to provide an effective user interface search video affective content.
引文
[1]Alan Hanjalic. Content-Based Analysis of Digital Video, Springer,2004.
    [2]林新棋.基于模糊理论的电影情感识别[学位论文].北京:北京邮电大学,2009.
    [3]严严,章毓晋.基于视频的人脸识别研究进展,计算机学报,2009,32(5):878-884
    [4]高隽,谢昭.图像理解理论与方法,北京:科学出版社,2009
    [5]Lin Xinqi, Wen Xiangming, Lu Zhaoming. Video Affective Content Recognition Based on Film Grammars and Fuzzy Evaluation,2008 International Conference on MultiMedia and Information Technology.2008:264-267
    [6]Sun K and Yu J Q. Video affective content representation and recognition usingvideo affective tree and Hidden Markov Model, the secondInternational Conference on Affective Computing and Intelligent Interaction,Lisbon, Portugal,2007:594-605.
    [7]Hong-Bong Kang. Emotional Event Detection Using Relevance Feedback. International Conference on Image Processing,Vol.1,2003,:14-17
    [8]Chen Xin,ZhangChengcui. Human-Centered Multiple Instance Learning Framework for Semantic Video Retrieval. IEEE Transactions On Systems, Man, And Cybernetics—Part C:Applications And Reviews, Vol.39, No.2, March 2009:228-233
    [9]Picard情感计算,北京:北京理工大学出版社,2005.4
    [10]罗森林,潘丽敏.情感计算理论与技术,系统工程与电子技术,2003,25(7):905-909
    [11]Erwan Baynaud. Evolving MMedia Computer Interfaces—Thinking of a Picture and Finding it. MMEDIA 2009-July 20-25,2009-Colmar, France
    [12]孙凯.面向观众的电影情感内容表示与识别方法研究[学位论文],武汉:华中科技大学,2009
    [13]Yao, B.Z.; Xiong Yang; Liang Lin; Mun Wai Lee;etc.I2T:Image Parsing to Text Description,Proceedings of the IEEE,Vol.98, Issue.8,2010:1485-1508
    [14]王国江,王志良,杨国亮,王玉洁,陈锋军.人工情感研究综述.计算机应用研究,2006(7):7-11
    [15]李凡长,钱旭培,谢林等著.机器学习理论及应用.合肥:中国科学技术大学出版社.2009.10
    [16]何培舟.基于内容的图像垃圾邮件过滤关键技术研究[学位论文],北京:北京邮电大学,2010
    [17]Alan Hanjalic and Xu Li-Qun. Affective Video Content Representation andModeling. IEEE transactions on multimedia,Vol.7,No.1,2005,PP:143-154
    [18]Sutjipto Arifin and Peter Y. K. Cheung. Affective Level Video Segmentation by Utilizing thePleasure-Arousal-Dominance Information, IEEE Transactions On Multimedia, Vol.10, No.7, November 2008:1325-1341
    [19]Serene Banerjee. Low-Power Content-Based Video Acquisitionfor Super-Resolution Enhancement, IEEE TRANSACTIONS ON MULTIMEDIA, VOL.11, NO.3, APRIL 2009:455-464
    [20]谷学静,王志良,魏哲华等.基于人工心理理论的情感模型构建方法研究,微计算机信息,2006,22(2):264-266
    [21]王志良.人工心理与人工情感.智能系统学报,2006,1(1):38-43.
    [22]刘烨,陶霖密,傅小兰.基于情绪图片的PAD情感状态模型分析,中国图像图形学报,2009,14(5):753-758
    [23]李清勇,胡宏,施智平等.基于纹理语义特征的图像检索研究,计算机学报,2006,29(1):116-123
    [24]苑丽红,付丽,杨勇等.灰度共生矩阵提取纹理特征的实验结果分析,计算机应用,2009,29(4):1018-1021
    [25]毛峡,丁玉宽,牟田一弥.图像的情感特征分析及其和谐感评价.电子学报,2001(12A):1923-1927
    [26]Hayashi T,Hagiwara M. Image query by Impression words—The IQI System Consumer Electronics. IEEE Transactions on,1998,44(2):347-352.
    [27]方勇.基于内容的视频检索关键技术研究[学位论文].上海:上海交通大学,2006.
    [28]钟善君.基于内容的视频检索关键技术研究[学位论文].杭州:浙江理工大学,2007.
    [29]魏维等.多层视频语义概念分析与理解,计算机辅助设计与图形学学报,2008,20(1):85-92
    [30]贺莉娜.视频语义特征提取的研究[学位论文],北京:北京交通大学,2008年
    [31]Chengcui Zhang,Xin Chen,Liping Zhou,Wei-Bang Chen,Semantic retrieval of events from indoor surveillance video databases,Pattem Recognition Letters 30 (2009) 1067-1076
    [32]Bai,Liang; Lao, Songyang; Zhang, Weiming; Jones, Gareth J.F.; Smeaton, Alan F. A semantic event detection approach for soccer video based on perception concepts and finite state machines,8th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2007
    [33]William Gibson. Pattern Recognition. Berkley Publishing Group 2004
    [34]Arifin S and Cheung P Y K. Towards affective level video application:a novelFPGA-based video arousal content modeling system. IEEEInternational Conference on Field Programmable Logic and Applications,200,1-4
    [35]Alan Hanjalic. Adaptive Extraction of Highlights from a Sport Video Based onExcitement Modeling. IEEE Transactions on Multimedia,2005,7(6):1114-1122
    [36]文军,谢毓湘,老松杨.足球比赛视频中的精彩镜头分析方法.计算机工程,2004,30(6):159-161.
    [37]Bo-Wei Chen, Jia-Ching Wang, and Jhing-Fa Wang. A Novel Video Summarization Based on Miningthe Story-Structure and Semantic RelationsAmong Concept Entities, IEEE Transactions On Multimedia,2009,11(2):295-312
    [38]Gabriel J. Brostow, Julien Fauqueur, Roberto Cipolla. Semantic object classes in video: A high-definition ground truth database. Pattern Recognition Letters 30 (2009) 88-97
    [39]王慧芳,刘琳.图像检索技术中情感计算模型研究.天津师范大学学报,2006,26(1):66-69
    [40]王上飞,王煦法.图像情感检索研究的进展与展望,电路与系统学报,2005,10(4):102-109
    [41]郭戈.数字视频语义信息提取与分析[学位论文],解放军信息工程大学,2010.
    [42]张良,周长胜.基于内容的视频语义分析关键技术,电子科技,2011,24(10):111-114
    [43]赵涓涓.图像视觉特征与情感语义映射的相关技术研究[学位论文],太原理工大学,2010
    [44]王伟凝,余英林.图像的情感语义研究进展,电路与系统学报,2003,8(5):101-109
    [45]冯玉爽.基于视觉的情感推理研究[学位论文],哈尔滨理工大学,2009
    [46]李晋.图像视觉特征与情感语义映射方法的研究[学位论文],太原理工大学,2008
    [47]郭戈;平西建;视频情感语义分析—类型-强度分解法,计算机应用,2010,30(6):1704-1707
    [48]C Colombo, A Del Bimbo, P Pala. Semantics in Visual Information Retrieval. IEEE Multimedia,1999:6(3):38-53.
    [49]Qasim Iqbal, J K Aggarwal. Retrieval By Classification of Images Containing Large Manmade Objects Using Perceptual Grouping.Pattern Recognition,2002,35(7): 1463-1479.
    [50]Su,Ja-Hwung; Huang,Yu-Ting; Yeh,Hsin-Ho; Tseng, Vincent S. Effective content-based video retrieval using pattern-indexing and matching techniques,Expert Systems with Applications,2010,37(7),p5068-5085
    [51]焦丽鹏.基于模糊近似推理的图像情感注释[学位论文],太原理工大学,2007
    [52]付亚丽.情感语义图像检索研究[学位论文],河南大学,2009
    [53]张良.一种视频关键语义对象的检测方法,北京信息科技大学学报(自然科学版),2010,25(6):75-78
    [54]郑烇,肖碧宇.基于MPEG-7的视频检索系统的设计与实现.计算机系统应用,2010,19(10):1-6
    [55]ASoleymani,Mohammad,Chanel,Guillaume; Kierkels,Joep J.M.; Pun, Thierry, Affective characterization of movie scenes based on multimedia content analysis and user's physiological emotional responses Proceedings-10th IEEE International Symposium on Multimedia, ISM 2008,2008:228-235,
    [56]Arifm, Sutjipto; Cheung, Peter Y. K. Affective level video segmentation by utilizing the pleasure-arousal-dominance information,IEEE Transactions on Multimedia, 2008,10(7):1325-1341
    [57]Padmakala, S. (St. Joseph's College of Engineering, Anna University, Chennai-600025, Tamilnadu, India); AnandhaMala, G.S.; Shalini, M. An effective content based video retrieval utilizing texture, color and optimal key frame features, ICIIP 2011 Proceedings:2011 International Conference on Image Information Processing,2011
    [58]Hu, Weiming; Xie, Nianhua; Li, Li; Zeng, Xianglin; Maybank, Stephen,A survey on visual content-based video indexing and retrieval,IEEE Transactions on Systems, Man and Cybernetics Part C:Applications and Reviews,2011,41(6):797-819
    [1]林崇德,杨治良,黄希庭.心理学大辞典.上海:上海教育出版社,2003
    [2]巴甫洛夫.条件反射-动物高级神经活动.北京:北京大学出版社,2010
    [3]袁勋.基于动力学的人工情感模型研究,中国科学技术大学,2008
    [4]王伟凝,余英林.图像的情感语义研究进展,电路与系统学报,2003,8(5):101-109
    [5]刘金平.情绪的激活模式研究,河南大学学报(社会科学版),1995,35(4):27-31
    [6]王玉,王志良,王国江,陈锋军,王怀威.一种情感模型的研究,辽宁工程技术大学学报,2006,25(5):635-637
    [7]付选刚.论美感的中枢生理机制,延安大学学报(社会科学版),1995,17(65):86-90
    [8]段鸿.一种虚拟人物的情感计算方法,计算机工程与应用,2007,43(11):117-118
    [9]潘秀霞,杜吉祥.马斯洛层次需求理论的人工情感建模,华侨大学学报,2010,33(1):23-26
    [10]Kimiaki Shirahama,Kazuyuki Otaka and Kuniaki Uehara. Content-Based Video Retrieval Using Video Ontology. Ninth IEEE International Symposium on Multimedia 2007:283-288
    [11]卢毓东.多媒体数据语义建模及应用研究,华北电力大学,2004
    [12]李景,孟宪学,苏晓路. 领域本体的构建方法与应用研究,北京:中国农业科学技术出版社,2009.7
    [13]陈贤明,王小铭.基于本体与MPEG-7视频语义描述模型,华南师范大学学报(自然科学版),2007(2):51-56
    [14]白亮,刘海涛,老松杨等.基于本体的视频语义内容分析.计算机科 学,2009,36(7):170-174
    [15]李海芳,焦丽鹏,陈俊杰等.情感语义图像检索技术研究,计算机工程与应用,2006(18):82-85
    [16]Liu,Huayong.Content-based TV sports video retrieval based on audio-visual features and text information,Proceedings-IEEE/WIC/ACM International Conference on Web Intelligence,2004:481-484
    [17]Fan, Jianping; Luo, Hangzai; Gao, Yuli; Jain, Ramesh,Incorporating concept ontology for hierarchical video classification, annotation, and visualization, IEEE Transactions on Multimedia,2007,9(5), p939-957
    [18]Ho, Yu-Hsuan Lin, Chia-Wen; Chen, Jing-Fung; Liao, Hong-Yuan Mark,Fast coarse-to-fine video retrieval using shot-level spatio-temporal statistics,IEEE Transactions on Circuits and Systems for Video Technology,2006,16(5):642-648
    [19]顾志伟.面向结构化数据的视频检索研究[学位论文],中国科学技术大学,2008
    [20]相洁,陈俊杰,董志锋.基于本体的图像情感语义识别及推理模型,计算机工程与设计,2008,29(6):1494-1496
    [21]Vrusias, Bogdan; Newbold, Neil; Makris,Dimitrios; Ahmad,Khurshid; Renno,John-Paul; Jones,Graeme,A framework for ontology enriched semantic annotation of CCTV video,8th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2007,2007
    [22]程淑红,胡春海.基于时空域的自动视频对象分割算法,应用光学,2009,30(5):768-771
    [23]徐峰,郑烇.基于本体的视频语义检索系统研究.计算机应用,2010,30(3):835-849
    [24]赵涓涓,陈俊杰,刘嘉琳,许伟忠.以本体为核心的图像情感语义检索模型.计算机应用,2009,29(5):1430-1432
    [25]黄崑,赖茂生.以用户情感为线索的图像检索研究,情报科学,2006,24(9):1395-1399
    [26]邓志鸿,唐世渭,张铭等Ontology研究综述.北京大学学报,2002,38(5):730-738
    [27]王煜,周立柱,邢春晓.视频语义模型及评价准则.计算机学报,2007,30(3):337-349
    [28]孟秀艳,王志良,李娜,刘遥峰.情感机器人的情感模型研究,计算机科学,2008,35(6):157-162
    [29]杨国亮,王志良.情感建模研究进展.自动化技术与应用,2004,23(11)1-4
    [30]张颖,罗森林.情感建模与情感识别,计算机工程与应用,2003(33).98-102
    [31]江道平,班晓娟,尹怡欣等.情感理论及基于情感的决策理论与模型研究.计算机科学,2007,34(4):154-157
    [32]王素玉,沈兰荪.基于对象的视频编码技术测控技术,2006,25(5):20-23
    [33]Jiang, Wei; Loui, Alexander C. Semantic event detection for consumer photo and video collections,2008 IEEE International Conference on Multimedia and Expo, ICME 2008-Proceedings, p313-316,2008.
    [34]Dyana, A.; Das, Sukhendu Trajectory representation using Gabor features for motion-based video retrieval, Pattern Recognition Letters,2009,30(10):877-892.
    [35]Lie, Wen-Nung; Hsu, Kuo-Chiang,Video summarization based on semantic feature analysis and user preference,Proceedings-IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing,2008:486-491
    [36]Zhang, Shiliang; Huang, Qingming; Jiang, Shuqiang; Gao, Wen; Tian, Qi,Affective visualization and retrieval for music video,IEEE Transactions on Multimedia,2010, 12(6):510-522
    [37]Katti, Harish; Yadati, Karthik; Kankanhalli, Mohan; Tat-Seng, Chua,Affective video summarization and story board generation using pupillary dilation and eye gaze, Proceedings-2011 IEEE InternationalSymposium on Multimedia,2011:319-326,
    [38]Zhao, Sicheng (Department of Computer Science, Harbin Institute of Technology, No.92, West Dazhi Street, Harbin,150001, China); Yao, Hongxun; Sun, Xiaoshuai; Xu, Pengfei; Liu, Xianming; Ji, Rongrong.Video indexing and recommendation based on affective analysis of viewers, MM'11-Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops,2011:1473-1476
    [39]Kleinsmith, Andrea; Bianchi-Berthouze, Nadia; Steed, Anthony.Automatic recognition of non-acted affective postures,IEEE Transactions on Systems, Man, and Cybernetics, Part B:Cybernetics,2011,41(4):1027-1038,
    [40]Chan, Ching Hau; Jones, Gareth J. F.,Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)An affect-based video retrieval system with open vocabulary querying, 2011:103-117
    [41]李红英.基于内容的图像和视频检索技术研究及其系统实现[学位论文],湖南师范大学,2006
    [42]李健.基于内容的新闻视频检索关键技术研究[学位论文],哈尔滨理工大学,2010
    [43]翟俊杰.基于色彩直方图特征值的视频检索问题的研究[学位论文],北京邮电大学,2007
    [44]Deng, Yining; Manjunath, B.S. Content-based search of video using color, texture, and motion,IEEE International Conference on Image Processing,1997(2):534-537
    [45]Dyana,A.; Subramanian,M.P.; Das,Sukhendu Combining features for shape and motion trajectory of video objects for efficient content based video retrieval,Proceedings of the 7th International Conference on Advances in Pattern Recognition,2009:113-116
    [46]陈尧.基于概念相似度计算的本体映射算法的研究[学位论文],大庆石油学院,2009
    [47]李晓丹.限定领域内基于web的智能问答系统[学位论文],内蒙古大学,2005
    [1]田玉敏,王忠,朱虹.基于均值散度直方图的镜头分割算法.华中科技大学学报(自然科学版),2009,37(4):43-46
    [2]史元春;徐光祐;中国多媒体技术研究:2010,中国图像图形学报,2011,16(7)
    [3]孙君顶,赵珊.图像底层特征提取与检索技术,电子工业出版社,2009.7
    [4]肖治民,林坤辉,周昌乐等.基于HSV颜色空间的视频镜头检测.厦门大学学报(自然科学版),2008,47(5):665-668
    [5]Liang Lin,Haifeng Gong,Liang Wang.Semantic event representation and recognition using syntacticattribute graph grammar, Pattern Recognition Letters 30 (2009) 180-186
    [6]Chengcui Zhang, Xin Chen, Liping Zhou, Wei-Bang Chen, Semantic retrieval of events from indoor surveillance video databases, Pattern Recognition Letters 30 (2009) 1067-1076
    [7]李志慧,赵永华,魏巍,谢孔峰,曲昭伟,王殿海.基于视频的自行车检测算法.吉林大学学报,2010,40(5):1235-1238
    [8]刘骏伟.视频对象检测及其在视频语义内容分析中的应用[学位论文].浙江大学,2003
    [9]郑锦,李波.视频序列中运动对象检测技术的研究现状与展望,计算机应用研究,2008,25(12):3534-3539
    [10]赵志诚,蔡安妮.基于全局运动的视频检索方案,北京邮电大学学报,2006,29(4):18-23
    [11]贾克斌,邓智毗,庄新月.基于时序特征的视频相似性匹配算法.北京工业大学学报,2008,34(12):1250-1253
    [12]文军,吴玲达,曾璞,谢毓湘.新闻视频中基于“场景词汇”的故事单元相似度分析,国 防科技大学学报,2009,31(6):121-125
    [13]李勇,陈贺新,陈绵书等.视频流中运动对象提取和生成技术,吉林大学学报,2009,39(增1):328-331
    [14]赵江波,沈伟,王军政.基于灰度信息的动场景视频序列中运动对象的提取.光学技术,2008,34(1):55-57
    [15]刘文哲.视频序列中目标跟踪技术研究[学位论文],西安电子科技大学,2005
    [16]卢晓朋.基于内容的视频检索的若干关键技术的研究,中国科学院,2007
    [17]焦荣梅.基于内容的视频运动对象提取技术[学位论文],重庆大学,2007
    [18]栾悉道.视频检索中的特征提取方法研究[学位论文],国防科学技术大学,2008
    [19]李娟.城市交通系统中行人交通视频检测的理论与方法,北京交通大学博士论文,2010
    [20]于跃龙.视频语义信息提取关键技术研究[学位论文],国防科技大学,2005年
    [21]闫君飞.视频点播系统中的视频检索研究[学位论文],中国科学技术大学,2008
    [22]张志伟,可变光照条件下的人脸识别技术研究[学位论文],河北工业大学-2007
    [23]吕丽.多层次语义视频对象描述模型及提取技术研究,上海交通大学硕士论文,2007
    [24]A. Dyana,M.P. Subramanian and Sukhendu Das. Combining features for Shape and Motion Trajectory of Video Objects for efficientContent based Video Retrieval,2009 Seventh International Conference on Advances in Pattern Recognition,2009:113-116
    [25]孙即祥.现代模式识别(第二版),北京:高等教育出版社,2008.1
    [26]张良,周长胜.基于内容的视频语义分析关键技术,电子科技,2011,24(10):111-114
    [27]Richard O.duda peter E.hart david G.stock著,李宏东,姚天翔译.模式分类,机械工 业出版社中信出版社,2010.4
    [28]王晓峰,张大鹏等.基于语义轨迹的视频事件探测.计算机学报.2010,33(10):1845-1858
    [29]吴飞,刘亚楠,庄越挺.基于张量表示的直推式多模态视频语义概念检测.软件学报,2008,19(11):2854-2868
    [30]韩建宇,高胜法,左凤艳.基于帧差特征点的视频对象提取跟踪的研究.计算机工程与设计,2009,30(24):5676-5680
    [31]Zhao, Sicheng; Yao, Hongxun; Sun, Xiaoshuai.Affective video classification based on spatio-temporal feature fusion,Proceedings-6th International Conference on Image and Graphics, ICIG 2011, p795-800,2011
    [32]Chen, Xin; Zhang, Chengcui; Chen, Shu-Ching; Rubin, Stuart,A human-centered multiple instance learning framework for semantic video retrieval, IEEE Transactions on Systems, Man and Cybernetics Part C:Applications and Reviews,2009,39(2): 228-233
    [33]危自福;毕笃彦;杨俭.基于多级纹理特征和Mean-Shift的灰度目标跟踪;计算机应用,2010,30(6)
    [34]Birchfield S. Elliptical head tracking using intensity gradients and colorhistograms, Proceedings of the IEEE Conference on Computer Vision andPattern Recognition. Santa Barbara:IEEE,1998:232-237
    [35]Zhu G. Zeng Q. Wang C. Efficient edge-based object tracking. PatternRecognition. 2006,39(11):2223-2226
    [36]Tissainayagam P. Suter D. Object tracking in image sequences using pointfeatures. Pattern Recognition.2005,38 (1):105-113
    [37]Hong, Ha Bui; Kiyoki, Yasushi,A Color-Content Based Video Retrieval system with a Time-Sequence Analyzer,Proceedings of the 10th IASTED International Conference on Software Engineering, SE 2011, p116-121,2011
    [38]Kong, Juan; Han, Cuiying.Content-based video retrieval system research,Proceedings 2010 3rd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2010, v4, p701-704,2010
    [39]Patel, B.V.; Deorankar, A.V.; Meshram, B.B. Content based video retrieval using entropy, edge detection, black and white color features,ICCET 2010-2010 International Conference on Computer Engineering and Technology, Proceedings, v6, pV6272-V6276,2010
    [40]Zhang, Hui; Zhao, Zhicheng; Cai, Anni; Xie, Xiaohui.A novel framework for content-based video copy detection, Proceedings-2010 2nd IEEE International Conference on Network Infrastructure and Digital Content, IC-NIDC 2010, p753-757, 2010
    [41]Zhu, Liuzhang (Anhui Electric Power Jiyuan Software Co. Ltd. Hefei, China); Li, Zimian; Cao, Zheng.An efficient and effective video similarity search method,Proceedings of SPIE-The International Society for Optical Engineering, v8285,2011,
    [42]Chen,Duan-Yu; Chu,Kuei-Cheng; Liu,Yu-Chien; Chen, Yung-Sheng Human subject-based video browsing and summarization,2010 International Conference on Machine Learning and Cybernetics, ICMLC 2010,v6,p2796-2801,2010
    [43]Qu,Zhong; Gao,TengFei An improved algorithm of keyframe extraction for video summarization,Advanced Materials Research,v225-226,p807-811,2011
    [44]Lu,BaoFeng; Cao,HaiBin; Cao,Zheng An efficient method for video similarity search with video signature,Proceedings-2010 International Conference on Computational and Information Sciences,ICCIS 2010,p713-716,2010
    [45]Jamil,Akhtar; Siddiqi,Imran; Arif,Fahim; Raza,Ahsen.Edge-based features for localization of artificial Urdu text in video images,Proceedings of the International Conference on Document Analysis and Recognition,ICDAR,p1120-1124,2011
    [46]Zhang,Shilin; Zhang,Shuwu,Content-based Hand language video searching under complex background:2010 IEEE International Conference on Information and Automation,ICIA 2010,p2433-2437,2010
    [47]Katkar,Vijay; Barve,Amit.Efficient content based video retrieval for animal videos,Communications in Computer and Information Science,v125 CCIS,p242-248,2011,Advances in Computing,Communication and Control International Conference,ICAC3 2011,Proceedings
    [48]Zhu,Lei; Qu,Junfeng; Rahman,Muhammad Asadur; Hong,Weihu.An integrated method for video shot boundary detection,Conference Proceedings-IEEE SOUTHEASTCON,pl 51-154,2010
    [49]Roopalakshmi,R.; Reddy,G. Ram Mohana.Efficient video copy detection using simple and effective extraction of color features,Communications in Computer and Information Science,v193 CCIS,n PART 4,p473-480,2011
    [50]姜璐,章品正,舒华忠.矩在面部表情识别中的应用,东南大学学报,2004,34(4):557-560
    [51]于俊清,何欢欢,何云峰.利用情感激励提取足球视频精彩镜头,计算机研究与发 展,2010,47(10):1823-1831
    [52]季丽红.图像序列中人体运动的检测和跟踪[学位论文],苏州大学,2007
    [1]林新棋.基于模糊理论的电影情感识别[学位论文].北京:北京邮电大学,2009.
    [2]Alan Hanjalic and Xu Li-Qun. Affective Video Content Representation andModeling. IEEE transactions on multimedia,2005,7(1),PP:143-154
    [3]Alan Hanjalic. Content-Based Analysis of DigitalVideo,Springer,2004.Chengcui Zhang,Xin Chen,Liping Zhou,Wei-Bang Chen,Semantic retrieval of events from indoor surveillance video databases,Pattern Recognition Letters 30 (2009) 1067-1076
    [4]史忠植.神经网络,北京:高等教育出版社,2009.5
    [5]沈兰荪等.图像检索与压缩域处理技术的研究,北京:人民邮电出版社,2008.
    [6]张菁,沈兰荪,高静静.基于视觉注意机制的感兴趣区检,光子学报,2009,38(6):1561-1564
    [7]计文平,沈兰荪.基于感兴趣区的图像多描述编码,北京工业大学学报,2007,33(3)140-143
    [8]许先斌,胡婧,吴玉芹.基于神经网络的视频压缩的FPGA实现,计算机工程与设计.2009,30(13):3082-3084
    [9]吕进来,相洁,陈俊杰等.基于感兴趣区域特征提取技术的情感语义研究.计算机工程与设计.2010,31(3):660-662
    [10]李青,蒋冬梅.基于流形特征的视频情感分析与识别.计算机工程与科学,2010,32(12):39-41
    [11]Murugappan,M.Human emotion classification using wavelet transform and KNN: Proceedings of the 2011 International Conference on Pattern Analysis and Intelligent Robotics,ICPAIR 2011,vl,p148-153,2011
    [12]Teixeira, Rene Marcelino Abritta; Yamasaki, Toshihiko; Aizawa, Kiyoharu.Determination of emotional content of video clips by low-level audiovisual features-A dimensional and categorial experimental approach,Multimedia Tools and Applications, p1-29,2011
    [13]Irie, Go; Hidaka, Kota; Satou, Takashi; Yamasaki, Toshihiko; Aizawa, Kiyoharu.Affective video segment retrieval for consumer generated videos based on correlation between emotions and emotional audio events, Proceedings-2009 IEEE International Conference on Multimedia and Expo, ICME 2009, p522-525,2009, Proceedings
    [14]Kai, Sun; Junqing, Yu; Yue, Huang; Xiaoqiang, Hu. An improved valence-arousal emotion space for video affective content representation and recognition, Proceedings 2009 IEEE International Conference on Multimedia and Expo, ICME 2009, p566-569,2009,
    [15]Kang, Hang-Bong, Analysis of scene context related with emotional events,Proceedings of the ACM International Multimedia Conference and Exhibition, p311-314,2002
    [16]陈倩倩,赵杰煜.基于嵌入式HMM的脸部表情识别.计算机T程与应用,2006(2):187-189
    [17]Liu, Guang-Yuan; Hao, Min.Emotion recognition of physiological signals based on adaptive hierarchical genetic algorithm,2009 WRI World Congress on Computer Science and Information Engineering, CSIE 2009, v4, p670-674,2009
    [18]Rabie, Ahmad; Wrede, Britta; Vogt, Thurid; Hanheide, Marc.Evaluation and discussion of multi-modal emotion recognition,2009 International Conference on Computer and Electrical Engineering, ICCEE 2009, v1, p598-602,2009,
    [19]Paleari, Marco; Chellali, Ryad; Huet, Benoit,Features for multimodal emotion recognition:An extensive study,2010 IEEE Conference on Cybernetics and Intelligent Systems, CIS 2010, p90-95,2010
    [20]马希荣,刘琳,桑婧.基于情感计算的e_Learning系统建模,计算机科学,2005,32(8):131-133
    [21]王万森,温绍洁,郭凤英.基于人工情绪的智能情感网络教学系统研究.小型微型计算机系统,2006,27(3):569-57
    [22]赵力,王治平,卢韦,邹采荣,吴镇扬.全局和时序结构特征并用的语音信号情感特征识别方法,自动化学报.2004,30(3):423-429
    [23]宋亦旭,贾培发.人工情感及其应用,控制理论与应用,2004,21(2):315-320
    [24]朱飒飒,彭力,王巍.人工情感进化模型及其学习算法的研究,计算机工程与应用,2008,44(32):45-47
    [25]Yan,Lelin; Wen,Xiangming; Zheng,Wei; Zhang,Liang.Content-based affective intensity recognition algorithm using unascertained measureSource:Applied Mechanics and Materials,v39,p476-481,2011
    [26]薛雨丽,毛峡,郭叶,吕善伟:入机交互中的人脸表情识别研究进展.中国图像图形学报,2009,14(5):764-772
    [27]李文.人脸表情识别方法,电子科技,2007(6):63-72
    [28]杨梅娟.人脸表情识别综述,甘肃科技,2006,22(4):95-962
    [29]董静.基于HMM的情感模型及在心理咨询专家系统中的应用研究,首都师范大学,2009
    [30]王扉. 人机情感交互的方法与技术研究,中国科学院,2005
    [31]王书朋.基于Web的评论文本情感分类问题研究,西安电子科技大学,2009
    [32]王涛. 基于人工心理的情感建模及人工情感交互技术研究,安徽大学,2007
    [33]Lin, T.; Ngo, C.-W.; Zhang, H.-J.; Shi, Q.-Y. Integrating color and spatial features for content-based video retrieval, IEEE International Conference on Image Processing, v3, p592-595,2001
    [34]Wei, Wei; Liu, Wen-Qing; Li, Li-Li Multi-label annotation study in video semantic content analysis, Proceedings of the 2009 International Conference on Machine Learning and Cybernetics, v4, p2453-2457,2009
    [35]Ntalianis, Klimis; Doulamis, Anastasios; Tsapatsoulis, Nicolas; Doulamis, Nikolaos.Human action analysis, annotation and modeling in video streams based on implicit user interaction:MM'08-Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops, p65-72, 2008,
    [36]卢健华,智能终端人脸检测技术研究[学位论文],华南理工大学,2010
    [37]宫丽娜,基于神经网络的软件质量预测模型研究,中国石油大学,2011
    [38]董鹏,基于全向视觉的足球机器人任意足球识别与跟踪问题研究[学位论文],国防科学技术大学,2010
    [1]陈胜勇,刘盛.基于OpenCV的计算机视觉技术实现,北京:科学出版社,2008
    [2]王素玉,沈兰荪.基于对象的视频编码技术,测控技术,2006,25(5):20-23
    [3]张良.一种视频关键语义对象的检测方法,北京信息科技大学学报(自然科学版),2010,25(2):75-78
    [4]郑拴,肖碧宇.基于MPEG-7的视频检索系统的设计与实现.计算机系统应用,2010,19(10).
    [5]薛玲,李超,熊璋.基于MPEG-7协议的视频检索系统设计,北京航空航天大学学报,2006,32(7):865-868
    [6]王焱.基于内容的通用视频检索系统框架设计,计算机应用研究,2004(3):161-164
    [7]彭宇新,Ngo chong wah,董庆杰等,一种通过视频片段进行视频检索的方法,软件学报,2003,14(8):1409-1417
    [8]冯柏岚,包蕾,曹娟,张勇东,林守勋.基于多模态概念关联图的视频检索,计算机辅助设计与图形学学报,2010,22(5):827-832
    [9]胡双演,李俊山,李建军.基于潜在语义分析的视频检索.计算机工程,2007,33(13):216-217
    [10]姚领田,刘雨,程勇.一个基于运动的视频检索系统,计算机与现代化.2004(2):20-22
    [11]Lanze,Marc; Dy, Ivan C.; Vener, Ivan; Espinosa, L.; Patrick, Paul; Go, V.; Martin, Charles; Mendez, M.; Cu, Jocelynn W. Multimodal emotion recognition using a spontaneous Filipino emotion database,2010 3rd International Conference on Human-Centric Computing, HumanCom 2010
    [12]刘涛,基于内容视频检索系统的实现[学位论文],浙江大学,2006
    [13]蒲金培.基于内容的视频检索系统的研究与实现[学位论文],吉林大学,2008
    [14]曲昭伟.基于内容的视频检索研究[学位论文],吉林大学,2009
    [15]任建四.基于内容的视频检索系统研究与设计[学位论文],华中师范大学,2002
    [16]胡振兴,夏利民.基于视频片段的视频检索.中南大学学报.2010,44(3):1009-1014
    [17]李华北,胡卫明,罗冠,基于语义匹配的交互式视频检索框架.自动化学报.2008,34(10):1243-1249
    [18]曾中魁.基于MPEG-7低层特征的视频检索系统[学位论文],中国科学技术大学,2011
    [19]孟秀艳,王志良,王丽娟.基于情感建模的教学辅助系统的研究,计算机应用研究,2007,24(4):74-76
    [20]王上飞,陈恩红,王胜惠等.基于情感模型的感性图像检索,电路与系统学报,2003,8(6):48-52
    [21]李华北,胡卫明,罗冠.基于语义匹配的交互式视频检索框架.自动化学报,2008,34(10):1243-1249
    [22]陈博.WEB文本情感分类中关键问题的研究[学位论文],北京邮电大学,2008
    [1]Benini,Sergio; Canini, Luca; Leonardi, Riccardo.A connotative space for supporting movie affective recommendation,IEEE Transactions on Multimedia, v13, n 6, p1356-1370, December 2011
    [2]Wang, Jianchao; Li, Bing; Hu, Weiming; Wu, Ou. Horror video scene recognition via multiple-instance learning,ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing-Proceedings, p1325-1328,2011
    [3]李健.情感教学agent_建模与反馈策略研究[学位论文],哈尔滨理工大学,2010
    [4]寿航军.情感语音合成,西安电子科技大学[学位论文],2007
    [5]李冬冬.基于拓展和聚类的情感鲁棒说话人识别研究,浙江大学,2008
    [6]刘飞.音乐情感认知模型与交互技术研究[学位论文],四川大学,2005
    [7]Katti, Harish; Yadati, Karthik; Kankanhalli, Mohan; Tat-Seng, Chua,Affective video summarization and story board generation using pupillary dilation and eye gaze, Proceedings-2011 IEEE InternationalSymposium on Multimedia, ISM 2011, p319-326,2011
    [8]Zhao, Sicheng (Department of Computer Science, Harbin Institute of Technology, No.92, West Dazhi Street, Harbin,150001, China); Yao, Hongxun; Sun, Xiaoshuai; Xu, Pengfei; Liu, Xianming; Ji, Rongrong.Video indexing and recommendation based on affective analysis of viewers, MM'11-Proceedings of the 2011 ACM

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700