基于手持设备的多媒体信息服务的设计和实现
|
摘要
随着多媒体网络技术的发展和手持移动设备的普及,在手持设备上观看多媒体信息的需求愈发迫切。然而,由于手持设备能力和无线网络带宽的限制,现有的大多数流媒体服务在无线网络环境中并不能直接适用于手持设备。另一方面,当前手持设备上所提供的多媒体信息服务方式多样且一般存在于不同应用之中,即使在一个应用中往往也需要用户自己去查找所需的信息内容,耗费大量设备资源和用户时间。因此,流媒体适配和信息服务整合就成为很有价值的研究课题。
流媒体适配方面,本文综合了多项技术成果,提出了结构新颖的流媒体适配网关设计。设计重点是码流适配和信息反馈。通过对手持设备能力和媒体流特性的分析,结合以往相关文献中提出的适配方案,本文总结了针对分辨率,帧速率,编码率,编码格式等适配方法。相比现有设计方法中只提供单一类型适配的局限性,提出了基于模块的多向适配设计。另一方面,对于信息反馈机制主要基于设备能力和用户喜好,概括了三种方案,并引入神经网络的设计思想,对反馈信息进行自动控制来形成反馈循环。
基于手持设备的多媒体信息服务整合方面本文提出将信息传送方式整合和信息内容种类整合的架构设计。具体来说,将实时媒体流服务,交互式服务,推送式服务整合于一个应用之中,将用户需求信息采用上述相应的传送方式分类呈现给用户。
根据上述架构设计,本论文基于Nokia手持终端N800设计开发了应用程序。一方面利用GTK+实现友好的用户界面,另一方面采用多线程机制实现多样化服务的整合和并发,并借用mplayer的媒体流处理能力,实现了N800上的多媒体服务。经过在多媒体信息服务网关系统的实际验证,基于手持设备的多媒体信息服务的设计和实现能够较好的满足用户的多媒体需求,随着后续研究的深入,这一课题的应用必将为用户带来更多的使用便利和娱乐享受。
With the development of multimedia networking technologies and the popularity of mobile handheld devices, the requirements of receiving and watching multimedia information through the handheld devices become stronger. However, due to the limited capability of the handheld devices and the bandwidth of wireless networks, currently most multimedia streaming services cannot be applied to handheld devices directly in wireless network. On the other hand, multimedia information services for handheld device with multiple ways to access to the information are scattered into different applications. Even if using one application, users would take a lot of time to search for information they need. Moreover, both costs too much resource of devices. Consequently, multimedia streaming adaptation and information sevice integration are valuable research subject.
Referring to multimedia stream adaptation, this thesis summarizes some key technologies and suggests a novel gateway architecture for adapting multimedia streamings for handheld devices. The architecture mainly focuses on streaming transcoding and information feedback. After analyzing the capabilities of handheld devices and the features of multimedia streamings, and referring to the related work in previous literatures, the thesis generalizes several primary transcoding approaches which are based on resolution, frame rate, and the volume of the bits encoding, encoding format and so on. Comparing with current designs which provide only single transcoding approach, the thesis proposes multidimensional transcoding module design. On the other hand, according to the user's requirements and the capabilities of the devices, three solutions are designed for information feedback. Also, the mechanism of neural network is introduced to provide automatic control conducting a feedback loop.
With regard to integrating multimedia information services for handheld devices, this thesis suggests a new architecture design which aims to integrating the modes of transmitting information and the classes of information. Especially, this architecture integrates real-time streaming services, interactive services and push services into one application. Furthermore, the information which users need are generally classified and provided to users by corresponsive modes referred above.
Based on the architecture design described above, an application has been developed on top of Nokia N800, a handheld device with WLAN interface. A friendly user interface is implemented by using GTK+ and the integration as well as concurrency of multiple services is implemented by using multi-thread mechanism. Additionally, the media application MPLAYER is used in our application, which provides stronger capability to process multimedia streaming. The application has been test practically in the Multimedia and Information Gateway system developed in our lab. The test results show that the multimedia information application for handheld devices can satisfy the user's requirements well. The work in the thesis provides a solid foundation for the future work.
流媒体适配方面,本文综合了多项技术成果,提出了结构新颖的流媒体适配网关设计。设计重点是码流适配和信息反馈。通过对手持设备能力和媒体流特性的分析,结合以往相关文献中提出的适配方案,本文总结了针对分辨率,帧速率,编码率,编码格式等适配方法。相比现有设计方法中只提供单一类型适配的局限性,提出了基于模块的多向适配设计。另一方面,对于信息反馈机制主要基于设备能力和用户喜好,概括了三种方案,并引入神经网络的设计思想,对反馈信息进行自动控制来形成反馈循环。
基于手持设备的多媒体信息服务整合方面本文提出将信息传送方式整合和信息内容种类整合的架构设计。具体来说,将实时媒体流服务,交互式服务,推送式服务整合于一个应用之中,将用户需求信息采用上述相应的传送方式分类呈现给用户。
根据上述架构设计,本论文基于Nokia手持终端N800设计开发了应用程序。一方面利用GTK+实现友好的用户界面,另一方面采用多线程机制实现多样化服务的整合和并发,并借用mplayer的媒体流处理能力,实现了N800上的多媒体服务。经过在多媒体信息服务网关系统的实际验证,基于手持设备的多媒体信息服务的设计和实现能够较好的满足用户的多媒体需求,随着后续研究的深入,这一课题的应用必将为用户带来更多的使用便利和娱乐享受。
With the development of multimedia networking technologies and the popularity of mobile handheld devices, the requirements of receiving and watching multimedia information through the handheld devices become stronger. However, due to the limited capability of the handheld devices and the bandwidth of wireless networks, currently most multimedia streaming services cannot be applied to handheld devices directly in wireless network. On the other hand, multimedia information services for handheld device with multiple ways to access to the information are scattered into different applications. Even if using one application, users would take a lot of time to search for information they need. Moreover, both costs too much resource of devices. Consequently, multimedia streaming adaptation and information sevice integration are valuable research subject.
Referring to multimedia stream adaptation, this thesis summarizes some key technologies and suggests a novel gateway architecture for adapting multimedia streamings for handheld devices. The architecture mainly focuses on streaming transcoding and information feedback. After analyzing the capabilities of handheld devices and the features of multimedia streamings, and referring to the related work in previous literatures, the thesis generalizes several primary transcoding approaches which are based on resolution, frame rate, and the volume of the bits encoding, encoding format and so on. Comparing with current designs which provide only single transcoding approach, the thesis proposes multidimensional transcoding module design. On the other hand, according to the user's requirements and the capabilities of the devices, three solutions are designed for information feedback. Also, the mechanism of neural network is introduced to provide automatic control conducting a feedback loop.
With regard to integrating multimedia information services for handheld devices, this thesis suggests a new architecture design which aims to integrating the modes of transmitting information and the classes of information. Especially, this architecture integrates real-time streaming services, interactive services and push services into one application. Furthermore, the information which users need are generally classified and provided to users by corresponsive modes referred above.
Based on the architecture design described above, an application has been developed on top of Nokia N800, a handheld device with WLAN interface. A friendly user interface is implemented by using GTK+ and the integration as well as concurrency of multiple services is implemented by using multi-thread mechanism. Additionally, the media application MPLAYER is used in our application, which provides stronger capability to process multimedia streaming. The application has been test practically in the Multimedia and Information Gateway system developed in our lab. The test results show that the multimedia information application for handheld devices can satisfy the user's requirements well. The work in the thesis provides a solid foundation for the future work.
引文
[1]李雪松.数字电视标准概述.西部电视概述.2005年04期
[2]DVB BlueBook A096:"IP Datacast over DVB-H:Phase 1 Set of Specifications".European Telecommunications Standards Institute.
[3]汪志明,邹道文,周源华.数字电视中电子节目指南系统的研究.电视技术.第12期.2005.9
[4]康建.PSI和EPG在DVB中的实现.卫星电视与宽带多媒体.第8期.2006.12.
[5]余雷.基于数字电视广播的电子节目指南系统的实现.中国有线电视.第19期.2004
[6]http://en.wikipedia.org/wiki/N800
[7]Maemo 2.2 tutorial.Maemo Development Platform:White paper.http://maemo.org/development/documentation/tutorials/
[8]http://buildroot.uclibc.org.
[9]Scratchbox home page.http://scratchbox.org.
[10]Ubuntu home page.http://www.ubuntu.com/.
[11]GTK+ api documentation,http://www.gtk.org/api/.
[12]崔尚卿 基于Gnome/Gtk+的图形用户界面的几个实现技巧计算机时代第8期P47-P48,2005
[13]张同光,潘红Linux中GTK编程技术研究及其应用软件导刊8月号P38-P40.2007
[14]何世勇 基于GTK的GUI编程中国水运(理论版)Vol.4,No.3,2006
[15]VideoLAN home page.http://www.videolan.org/
[16]Jens Brandt,Lars Wolf.Multidimensional Transcoding for Adaptive Video Streaming.NOSSDAV'07 Urbana,Illinois USA.
[17]郭大群.多媒体信息在网络中实时传输的研究与应用.[学位论文].南京航空航天大学.2002.
[18]冯开江.移动流媒体技术的视频编码标准及协议.广播电视信息(上半月刊).2007年12期.
[19]刘欣欣.国内外移动流媒体现行技术标准的比较研究.中国科技信息2005年4月.
[20]移动流媒体技术的视频编码标准及协议
[21]J.Brandt and L.Wolf,"A Gateway Architecture for Mobile Multimedia Streaming," in European Symposium on Mobile Media Delivery(EuMob06),Alghero,Italy,September 2006 3,Genova,Italy,Sept.2005,pp.700-703.
[22]H.S.S Park,Y.Lee.Quality-adaptive requantization for low-energy MPEG-4video decoding in mobile devices.IEEE Transactions on Consumer Electronics,51(3):999-1005,2005
[23]E.Amir,S.McCanne,and H.Zhang,"An application level video gateway," in ACM Multimedia '95,San Francisco,CA,1995.
[24]A.Vetro and H.Sun,"Media conversion to support mobile users," in IEEE Canadian Conference on Electronic and Computer Engineering,2001.
[25]C.-H.Chi and Y.Cao,"Progressive proxy-based multimedia transcoding system with maximum data reuse," in Proceedings of the tenth ACM international conference on Multimedia,2002,pp.425-426.
[26]J.Guo,F.Chen,L.Bhuyan,and R.Kumar,"A cluster-based active router architecture supporting video/audio stream transcoding service," in International Parallel and Distributed Processing Symposium,2003.
[27]Z.Lei and N.D.Georganas,"Video transcoding gateway for wireless video access," in Canadian Conference on Electrical and Computer Engineering,vol.3,2003,pp.1775 -1778.
[28]P.Schojer,L.Bszrmenyi,H.Hellwagner,B.Penz,and S.Podlipnig,"Architecture of a quality based intelligent proxy(QBIX)for MPEG-4 videos," in Proceedings of the twelfth international conference on World Wide Web.ACM Press,2003,pp.394-402.
[29]S.Roy,M.Covell,J.Ankcomand,S.Wee,and T.Yoshimura,"A system architecture for managing mobile streaming media services," in 23~(rd)International Conference on Distributed Computing Systems Workshops,May 2003,pp.408 - 413.
[30]Simon Dobson,Fabio Massacci,"A Survey of Autonomic Communications",in ACM Transactions on Autonomous and Adaptive System,Vol.1,No.2,December 2006.
[31]IETF RFC 2326:H.Schulzrinne,A.Rao,R.Lanphier:"Real Time Streaming Protocol(RTSP)",April 1998.
[32]TVersity home page.http://tversity.com/
[33]Orb test page.http://test.orb.com
[34]I.Richard,G.G,"Service advertisement and discovery:enabling universal device cooperation,"IEEE Internet Computing,Sept.-Oct.2000.
[35]Warren W.Gay《实战Linux Socket编程》西安电子科技大学出版社2002.156-64
[2]DVB BlueBook A096:"IP Datacast over DVB-H:Phase 1 Set of Specifications".European Telecommunications Standards Institute.
[3]汪志明,邹道文,周源华.数字电视中电子节目指南系统的研究.电视技术.第12期.2005.9
[4]康建.PSI和EPG在DVB中的实现.卫星电视与宽带多媒体.第8期.2006.12.
[5]余雷.基于数字电视广播的电子节目指南系统的实现.中国有线电视.第19期.2004
[6]http://en.wikipedia.org/wiki/N800
[7]Maemo 2.2 tutorial.Maemo Development Platform:White paper.http://maemo.org/development/documentation/tutorials/
[8]http://buildroot.uclibc.org.
[9]Scratchbox home page.http://scratchbox.org.
[10]Ubuntu home page.http://www.ubuntu.com/.
[11]GTK+ api documentation,http://www.gtk.org/api/.
[12]崔尚卿 基于Gnome/Gtk+的图形用户界面的几个实现技巧计算机时代第8期P47-P48,2005
[13]张同光,潘红Linux中GTK编程技术研究及其应用软件导刊8月号P38-P40.2007
[14]何世勇 基于GTK的GUI编程中国水运(理论版)Vol.4,No.3,2006
[15]VideoLAN home page.http://www.videolan.org/
[16]Jens Brandt,Lars Wolf.Multidimensional Transcoding for Adaptive Video Streaming.NOSSDAV'07 Urbana,Illinois USA.
[17]郭大群.多媒体信息在网络中实时传输的研究与应用.[学位论文].南京航空航天大学.2002.
[18]冯开江.移动流媒体技术的视频编码标准及协议.广播电视信息(上半月刊).2007年12期.
[19]刘欣欣.国内外移动流媒体现行技术标准的比较研究.中国科技信息2005年4月.
[20]移动流媒体技术的视频编码标准及协议
[21]J.Brandt and L.Wolf,"A Gateway Architecture for Mobile Multimedia Streaming," in European Symposium on Mobile Media Delivery(EuMob06),Alghero,Italy,September 2006 3,Genova,Italy,Sept.2005,pp.700-703.
[22]H.S.S Park,Y.Lee.Quality-adaptive requantization for low-energy MPEG-4video decoding in mobile devices.IEEE Transactions on Consumer Electronics,51(3):999-1005,2005
[23]E.Amir,S.McCanne,and H.Zhang,"An application level video gateway," in ACM Multimedia '95,San Francisco,CA,1995.
[24]A.Vetro and H.Sun,"Media conversion to support mobile users," in IEEE Canadian Conference on Electronic and Computer Engineering,2001.
[25]C.-H.Chi and Y.Cao,"Progressive proxy-based multimedia transcoding system with maximum data reuse," in Proceedings of the tenth ACM international conference on Multimedia,2002,pp.425-426.
[26]J.Guo,F.Chen,L.Bhuyan,and R.Kumar,"A cluster-based active router architecture supporting video/audio stream transcoding service," in International Parallel and Distributed Processing Symposium,2003.
[27]Z.Lei and N.D.Georganas,"Video transcoding gateway for wireless video access," in Canadian Conference on Electrical and Computer Engineering,vol.3,2003,pp.1775 -1778.
[28]P.Schojer,L.Bszrmenyi,H.Hellwagner,B.Penz,and S.Podlipnig,"Architecture of a quality based intelligent proxy(QBIX)for MPEG-4 videos," in Proceedings of the twelfth international conference on World Wide Web.ACM Press,2003,pp.394-402.
[29]S.Roy,M.Covell,J.Ankcomand,S.Wee,and T.Yoshimura,"A system architecture for managing mobile streaming media services," in 23~(rd)International Conference on Distributed Computing Systems Workshops,May 2003,pp.408 - 413.
[30]Simon Dobson,Fabio Massacci,"A Survey of Autonomic Communications",in ACM Transactions on Autonomous and Adaptive System,Vol.1,No.2,December 2006.
[31]IETF RFC 2326:H.Schulzrinne,A.Rao,R.Lanphier:"Real Time Streaming Protocol(RTSP)",April 1998.
[32]TVersity home page.http://tversity.com/
[33]Orb test page.http://test.orb.com
[34]I.Richard,G.G,"Service advertisement and discovery:enabling universal device cooperation,"IEEE Internet Computing,Sept.-Oct.2000.
[35]Warren W.Gay《实战Linux Socket编程》西安电子科技大学出版社2002.156-64
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |