基于Hadoop的移动学习系统设计与实现
|
摘要
二十一世纪以来网络技术、移动通信技术的高速发展不断地改变着人们的生活方式和工作方式,也改变着人们求知学习的方式。特别是近几年3G技术的不断成熟与应用使得手机上网突破了网络通信速度的瓶颈后,我国手机网民数量迅速增长,使用手机进行随时、随地的移动式学习的用户也越来越多。但是以手机为代表的常用的移动学习设备因受体积的限制,计算能力和存储能力差,资源共享能力低等缺点还不能满足人们日益增长的学习需求,这也阻碍了移动学习模式的进一步推广。
与此同时,云计算作为一种全新网络服务方式,受到众多学者、专家的认可与追捧。它将任务处理的模式由传统的以桌面为核心的转变为以网络为核心,充分利用互联网的功能来实现自己想要完成的任务,使网络成为传递服务、计算力和信息的综合媒介,真正实现按需计算、多人协作。近两年微软、google等各大IT公司都投入了巨大的人力与财力致力于云计算的发展,云计算技术日趋得到完善,并已经在教育中进行了初步的应用。
考虑到以上两种情况,我们试探性的把云计算应用于移动学习领域,试图通过搭建一个基于云计算的移动学习系统,来解决移动学习发展中所面临的问题。在研究中我们对大量的相关文献进行调研、总结与比较,通过调研移动学习国内外研究的现状,找到移动学习目前发展中存在的问题。并深入了解了移动学习的理论基础,掌握了移动学习系统设计的几大原则。通过对云计算的文献、网站等相关资料的调研。深入地了解了云计算的工作原理,体系结构、服务层次,以及云计算对移动学习所产生的正面影响后,对目前几大主要的云计算平台进行比较后,选择利用开源的云计算平台Hadoop来搭建云计算环境,并设计出了基于Hadoop的移动学习系统的理论模型,在模型中除了参照传统的移动学习系统设计以外,着重利用云计算技术为移动学习提供了海量的存储服务与高性能计算服务。在大量的阅读了关于Hadoop的文献资料,掌握了分布式文件系统HDFS与MapReduce框架的原理。成功的利用Hadoop搭建了云计算环境,并利用WAP技术、虚拟化技术、AJAX技术成功实现了移动学习系统的部分功能。并在最后对系统做了关于存储与高性能计算方面的测试,测试结果也证明了云计算技术是移动学习发展最好的选择。在论文的最后总结了本研究的成果与不足,并对下一步工作做了展望。
With the rapid development of the network technology and mobile communication technology, especially after the bottleneck of network communication speed of mobile Internet has been broken through by 3G technology, the number of mobile netizen experiences a rapid growth in our country. Meanwhile, in a new era of the expanding information, the demand for learning is increasing, and it is an urgent need for a new mobile learning to achieve learning anytime, anywhere and portably. However, as the common mobile learning devices (for example mobile phone) have constraints in volume, the capacities of computing and storage will not be high. Thus the mobile learning modes are prevented from popularizing additionally.
Moreover, as a new way of network services, cloud computing is recognized and concerned by many scholars and experts. It transforms the desktop-centered processing of task into a network-centered one, and completes all the intended tasks with Internet to make the network as combined media for delivery services, computing power and information, where the calculating on demand and multi-person cooperative are truly achieved. During the recent two years, Microsoft, google and other large IT companies have invested enormous financial and human resources to develop cloud computing. And the technology of cloud computing has been improved gradually, and applied in education preliminarily.
Taking both the cases above into account, we try to apply the cloud computing in the field of mobile learning, and build a mobile learning system based on cloud computing to address the problems in the mobile learning.
With survey, summary and comparison of extensive literature, this paper researches the following aspects. Find the problems of current development of mobile learning through researches on the status of mobile learning at home and abroad. Have a deep understanding of the theoretical basis for mobile learning, and master several principles to design mobile learning system. Investigate the literature, web site and other relevant information about cloud computing. Deeply understand the working principle, system architecture and service level of cloud computing, and the positive impact that the cloud computing has caused on mobile learning. Compare several major cloud computing platforms, and select open source cloud computing platform Hadoop to build a cloud computing environment. And design a theoretical model of mobile learning system based on Hadoop. In this model, apart from the reference to the traditional system design of mobile learning, it emphasizes to provide storage services and high-performance computing services with cloud computing technology for mobile learning. Read a lot of literature on the Hadoop, and get over the principles of distributed file system HDFS and MapReduce framework. Build a cloud computing environment with Hadoop successfully, and a part of the functions of mobile learning system was implemented by WAP technology, virtualization technology and AJAX technology. The system was tested about the storage and high-performance computing, and the result has proved that cloud computing is the best choice for the development of mobile learning. Finally, this paper summarized the achievements and shortage and looked forward to the future work.
与此同时,云计算作为一种全新网络服务方式,受到众多学者、专家的认可与追捧。它将任务处理的模式由传统的以桌面为核心的转变为以网络为核心,充分利用互联网的功能来实现自己想要完成的任务,使网络成为传递服务、计算力和信息的综合媒介,真正实现按需计算、多人协作。近两年微软、google等各大IT公司都投入了巨大的人力与财力致力于云计算的发展,云计算技术日趋得到完善,并已经在教育中进行了初步的应用。
考虑到以上两种情况,我们试探性的把云计算应用于移动学习领域,试图通过搭建一个基于云计算的移动学习系统,来解决移动学习发展中所面临的问题。在研究中我们对大量的相关文献进行调研、总结与比较,通过调研移动学习国内外研究的现状,找到移动学习目前发展中存在的问题。并深入了解了移动学习的理论基础,掌握了移动学习系统设计的几大原则。通过对云计算的文献、网站等相关资料的调研。深入地了解了云计算的工作原理,体系结构、服务层次,以及云计算对移动学习所产生的正面影响后,对目前几大主要的云计算平台进行比较后,选择利用开源的云计算平台Hadoop来搭建云计算环境,并设计出了基于Hadoop的移动学习系统的理论模型,在模型中除了参照传统的移动学习系统设计以外,着重利用云计算技术为移动学习提供了海量的存储服务与高性能计算服务。在大量的阅读了关于Hadoop的文献资料,掌握了分布式文件系统HDFS与MapReduce框架的原理。成功的利用Hadoop搭建了云计算环境,并利用WAP技术、虚拟化技术、AJAX技术成功实现了移动学习系统的部分功能。并在最后对系统做了关于存储与高性能计算方面的测试,测试结果也证明了云计算技术是移动学习发展最好的选择。在论文的最后总结了本研究的成果与不足,并对下一步工作做了展望。
With the rapid development of the network technology and mobile communication technology, especially after the bottleneck of network communication speed of mobile Internet has been broken through by 3G technology, the number of mobile netizen experiences a rapid growth in our country. Meanwhile, in a new era of the expanding information, the demand for learning is increasing, and it is an urgent need for a new mobile learning to achieve learning anytime, anywhere and portably. However, as the common mobile learning devices (for example mobile phone) have constraints in volume, the capacities of computing and storage will not be high. Thus the mobile learning modes are prevented from popularizing additionally.
Moreover, as a new way of network services, cloud computing is recognized and concerned by many scholars and experts. It transforms the desktop-centered processing of task into a network-centered one, and completes all the intended tasks with Internet to make the network as combined media for delivery services, computing power and information, where the calculating on demand and multi-person cooperative are truly achieved. During the recent two years, Microsoft, google and other large IT companies have invested enormous financial and human resources to develop cloud computing. And the technology of cloud computing has been improved gradually, and applied in education preliminarily.
Taking both the cases above into account, we try to apply the cloud computing in the field of mobile learning, and build a mobile learning system based on cloud computing to address the problems in the mobile learning.
With survey, summary and comparison of extensive literature, this paper researches the following aspects. Find the problems of current development of mobile learning through researches on the status of mobile learning at home and abroad. Have a deep understanding of the theoretical basis for mobile learning, and master several principles to design mobile learning system. Investigate the literature, web site and other relevant information about cloud computing. Deeply understand the working principle, system architecture and service level of cloud computing, and the positive impact that the cloud computing has caused on mobile learning. Compare several major cloud computing platforms, and select open source cloud computing platform Hadoop to build a cloud computing environment. And design a theoretical model of mobile learning system based on Hadoop. In this model, apart from the reference to the traditional system design of mobile learning, it emphasizes to provide storage services and high-performance computing services with cloud computing technology for mobile learning. Read a lot of literature on the Hadoop, and get over the principles of distributed file system HDFS and MapReduce framework. Build a cloud computing environment with Hadoop successfully, and a part of the functions of mobile learning system was implemented by WAP technology, virtualization technology and AJAX technology. The system was tested about the storage and high-performance computing, and the result has proved that cloud computing is the best choice for the development of mobile learning. Finally, this paper summarized the achievements and shortage and looked forward to the future work.
引文
[1] [DB/OL]. http://www.cnnic.net.cn/html/Dir/2010/01/15/5767.htm.
[2]王润华.移动学习系统研究[D].上海:华东师范大学,2006.
[3]孙少陵.罗治国.云计算及应用的研究与实现[J].电信工程技术与标准化,2009(11):2-5.
[4]刘建设.移动学习研究现状综述[J].电化教育研究,2007(7):21-25.
[5]叶成林.移动学习研究综述[J].电化教育研究,2006(3):12-19.
[6] Dichanz, H. e2L earning, a linguistic, psycho logical and pedagogical analysis of a misleading term [R]. Paper p resented at the20th ICDE World Conference in Düsseldorf 2001.
[7] Fagerberg, T. Designing for the PDA Environment. Paper to the Conference“m 2L earning: The Cutting edge”, final conference of the EUL eonardo Project“From e2L earning to m 2L earning”.
[8] Fagerberg, T. &Bredal, S. 2002: Technical working paper 2002, N K I Distance Education.
[9]魏洪伟.移动学习理论研究与实践[J].计算机工程与科学,2009,31(9):135-141.
[10]叶成林.基于网格的移动学习系统建模与设计研究[D].广州:华南师范大学,2006.
[11]许诣博.基于WAP的移动学习系统[J].吉林大学学报,2009,27(3):278-281.
[12]孙怡夏.移动学习系统建构与应用研究[D].上海:上海交通大学,2008.
[13] M-Learning Forum Meeting [DB/OL].http://www. Pjb.co.uk/M-learning/helsinki. htm.
[14]白俊.移动学习的发展现状及其启示[J].中国现代教育装备,2007(5):125-127
[15]崔光佐等.移动教育——现代教育技术的一个新方向[DB/OL ]. http: //www. hebiat. edu.cn/jjzx/MET/journal/articledigest12/meeting- 8.htm.
[16]孙剑华.未来云计算在云端[J].现代教育技术,2009(8):60-63.
[17]云计算的技术原理[DB/OL].http://www.chinacloud.cn/show.aspx?id=1929&cid=12.
[18]王萍.云计算与网络学习[J].现代教育技术,2008(11):81-84.
[19]祁金华.云计算揭秘[J ].网络世界, 2008 (2) :7 - 8.
[20] Sanjay Madria, Kalpdrum Passi, Sourav Bhow mick. An XML schema integration and query mechanism system [J] .Data & Know ledge Engineering, 2008(65): 266- 303.
[21]祁金华.云计算:网格计算的2.0.[EB/OL]..
[22]富益群.泛谈云计算的发展之路[J].程序员,2008,(11):43.
[23]虎莹.浅谈云计算在气象事业中的展望[J].计算机工程应用技术,2009,5(7):5876-5879.
[24]高宏卿,邢颖.基于经济学的云资源管理模型研究[J].计算机工程与设计,2010(10):68-72.
[25]余宗泽.云计算的基本原理及其对教育领域的影响[J].卫星电视与宽带多媒体,2010(6):67-70.
[26]冯坚.基于云计算的现代远程教育展望[J].中国电化教育,2009(10):39-42.
[27] [DB/OL]. http://hadoop.apache.org/.
[28]邓自立.云计算的网络拓扑设计与Hadoop平台研究[D].安徽:中国科学技术大学,2009.
[29]陈全.云计算及其关键技术[J].计算机应用,2009,29(9):2562-2566.
[30]高垣.基于WAP2.0的移动学习系统设计与实现[D].西安:西北大学,2010.
[31]胡桂兰,石昭祥. WAP PUSH技术在网络图书馆信息服务中的应用[J].微电子学计算机,2007(2):68-72.
[32]鲁松.计算机虚拟化技术及应用[M].北京:机械工业出版社,2008.
[33]何禹.虚拟化技术在校园网数据中心的应用[J].电子科技大学学报,2007(6):1461-1464.
[34]张为民.云计算深刻改变未来[M].北京:科学出版社,2009:72-75.
[35]王昊鹏.虚拟化技术在云计算中的应用初探[J].电脑知识与技术,2008(9):1554-1565.
[36]朱哲.基于社会性软件的大学生非正式学习模式构建[J].电化教育研究,2010(2):84-87.
[37]杨旭东.基于网络的行动模式探索[J].开放学习,2006(9):33-35.
[38]陈国松.终身教育背景下的移动学习系统研究[D].武汉:华中科技大学大学,2008.
[39]张振新.情境学习理论研究综述[J].心理科学,2005,28(1):125-127.
[40]田越.几种移动学习方式比较[J].中国医学教育技术,2004,18(2):72-76.
[41]黄成云.基于云计算的移动学习系统设计[J].现代教育技术,2010,20(8):72-76:102-105.
[42]高宏卿,翟炎杰.基于Hadoop的移动学习模型研究[J].中国电化教育,2011(1):67-71.
[43]曾龙海,张博锋.基于云计算平台的虚拟集群构建技术研究[J].微电子学与计算机,2010,27(8):31-35. [44高宏卿,汪浩.基于云存储的教学资源整合研究与实现[J].现代教育技术, 2010, 20(3):97-101.
[45]王鹏.走进云计算[M].北京:人民邮电出版社,2009:123-124.
[46]王鹏.董静宜一种云计算架构的实现方法研究[J].计算机工程与科学,2009,31(A1):11-14.
[47] David P.Anderson,Jeff Cobb,Eric Korpela. SETI@home: An Experiment in Public-Resource Computing [J].COMMUNICATIONS OF THE ACM, 2002, 45(11):57-58.
[2]王润华.移动学习系统研究[D].上海:华东师范大学,2006.
[3]孙少陵.罗治国.云计算及应用的研究与实现[J].电信工程技术与标准化,2009(11):2-5.
[4]刘建设.移动学习研究现状综述[J].电化教育研究,2007(7):21-25.
[5]叶成林.移动学习研究综述[J].电化教育研究,2006(3):12-19.
[6] Dichanz, H. e2L earning, a linguistic, psycho logical and pedagogical analysis of a misleading term [R]. Paper p resented at the20th ICDE World Conference in Düsseldorf 2001.
[7] Fagerberg, T. Designing for the PDA Environment. Paper to the Conference“m 2L earning: The Cutting edge”, final conference of the EUL eonardo Project“From e2L earning to m 2L earning”.
[8] Fagerberg, T. &Bredal, S. 2002: Technical working paper 2002, N K I Distance Education.
[9]魏洪伟.移动学习理论研究与实践[J].计算机工程与科学,2009,31(9):135-141.
[10]叶成林.基于网格的移动学习系统建模与设计研究[D].广州:华南师范大学,2006.
[11]许诣博.基于WAP的移动学习系统[J].吉林大学学报,2009,27(3):278-281.
[12]孙怡夏.移动学习系统建构与应用研究[D].上海:上海交通大学,2008.
[13] M-Learning Forum Meeting [DB/OL].http://www. Pjb.co.uk/M-learning/helsinki. htm.
[14]白俊.移动学习的发展现状及其启示[J].中国现代教育装备,2007(5):125-127
[15]崔光佐等.移动教育——现代教育技术的一个新方向[DB/OL ]. http: //www. hebiat. edu.cn/jjzx/MET/journal/articledigest12/meeting- 8.htm.
[16]孙剑华.未来云计算在云端[J].现代教育技术,2009(8):60-63.
[17]云计算的技术原理[DB/OL].http://www.chinacloud.cn/show.aspx?id=1929&cid=12.
[18]王萍.云计算与网络学习[J].现代教育技术,2008(11):81-84.
[19]祁金华.云计算揭秘[J ].网络世界, 2008 (2) :7 - 8.
[20] Sanjay Madria, Kalpdrum Passi, Sourav Bhow mick. An XML schema integration and query mechanism system [J] .Data & Know ledge Engineering, 2008(65): 266- 303.
[21]祁金华.云计算:网格计算的2.0.[EB/OL].
[22]富益群.泛谈云计算的发展之路[J].程序员,2008,(11):43.
[23]虎莹.浅谈云计算在气象事业中的展望[J].计算机工程应用技术,2009,5(7):5876-5879.
[24]高宏卿,邢颖.基于经济学的云资源管理模型研究[J].计算机工程与设计,2010(10):68-72.
[25]余宗泽.云计算的基本原理及其对教育领域的影响[J].卫星电视与宽带多媒体,2010(6):67-70.
[26]冯坚.基于云计算的现代远程教育展望[J].中国电化教育,2009(10):39-42.
[27] [DB/OL]. http://hadoop.apache.org/.
[28]邓自立.云计算的网络拓扑设计与Hadoop平台研究[D].安徽:中国科学技术大学,2009.
[29]陈全.云计算及其关键技术[J].计算机应用,2009,29(9):2562-2566.
[30]高垣.基于WAP2.0的移动学习系统设计与实现[D].西安:西北大学,2010.
[31]胡桂兰,石昭祥. WAP PUSH技术在网络图书馆信息服务中的应用[J].微电子学计算机,2007(2):68-72.
[32]鲁松.计算机虚拟化技术及应用[M].北京:机械工业出版社,2008.
[33]何禹.虚拟化技术在校园网数据中心的应用[J].电子科技大学学报,2007(6):1461-1464.
[34]张为民.云计算深刻改变未来[M].北京:科学出版社,2009:72-75.
[35]王昊鹏.虚拟化技术在云计算中的应用初探[J].电脑知识与技术,2008(9):1554-1565.
[36]朱哲.基于社会性软件的大学生非正式学习模式构建[J].电化教育研究,2010(2):84-87.
[37]杨旭东.基于网络的行动模式探索[J].开放学习,2006(9):33-35.
[38]陈国松.终身教育背景下的移动学习系统研究[D].武汉:华中科技大学大学,2008.
[39]张振新.情境学习理论研究综述[J].心理科学,2005,28(1):125-127.
[40]田越.几种移动学习方式比较[J].中国医学教育技术,2004,18(2):72-76.
[41]黄成云.基于云计算的移动学习系统设计[J].现代教育技术,2010,20(8):72-76:102-105.
[42]高宏卿,翟炎杰.基于Hadoop的移动学习模型研究[J].中国电化教育,2011(1):67-71.
[43]曾龙海,张博锋.基于云计算平台的虚拟集群构建技术研究[J].微电子学与计算机,2010,27(8):31-35. [44高宏卿,汪浩.基于云存储的教学资源整合研究与实现[J].现代教育技术, 2010, 20(3):97-101.
[45]王鹏.走进云计算[M].北京:人民邮电出版社,2009:123-124.
[46]王鹏.董静宜一种云计算架构的实现方法研究[J].计算机工程与科学,2009,31(A1):11-14.
[47] David P.Anderson,Jeff Cobb,Eric Korpela. SETI@home: An Experiment in Public-Resource Computing [J].COMMUNICATIONS OF THE ACM, 2002, 45(11):57-58.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |