基于对象存储控制器的软件设计与实现
|
摘要
作为下一代互联网信息存储的核心技术,基于对象的存储系统结合了SAN(Storage Area Network)基于块存储和NAS(Network Attached Storage)基于文件存储的优势,提供了功能更加丰富的对象接口,在数据共享、安全性及智能化方面得到突破,具有多层次、可扩展、高性能、高安全性的特点。
基于对象的存储设备作为系统中的存储实体,一方面需要承担对象的存储管理、设备安全管理、设备与外界的网络通讯等功能;另外一方面需要实现设备的智能化,能够分析负载特征和对象属性,进行数据对象的预取和缓存。
基于对象的存储设备在数据传输方面,采用Intel的微处理器80314,它内部采用64位的交换结构网络;在数据处理方面,采用Intel的微处理器80200双CPU。对外接口采用2个31244 SATA(Serial ATA)控制器和1个千兆物理层网络控制器。基于对象的存储设备整个控制软件构建在实时操作系统TimeSys Linux之上,完成iSCSI(Internet SCSI)的命令解析以及OSD(Objected-based Storage Device)命令解析。由基于对象文件系统负责对象数据及其属性在磁盘上的存放、空闲磁盘的空间管理,其中索引区的搜索,采用B+树技术,可以提高磁盘位置的索引速度;数据区的管理,采用Buddy算法技术,可以提高磁盘空间的利用率;数据的动态预取算法,可以提高数据的读取速度。由Intel GD 31244驱动程序完成对该芯片的控制,实现了DPA(Direct Port Access)的数据传输模式,使多个磁盘设备可以同时访问,从而提供了更好的传输性能。
最后分别在开发板Intel 80314实现驱动程序的数据测试和在软件平台上实现OBFS(Object-based File System)文件系统的数据测试。驱动程序满足磁盘的读写,文件系统在32KB缓存的性能优化下和网络文件系统性能相当。
As the key technology of next generation Internet storage, Object-based storage system integrates SAN which is ba sed on block storage and NAS which is based on file storage. It provides an expressive object-level interface to user and improves the performance of the whole storage system in terms of data sharing, security and intelligence. The characteristic of the Object-based storage system is hierarchical structure, strong scalability, high performance and strong reliability.
Object-based storage device is physical element of the system. It abstracts away file storage details such as allocation and scheduling, semi-independently managing. It is with responsibility for space management, security management and data transmission management. And it needs to analyze system load characteristic, optimize the disk layout and prefetch data object.
Object-based storage device transfers object with Intel 80314 which is based switch network structure and process object with Intel 80200. It connects disks with two 31244 SATA controllers and Internet with one 1000M network controller. Its whole software structure is built on TimeSys Linux, a kind of real time operation system and designed to interpret iSCSI command and OSD command.The key technologies of software development are Object-based file system and Intel 31244 controller driver. Object-based file system is designed for data and attributer management, free disk space management .B+ tree technology is used to enhance researching speed,buddy arithmetic technology is developed to increase using rate of disk space and data dynamic prefetch technology is used to improve IO rate.Intel 31244 driver is developed for Intel 31244 SATA controller.DPA data trandfer mode is implemented to make disks accessed independenly,and this mode offers better preformace.
Finally Intel 31244 driver is tested on Intel 80314 development board , and OBFS file system is tested on the software platform. Driver can satisfy the needs of disks' read and write. File system have the equivalent performance to NFS when buffer is set to 32KB.
基于对象的存储设备作为系统中的存储实体,一方面需要承担对象的存储管理、设备安全管理、设备与外界的网络通讯等功能;另外一方面需要实现设备的智能化,能够分析负载特征和对象属性,进行数据对象的预取和缓存。
基于对象的存储设备在数据传输方面,采用Intel的微处理器80314,它内部采用64位的交换结构网络;在数据处理方面,采用Intel的微处理器80200双CPU。对外接口采用2个31244 SATA(Serial ATA)控制器和1个千兆物理层网络控制器。基于对象的存储设备整个控制软件构建在实时操作系统TimeSys Linux之上,完成iSCSI(Internet SCSI)的命令解析以及OSD(Objected-based Storage Device)命令解析。由基于对象文件系统负责对象数据及其属性在磁盘上的存放、空闲磁盘的空间管理,其中索引区的搜索,采用B+树技术,可以提高磁盘位置的索引速度;数据区的管理,采用Buddy算法技术,可以提高磁盘空间的利用率;数据的动态预取算法,可以提高数据的读取速度。由Intel GD 31244驱动程序完成对该芯片的控制,实现了DPA(Direct Port Access)的数据传输模式,使多个磁盘设备可以同时访问,从而提供了更好的传输性能。
最后分别在开发板Intel 80314实现驱动程序的数据测试和在软件平台上实现OBFS(Object-based File System)文件系统的数据测试。驱动程序满足磁盘的读写,文件系统在32KB缓存的性能优化下和网络文件系统性能相当。
As the key technology of next generation Internet storage, Object-based storage system integrates SAN which is ba sed on block storage and NAS which is based on file storage. It provides an expressive object-level interface to user and improves the performance of the whole storage system in terms of data sharing, security and intelligence. The characteristic of the Object-based storage system is hierarchical structure, strong scalability, high performance and strong reliability.
Object-based storage device is physical element of the system. It abstracts away file storage details such as allocation and scheduling, semi-independently managing. It is with responsibility for space management, security management and data transmission management. And it needs to analyze system load characteristic, optimize the disk layout and prefetch data object.
Object-based storage device transfers object with Intel 80314 which is based switch network structure and process object with Intel 80200. It connects disks with two 31244 SATA controllers and Internet with one 1000M network controller. Its whole software structure is built on TimeSys Linux, a kind of real time operation system and designed to interpret iSCSI command and OSD command.The key technologies of software development are Object-based file system and Intel 31244 controller driver. Object-based file system is designed for data and attributer management, free disk space management .B+ tree technology is used to enhance researching speed,buddy arithmetic technology is developed to increase using rate of disk space and data dynamic prefetch technology is used to improve IO rate.Intel 31244 driver is developed for Intel 31244 SATA controller.DPA data trandfer mode is implemented to make disks accessed independenly,and this mode offers better preformace.
Finally Intel 31244 driver is tested on Intel 80314 development board , and OBFS file system is tested on the software platform. Driver can satisfy the needs of disks' read and write. File system have the equivalent performance to NFS when buffer is set to 32KB.
引文
[1] 张悠慧, 郑纬民. 一种新的网络对象存储设备研究. 电子学报, 2003, 31(5): 679~682
[2] Grimm R., Swift M.,Henry M. Revisiting structured storage : A transactional record store [R] . Technical Report UW-CSE-00-04-01 ,USA: University of Washington ,Department of Computer Science and Engineering, April 2000. 54~67
[3] Steven D Gribble Scalable :Distributed data structures for internet service construction [A] . In : Proceedings of the Fourth Symposium on Operating Systems Design and Implementation (OSDI 2000) [C] . San Diego ,USA:USENIX Press ,October 2000. 181~190
[4] Duffy D., Acks N., Noga V., et al. Beyond the Storage Area Networking: Data Intensive Computing in a Distributed Environment. In : Proceeding of the 22nd IEEE/13th NASA Goddard Conference on Mass Storage System Technologies (MSST’05). American: IEEE Computer Society, 2005. 232~236
[5] Gibson G. A.,Nagle D. P., Amiri K., et al. Filesystems for Network-attachedSecure Disks. Technical Report CMU-CS, 1997, March:1~18
[6] Satran J., Smith D., Meth K., et al. iSCSI draft standard. Http://www.ietf.org/internet-drafts/draft-ietfips-iscsi-03.txt,2004 .7~78
[7] Bogdan C., Maarten S., Andrew S. A Security Architecture for Object-Based Distributed Systems. In :Proceeding of the 18th Annual Computer Security Applications Conference (ACSAC '02), America: IEEE Computer Society, 2002.161~164
[8] Kher V., Yongdae K. Decentralized Authentication Mechanisms for Object-based Storage Devices. In :Security in Storage Workshop, 2003. SISW '03. Proceedings of the Second IEEE International. America: IEEE Computer Society, 2003. 1~3
[9] Dan Feng, Lingfang Zeng, Fang Wang, et al. Adaptive policy triggermechanism for OBSS. In :Advanced Information Networking and Applications, 2005. AINA 2005. 19th International Conference on. 2005, Volume 2:591~595
[10] Yingping Lu, David H. C. Du, Tom R. Qos Provisioning Framework for an OSD-based Storage System. In :Proceeding of the 22nd IEEE/13th NASA Goddard Conference On Mass Storage System Technologies (MSST’05). American: IEEE Computer Society, 2005. 135~139
[11] Dahal K. P., Burt G. M., NcDonald J. R., et al. A case study of scheduling storage tanks using a hybrid genetic algorithm. Evolutionary Computation, IEEE Transactions on Volume 5, Issue 3, June 2001 .283~294
[12] Menon J., Pease D. A., Rees R., et al. IBM Storage Tank-A heterogeneous scalable SAN file system. IBM SYSTEMS JOURNAL, 2003, 42(2):250~261
[13] Satran J., Teperman A. Object Store Based SAN File Systems. IBM SYSTEMS JOURNAL, 2003, 47(1):25~29
[14] Peter J. Cluster File Systems Inc. The Lustre Storage Architecture.Cluster File Systems, Inc Whiter Paper. http://www.clusterfs.com. 2003. 14~28
[15] Cluster File Systems Inc. Lustre: A Scalable, High-performance File System. Cluster File Systems, Inc Whiter Paper. Http://www.clusterfs.com. 2002. 1~12
[16] Panasas, Inc. ActiveScale Storage Cluster. Panasas White Paper. http://www.panasas.com. 2004. 2~8
[17] Hong Tang, Aziz Gulbeden, Jingyu Zhou, et al. The Panasas ActiveScale Storage Cluster-Delivering Scalable High Bandwidth Storage. In :Proceedings of the 2004 ACM/IEEE conference of Supercomputing. America: IEEE Computer Society, 2004. 53~58
[18] 郑纬民, 舒继武. 下一代分布式智能网络存储系统的发展趋势. 世界电信, 2004, 17(8):16~19
[19] 谭毓安, 余锋, 曹元大. 面向对象的网络存储技术. 高性能计算技术, 2003, 4(7): 10~13
[20] Mesnier M., Ganger G. R., Riedel E. Object-based storage. Communications Magazine, IEEE, 2003, Volume 41, Issue 8, Aug: 84~90
[21] Mesnier M., Ganger G. R., Riedel E. Object-based storage: pushing more functionality into storage. Potentials, IEEE, 2005, Volume 24, Issue 2, April-May: 31~34
[22] Mike M., Carnegie M., Ganger R.,et al. Object-Based Storage. IEEE Communication Magazine. August 2003. 84~91
[23] John B. Lohmeyer, George O. Penokie, Paul D. Aloisi, et al. Information technology-SCSI Object-Based Storage Device Commands (OSD). INCITS T10 Working Draft. http://www.t10.org/drafts.htm. 2005.17~20
[24] Ling-Fang Zeng, Dan Feng, Ling-Jun Qin. SOSS: Smart Object-Based Storage System. In : Proceedings of the Third International Conference on Machine Learning and Cybernetics. America: IEEE Computer Society, 2004. 3263~3266
[25] Dan Feng, Ling-Jun Qin, Ling-Fang Zeng, et al. A Scalable Object-Based Intelligent Storage Device.In : Proceedings of 2004 International Conference on Machine Learning and Cybernetics. 2004. 26~29
[26] Intel cooperation. Object-based Storage-The Next Wave of Storage Technology and Devices. Intel White Paper. http://www.intel.com/labs/storage/osd.1~7
[27] TimeSys Corporation.TimeSys Linux GPL: Performance Advanced for Embedded Systems. Timesys Corpporation White Paper. http://www.timesys.com. 2004. 6~10
[28] 蒋金虎,陈左宁,黄文政. 全局文件系统的设计与实现. 计算机工程,2005,31(1):71~74
[29] 吴娴. 嵌入式 Linux 文件系统的设计与实现. 计算机工程与应用,2005, 9(3):111~125
[30] Zhu Y., Jiang H., Quin X., et al. Design, Implementation and Performance Evaluation of a Cost Effective, Fault-Tolerant Virtual Parallel File System. In : Proceedings of International Workshop on Storage Network Architecture and Parallel I/Os SNAPI’03. America: IEEE Computer Society, 2003.56~65
[31] 周可,张江陵,丁振. 一种对文件系统透明的网络存储系统. 华中科技大学学报,2003, 31(3): 43~45
[32] Feng Wang OBFS: A File System for Object-based Storage Devices. In :21nd IEEE/12th NASA Goddard Conference on Mass Storage Systems and Technologies. American,2004.8~14
[33] 田清源,靳超,温冬婵.磁盘物理参数提取的研究.计算机工程与应用,2003.1,7(27):67~72
[34] Intel cooperation 31244 PCI-X Serial ATA Controller Datasheet Intel White Paper. http:// www.intel.com/design/storage/serialata/gd31244.htm .7~12
[35] Zhimei Jiang An Adaptive Network Prefetch Scheme. In :IEEE International Conference on Communications,Part1(of3) 1(1),June 1997.8~12
[36] Zheng Zhao,Jie Yang Measurement Based Intelligent Prefetch and Cache Technique in Web. In : Proceeding of the 1999 IEEE Canadian Conference on Electrical and Computer Engineering ,May 1999 .9~12
[37] 李晓钰,刘小龙, 谢长生.PCI 中断机制初探. 计算机应用研究,2002, 8(3):91~94
[38] 崔涛, 刘庆文, 胡玥. Linux系统下基于PCI控制器(PLX9054)的DMA编程. 微计算机信息,2005,10(1):95~97
[39] 周庆喜, 刘强. 基于嵌入式 Linux 系统的 DVB-CI 设备驱动程序开发, 计算机应用,2005,25(7):1698~1701
[40] 李 娟,胡和平,郭耀辉等. PCI 设备卡的 Linux 驱动程序设计. 计算机工程,2003,29(4);162~163
[41] 陈莉君.Linux 中 PCI 设备驱动程序的开发.计算机应用研究,2003, 7(1) :138~142
[42] 谌勇辉, 卢德良, 陈泽文等. 基于 IP 的 Linux 外设驱动生成. 计算机工程与应用,2005,9(20) :92~94
[43] 陈海华, 杨晨晖, 晏松. 基于 TriMedia 处理器的嵌入式 PCI 网卡的设计与分析. 计算机应用研究,2004,8(3) :158~161
[44] Katayama T.,Saisho K., Fukuda A. Prototype of the device driver generation system for UNIX-like operating systems Principles of Software Evolution, 2000.In :Proceedings of the International Symposium on 1-2 Nov 2000;302 ~310
[45] Sertic H., Rus F., Rac R., UML for real-time device driver developmentTelecommunications, 2003. ConTEL 2003.In : Proceedings of the 7th International Conference on Volume 2, 11-13 June 2003:631~636
[46] Imai Y., Yokouchi T., Inomo H., et al. A Linux-based engineering education with hardware implementation, device drivers' programming and network literacy learning;Information Technology Based Higher Education and Training, 2004. ITHET 2004. In : Proceedings of the FIfth International Conference on 31 May-2 June 2004:463~467
[2] Grimm R., Swift M.,Henry M. Revisiting structured storage : A transactional record store [R] . Technical Report UW-CSE-00-04-01 ,USA: University of Washington ,Department of Computer Science and Engineering, April 2000. 54~67
[3] Steven D Gribble Scalable :Distributed data structures for internet service construction [A] . In : Proceedings of the Fourth Symposium on Operating Systems Design and Implementation (OSDI 2000) [C] . San Diego ,USA:USENIX Press ,October 2000. 181~190
[4] Duffy D., Acks N., Noga V., et al. Beyond the Storage Area Networking: Data Intensive Computing in a Distributed Environment. In : Proceeding of the 22nd IEEE/13th NASA Goddard Conference on Mass Storage System Technologies (MSST’05). American: IEEE Computer Society, 2005. 232~236
[5] Gibson G. A.,Nagle D. P., Amiri K., et al. Filesystems for Network-attachedSecure Disks. Technical Report CMU-CS, 1997, March:1~18
[6] Satran J., Smith D., Meth K., et al. iSCSI draft standard. Http://www.ietf.org/internet-drafts/draft-ietfips-iscsi-03.txt,2004 .7~78
[7] Bogdan C., Maarten S., Andrew S. A Security Architecture for Object-Based Distributed Systems. In :Proceeding of the 18th Annual Computer Security Applications Conference (ACSAC '02), America: IEEE Computer Society, 2002.161~164
[8] Kher V., Yongdae K. Decentralized Authentication Mechanisms for Object-based Storage Devices. In :Security in Storage Workshop, 2003. SISW '03. Proceedings of the Second IEEE International. America: IEEE Computer Society, 2003. 1~3
[9] Dan Feng, Lingfang Zeng, Fang Wang, et al. Adaptive policy triggermechanism for OBSS. In :Advanced Information Networking and Applications, 2005. AINA 2005. 19th International Conference on. 2005, Volume 2:591~595
[10] Yingping Lu, David H. C. Du, Tom R. Qos Provisioning Framework for an OSD-based Storage System. In :Proceeding of the 22nd IEEE/13th NASA Goddard Conference On Mass Storage System Technologies (MSST’05). American: IEEE Computer Society, 2005. 135~139
[11] Dahal K. P., Burt G. M., NcDonald J. R., et al. A case study of scheduling storage tanks using a hybrid genetic algorithm. Evolutionary Computation, IEEE Transactions on Volume 5, Issue 3, June 2001 .283~294
[12] Menon J., Pease D. A., Rees R., et al. IBM Storage Tank-A heterogeneous scalable SAN file system. IBM SYSTEMS JOURNAL, 2003, 42(2):250~261
[13] Satran J., Teperman A. Object Store Based SAN File Systems. IBM SYSTEMS JOURNAL, 2003, 47(1):25~29
[14] Peter J. Cluster File Systems Inc. The Lustre Storage Architecture.Cluster File Systems, Inc Whiter Paper. http://www.clusterfs.com. 2003. 14~28
[15] Cluster File Systems Inc. Lustre: A Scalable, High-performance File System. Cluster File Systems, Inc Whiter Paper. Http://www.clusterfs.com. 2002. 1~12
[16] Panasas, Inc. ActiveScale Storage Cluster. Panasas White Paper. http://www.panasas.com. 2004. 2~8
[17] Hong Tang, Aziz Gulbeden, Jingyu Zhou, et al. The Panasas ActiveScale Storage Cluster-Delivering Scalable High Bandwidth Storage. In :Proceedings of the 2004 ACM/IEEE conference of Supercomputing. America: IEEE Computer Society, 2004. 53~58
[18] 郑纬民, 舒继武. 下一代分布式智能网络存储系统的发展趋势. 世界电信, 2004, 17(8):16~19
[19] 谭毓安, 余锋, 曹元大. 面向对象的网络存储技术. 高性能计算技术, 2003, 4(7): 10~13
[20] Mesnier M., Ganger G. R., Riedel E. Object-based storage. Communications Magazine, IEEE, 2003, Volume 41, Issue 8, Aug: 84~90
[21] Mesnier M., Ganger G. R., Riedel E. Object-based storage: pushing more functionality into storage. Potentials, IEEE, 2005, Volume 24, Issue 2, April-May: 31~34
[22] Mike M., Carnegie M., Ganger R.,et al. Object-Based Storage. IEEE Communication Magazine. August 2003. 84~91
[23] John B. Lohmeyer, George O. Penokie, Paul D. Aloisi, et al. Information technology-SCSI Object-Based Storage Device Commands (OSD). INCITS T10 Working Draft. http://www.t10.org/drafts.htm. 2005.17~20
[24] Ling-Fang Zeng, Dan Feng, Ling-Jun Qin. SOSS: Smart Object-Based Storage System. In : Proceedings of the Third International Conference on Machine Learning and Cybernetics. America: IEEE Computer Society, 2004. 3263~3266
[25] Dan Feng, Ling-Jun Qin, Ling-Fang Zeng, et al. A Scalable Object-Based Intelligent Storage Device.In : Proceedings of 2004 International Conference on Machine Learning and Cybernetics. 2004. 26~29
[26] Intel cooperation. Object-based Storage-The Next Wave of Storage Technology and Devices. Intel White Paper. http://www.intel.com/labs/storage/osd.1~7
[27] TimeSys Corporation.TimeSys Linux GPL: Performance Advanced for Embedded Systems. Timesys Corpporation White Paper. http://www.timesys.com. 2004. 6~10
[28] 蒋金虎,陈左宁,黄文政. 全局文件系统的设计与实现. 计算机工程,2005,31(1):71~74
[29] 吴娴. 嵌入式 Linux 文件系统的设计与实现. 计算机工程与应用,2005, 9(3):111~125
[30] Zhu Y., Jiang H., Quin X., et al. Design, Implementation and Performance Evaluation of a Cost Effective, Fault-Tolerant Virtual Parallel File System. In : Proceedings of International Workshop on Storage Network Architecture and Parallel I/Os SNAPI’03. America: IEEE Computer Society, 2003.56~65
[31] 周可,张江陵,丁振. 一种对文件系统透明的网络存储系统. 华中科技大学学报,2003, 31(3): 43~45
[32] Feng Wang OBFS: A File System for Object-based Storage Devices. In :21nd IEEE/12th NASA Goddard Conference on Mass Storage Systems and Technologies. American,2004.8~14
[33] 田清源,靳超,温冬婵.磁盘物理参数提取的研究.计算机工程与应用,2003.1,7(27):67~72
[34] Intel cooperation 31244 PCI-X Serial ATA Controller Datasheet Intel White Paper. http:// www.intel.com/design/storage/serialata/gd31244.htm .7~12
[35] Zhimei Jiang An Adaptive Network Prefetch Scheme. In :IEEE International Conference on Communications,Part1(of3) 1(1),June 1997.8~12
[36] Zheng Zhao,Jie Yang Measurement Based Intelligent Prefetch and Cache Technique in Web. In : Proceeding of the 1999 IEEE Canadian Conference on Electrical and Computer Engineering ,May 1999 .9~12
[37] 李晓钰,刘小龙, 谢长生.PCI 中断机制初探. 计算机应用研究,2002, 8(3):91~94
[38] 崔涛, 刘庆文, 胡玥. Linux系统下基于PCI控制器(PLX9054)的DMA编程. 微计算机信息,2005,10(1):95~97
[39] 周庆喜, 刘强. 基于嵌入式 Linux 系统的 DVB-CI 设备驱动程序开发, 计算机应用,2005,25(7):1698~1701
[40] 李 娟,胡和平,郭耀辉等. PCI 设备卡的 Linux 驱动程序设计. 计算机工程,2003,29(4);162~163
[41] 陈莉君.Linux 中 PCI 设备驱动程序的开发.计算机应用研究,2003, 7(1) :138~142
[42] 谌勇辉, 卢德良, 陈泽文等. 基于 IP 的 Linux 外设驱动生成. 计算机工程与应用,2005,9(20) :92~94
[43] 陈海华, 杨晨晖, 晏松. 基于 TriMedia 处理器的嵌入式 PCI 网卡的设计与分析. 计算机应用研究,2004,8(3) :158~161
[44] Katayama T.,Saisho K., Fukuda A. Prototype of the device driver generation system for UNIX-like operating systems Principles of Software Evolution, 2000.In :Proceedings of the International Symposium on 1-2 Nov 2000;302 ~310
[45] Sertic H., Rus F., Rac R., UML for real-time device driver developmentTelecommunications, 2003. ConTEL 2003.In : Proceedings of the 7th International Conference on Volume 2, 11-13 June 2003:631~636
[46] Imai Y., Yokouchi T., Inomo H., et al. A Linux-based engineering education with hardware implementation, device drivers' programming and network literacy learning;Information Technology Based Higher Education and Training, 2004. ITHET 2004. In : Proceedings of the FIfth International Conference on 31 May-2 June 2004:463~467
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |