基于移动设备上增强现实系统的自然手势控制与研究
|
摘要
在实验中,搭建了一个基于Android设备上增强现实系统的手势控制系统,整个系统的核心在于通过Leap Motion提供的API编写程序来识别自定义手势部分。但是为了能够更直观的体验手势控制的交互方式,在实验中加入了增强现实的模块,该部分是通过一款增强现实的软件ARToolKit以及Android设备实现的。整个系统的实际运行过程是:手势识别程序通过控制器识别出手势,并将手势编号通过WiFi发送给Android端程序,Android程序根据编号切换图片,运行于PC端的ARToolKit程序通过摄像头识别图片,加载3D动画。
Under the protocol,we set up a gestures control system based on Android and Augmented Reality system. The most important apartment of the system is programming to recognize user-defined gestures with API offered by Leap Motion. However,we add Augmented Reality system to the experiment for better direct feels,and the system is based on a software named ARToolKit and Android device. The operational process of whole system is: First,program for gesture recognition recognize the gesture by Leap Motion and send the number of the gesture to the Android device by WiFi. Then,program,running on Android device,change the picture by the number. At last,ARToolKit program recognize the picture and upload Three-dimensional animation.
Under the protocol,we set up a gestures control system based on Android and Augmented Reality system. The most important apartment of the system is programming to recognize user-defined gestures with API offered by Leap Motion. However,we add Augmented Reality system to the experiment for better direct feels,and the system is based on a software named ARToolKit and Android device. The operational process of whole system is: First,program for gesture recognition recognize the gesture by Leap Motion and send the number of the gesture to the Android device by WiFi. Then,program,running on Android device,change the picture by the number. At last,ARToolKit program recognize the picture and upload Three-dimensional animation.
引文
[1]王常磊.机器人嵌入式传感与人机交互技术设计[D].南京:南京理工大学,2017.
[2]吴福理,丁胤,丁维龙,等.基于Leap Motion的虚拟农作物人机交互系统设计[J].农业工程学报,2016(23):144-151.
[3]李泽玲.基于手势的机器人自然人机交互系统[D].广州:华南理工大学,2015.
[4]王毅.基于多智能体的工业监控人机交互系统[D].北京:北京化工大学,2013.
[5]余波.基于体感设备多媒体应用框架的研究与实现[D].广州:中山大学,2013.
[6] Leap Motion.Leap Motion product[EB/OL].(2014-05-14)[2015-02-15].http://www.leapmotion.com/product.
[7]潘佳佳,徐昆.基于Leap Motion的三维自由手势操作[J].中国科技论文,2015(2):207-212.
[8] Shukla J,Dwivedi A. A method for hand gesturerecognition[C]//2014 Fourth International Confer-ence on Communication Systems and NetworkTechnologies(CSNT),2014:919-923.
[9] Nielsen M,Storring M,Moeslund T B,et al. Aprocedure for development intuitive and ergonomicgesture interfaces for HCI[C]//5th International Gesture Workshop,Genova,Italy,2004:409-420.
[10]朱明敏.基于视觉的手势识别及其交互应用研究[D].南京:南京理工大学,2017.
[11]刘运强.基于增强现实的三维注册技术的研究与实现[D].上海:华东师范大学,2017.
[12]彭远洋.探索虚拟现实和增强现实动画技术在课堂教学中的应用[D].广州:广州大学,2017.
[13]侯颖,许威威.增强现实技术综述[J].计算机测量与控制,2017.25(2):1-7,22.
[14]王天明.基于头戴式摄像头的手势识别技术研究与应用[D].南京:东南大学,2016.
[15]靳雅博.多空中机器人的相互感知与任务协同[D].天津:中国民航大学,2015.
[16]胡广华,黄平. Windows环境下基于面向对象技术的ARToolKit通用编程框架研究[J].计算机应用研究,2009,26(11):4133-4144.
[17]黄俊,景红.基于Leap Motion的手势控制技术初探[J].计算机系统应用,2015,24(10):259-263.
[18]Potter L E,Araullo J,Carter L. The leap motioncontroller:A view on sign language[C]//Proceed-ings of the 25th Australian Computer-Human Inter-action Conference:Augmentation,Application,In-novation,Collaboration,New York,USA,2013:175-178.
[19]萧明. Leap Motion获取帧数据Getting Frame Data[EB/OL].[2013-08-11]http://blog.csdn.net/guoming0000/article/details/9904179.
[2]吴福理,丁胤,丁维龙,等.基于Leap Motion的虚拟农作物人机交互系统设计[J].农业工程学报,2016(23):144-151.
[3]李泽玲.基于手势的机器人自然人机交互系统[D].广州:华南理工大学,2015.
[4]王毅.基于多智能体的工业监控人机交互系统[D].北京:北京化工大学,2013.
[5]余波.基于体感设备多媒体应用框架的研究与实现[D].广州:中山大学,2013.
[6] Leap Motion.Leap Motion product[EB/OL].(2014-05-14)[2015-02-15].http://www.leapmotion.com/product.
[7]潘佳佳,徐昆.基于Leap Motion的三维自由手势操作[J].中国科技论文,2015(2):207-212.
[8] Shukla J,Dwivedi A. A method for hand gesturerecognition[C]//2014 Fourth International Confer-ence on Communication Systems and NetworkTechnologies(CSNT),2014:919-923.
[9] Nielsen M,Storring M,Moeslund T B,et al. Aprocedure for development intuitive and ergonomicgesture interfaces for HCI[C]//5th International Gesture Workshop,Genova,Italy,2004:409-420.
[10]朱明敏.基于视觉的手势识别及其交互应用研究[D].南京:南京理工大学,2017.
[11]刘运强.基于增强现实的三维注册技术的研究与实现[D].上海:华东师范大学,2017.
[12]彭远洋.探索虚拟现实和增强现实动画技术在课堂教学中的应用[D].广州:广州大学,2017.
[13]侯颖,许威威.增强现实技术综述[J].计算机测量与控制,2017.25(2):1-7,22.
[14]王天明.基于头戴式摄像头的手势识别技术研究与应用[D].南京:东南大学,2016.
[15]靳雅博.多空中机器人的相互感知与任务协同[D].天津:中国民航大学,2015.
[16]胡广华,黄平. Windows环境下基于面向对象技术的ARToolKit通用编程框架研究[J].计算机应用研究,2009,26(11):4133-4144.
[17]黄俊,景红.基于Leap Motion的手势控制技术初探[J].计算机系统应用,2015,24(10):259-263.
[18]Potter L E,Araullo J,Carter L. The leap motioncontroller:A view on sign language[C]//Proceed-ings of the 25th Australian Computer-Human Inter-action Conference:Augmentation,Application,In-novation,Collaboration,New York,USA,2013:175-178.
[19]萧明. Leap Motion获取帧数据Getting Frame Data[EB/OL].[2013-08-11]http://blog.csdn.net/guoming0000/article/details/9904179.