基于LeapMotion的个体化手部建模与实时交互

Individualized Hand Modeling and Real-Time Interaction Based on LeapMotion

中文关键词:  测试及仪器  个体化手部运动交互  运动学  人手

英文关键词:measurement and instrumentation  individualized hand movement interaction  kinematics  human hand

中文摘要:

      虚拟人手的实时建模是以人机交互为核心的VR/AR系统中的重要技术难点，传统的基于LeapMotion的手部跟踪视觉反馈仅展示骨架动画信息，缺少应用演示的真实感。由此，提出了一个快速高效的个体化手部建模与实时交互系统，重点阐述了该系统的的工作原理以及算法。以含有骨架信息的静止手模型为模板，使用LeapMotion跟踪用户手的骨架数据作为输入，提出了基于骨骼尺寸的手部模型自动个体化建模算法。提供了一种基于不完整骨骼运动数据的线性蒙皮技术的改进算法，可快速计算不同手部姿势下骨架之间的变换矩阵，动态更新虚拟手的姿势。实验结果表明，此系统在实验的硬件平台上运行速度可以达到60 f/s，误差稳定在4 mm以内，能为人机交互任务实时提供真实可靠的视觉反馈。

英文摘要:

      The real-time modeling of virtual human hands is an important technical difficulty in the user interactions for VR/AR system.Conventional hand tracking based on the LeapMotion sensor only display the skeleton animation,and lack the realism of application display.Therefore,a fast and efficient individualized hand modeling and real-time interaction system is proposed,the working principle and algorithm of the system are introduced in detail.Based on the static hand model with skeleton information and the skeleton data of hands from LeapMotion sensor,an automatic individualized modeling algorithm based on the size of hand bone was presented.An improved algorithm for linear skinning animation based on incomplete skeletal motion data was provided,which can be used for calculating the transformation between the skeletons of different hand postures.Experiments show that the system can be achieved in 60 f/s,the error is less than 4 mm,and provides real and robust visual feedback for human-computer interaction tasks.