光纖式動作擷取系統

立體追蹤 (3D Motion Tracker) No Comments

This is a quick video illustrating how Measurand’s ShapeHand glove device can be used in the Quest3D software.

FiberMotion software (ShapeRecorder) 支援輸出以下格式:

BVH – skeletal data
3D – marker data
Cartesian

FiberMotion相容於以下軟體:

MOCAP (realt-time)
MotionBuilder (real-time)
ShapeRecorder (real-time)
3D Studio Max and Character Studio
XSI
Maya
Lightwave

_________________________________________________________________

在人機介面的研究領域之中,基於手勢的人機介面系統 (gesture-based systems) 一直是個重要的課題,在手形的辨識上市面上已有一些產品問世,例如CyberGloveDataGloveShapeHand 等基於手套式感應器的產品,然而此類基於手套式感應器的產品單價都在數萬元之上,且限制使用者必須穿戴特定的手套,對於實際的應用推廣有著相當大的阻力。 

 延伸閱讀 Exten link

Measurand, Inc

Mirax Technology

Practical Motion Capture in Everyday Surroundings

立體追蹤 (3D Motion Tracker), 電腦圖像(Computer Graphic) 1 Comment

mit.jpg

By Daniel Vlasic, Rolf Adelsberger, Giovanni Vannucci, John Barnwell, Markus Gross, Wojciech Matusik, Jovan Popovi´c

Commercial motion-capture systems produce excellent in-studio reconstructions, but offer no comparable solution for acquisition in everyday environments. We present a system for acquiring motions almost anywhere. This wearable system gathers ultrasonic time-of-flight and inertial measurements with a set of inexpensive miniature sensors worn on the garment. After recording, the information is combined using an Extended Kalman Filter to reconstruct joint configurations of a body. Experimental results show that even motions that are traditionally difficult to acquire are recorded with ease within their natural settings. Although our prototype does not reliably recover the global transformation, we show that the resulting motions are visually similar to the original ones, and that the combined acoustic and inertial system reduces the drift commonly observed in purely inertial systems. Our final results suggest that this system could become a versatile input device for a variety of augmented-reality applications.

商業化的動作擷取系統多數可在工作室內重建出來,但提供無法提供解決方法於每日週遭環境中。因次我們提供一套可以在任何地方使用的動作擷取系統。這個 穿戴式系統利用低廉的微型傳感器miniature sensors收集超音波time-of-flight與慣性量測資料。經過紀錄後,將資訊結合外部Kalman Filter建置身體關節點結構。實驗結果顯示,即使動作一般屬於難以透過自然設定被擷取與紀錄。隨然我們的Prototype並不是很穩定的去完成全部3D人體的變形,但我們顯示的結果是Motion與視覺化的人物非常相近,並結合音響和慣性的系統,降低drift,研究的最終結果是建議這套系統可以成為多功能輸入裝置給予擴增實境方面的應用

相關連結 Extenal Link

Practical Motion Capture in Everyday Surroundings

Jovan Popović

Puppet show

立體追蹤 (3D Motion Tracker), 電腦圖像(Computer Graphic), 科技(Technology) No Comments

PuppetShow is a system that allows people use there bodies to control virtual characters. Puppet show uses a webcam to track the movements of a puppet and translates the gestures into bone movements in a game engine. Puppet Show’s goal is remove confusing middleware (keyboards and mice) from the player interface and allow the users to use their body’s natural expressiveness to convey themselves in virtual environments.

PuppetShow was built with Processing and runs within the Unreal Runtime using custom characters. Currently PuppetShow is in the late alpha phases and can track any flat color puppet and relay the actions two different specialized characters: a duck and a panda. Currently the PuppetShow team is integrating the complete PuppetShow animation system into the standard Unreal skeletal system. In the near future PuppetShow will be able to control any Unreal character through the PuppetShow interface.

How it Works

PuppetShow in truth is actually two separate systems that communicate over a TCP link: the puppet tracker and the Unreal puppet animation system. Below is the overall flow diagram of how PuppetShow works.

puppet-show-overall.jpg

Puppet tracking is accomplished by using a puppet, a webcam, and the PuppetShow color tracking software. The color tracking software uses a refined blob tracking algorithm to track solid colors on a puppet. Since the tracking is based solely on color almost anything can act as a puppet: origami, gloves, socks, shirts and so forth! The tracking color can be set easily with the dynamic color calibration system. Based on a predetermined scheme, the tracking software then takes the blobs and translates them into usable information which is subsequently sent to the Unreal Runtime running the PuppetShow animation system.

The PuppetShow Mutator takes in values from the color tracker and translates them into bone translations and rotations. These are then applied to the character controlled 3D mesh (in the above diagram: a ducky!) which is subsequently displayed on the screen. An important note: PuppetShow does not interfere with the standard input devices of Unreal. This allows players to move and manipulate their characters as they would usually be able to.

action01.jpg

http://www.lcc.gatech.edu/~dhunt/puppetshow/index.htm

by devin grey hunt.

Visual Hand Tracking Using Occlusion Compensated Message Passing

立體追蹤 (3D Motion Tracker) No Comments

透過手部運動關係.進而尋找其手部的關聯性graspinghand.jpg

結構上,手部機近16個物件組合: 3個連接手指與拇指如手掌。這個 CASE手部模型簡化了二次曲面(橢面圓錐形圓柱面)去修正手部的尺寸。上方圖片先尋找手部初略輪廓Edges,右下圖片再經過原來的影像,右下2圖垂直軸旋轉35-70度之後輪廓。handgraphs.jpg

透過手部慣性,手部結構狀態與動態的系統參數執行:左圖為Hand運動的系統參數由各個關節點連接部同部位的手部物件,再根據手部結構上的系統參數對應手掌面()。最後將手部運動的系統參數與相關的手部姿勢關係連接,再與後面出現影像的Frames上,便可擷取影像上的模型參數。

作者:

Erik B. Sudderth, Michael I. Mandel, William T. Freeman & Alan S. Willsky

http://publications.csail.mit.edu/abstracts/abstracts05/sudderth/sudderth.html

066.gif   

戲偶的操作模式的手部追蹤. 透過相類似概念進行手部運動的系統參數建立.有機會可以進行及時追蹤.但目前靈敏度還是有待觀察

Sensisphere Interface

ART, 立體追蹤 (3D Motion Tracker), 科技(Technology) No Comments

Sensisphere is a hemispherical screen with an innovative user interface. It is integrated into the surrounding architecture. On this “porthole” with a diameter of about one meter many different interactive, multimedia-based contents can be experienced. by  reamatube

將multi-touch 技術用在半球行Display 上,似乎是一個很Smart的方式, 搭配了唱片選擇或地球儀的 瀏覽目的,回歸到人以往的使用模式, 讓互動的 手勢變的 更直接.

C.M.U.