By Hiro-san
Full-body Tracking is an abbreviation for technology that uses the entire body to operate. FBT is a fun way to increase your immersion in virtual realityIt is a commonly used name on VRchat.
- How does full body tracking work in VR?
- Recommendations for each device by movement for full body tracking
- Immersion is about realistic motion reproduction and low calibration!
- Introduction of various full-body tracking devices
- [1] Most popular! VIVE Tracker Budget: from 80,000 yen
- The easiest initial installation on the market. Immersive feeling, movement reproducibility, price are all high. Can be purchased from non-official sources if stock is available.
- Why buy a VIVE Tracker if it’s so expensive? Reason: Because it is the easiest and most powerful product on the market.
- Video showing the difference between Base Station 1.0 and 2.0!
- The biggest problem is that the Base Station cannot be bought immediately even though it is a commercial product
- [2] Unimotion Price: ¥30,000-50,000
- [3] HaritoraX Wireless price: ¥30,000-¥50,000
- [4] mocopi Price: ¥40,000- + (separate smartphone required)
- HaritoraX Wireless, Unimotion, VIVE Tracker or mocopi Which is better at reproducing realistic movements?
- [5] HaritoraX (hereafter HaritoraX (wired)) Price: ¥30,000-¥50,000
- [6] Xintracker: ¥30,000-¥50,000.
- [7] Home-made (SlimeVR) Budget: ¥10,000- (*Home-made is completely at your own risk.)
- [8] MocapForAll Budget: ¥30,000 (¥10,000 for software, ¥20,000 for camera, etc.)
- [9] Vseeface Budget: ¥10,000 for software itself (free of charge), ¥10,000 for camera, etc. (also very useful for VTuber use)
- 【10】TDPT Budget: Free software, ¥3,000 for camera, etc. (also very useful for VTuber use)
- 【11】AR marker use Budget: ¥10,000 for software itself (free of charge), ¥10,000 for camera, etc.
- 【12】Kinect use Budget: ¥3,000 (used price, etc.)
- 【13】VIVE Tracker (Ultimate) Budget: ¥90,000-.
- [14] Using HMD controllers and other devices as trackers Budget: ¥20,000 – unknown
- [15] How to use a Nintendo Joy-con as a tracker Budget: For the number of Joy-cons.
- [16] How to use a smartphone as a tracker substitute.
- [17] Tundra Tracker (depending on procurement status)
- Reasons why no companies appear when searching for ‘フルトラ’.
- Are there any full-body tracking devices that are not possible due to differences in HMDs?
- [extra] What about virtual trackers?
- If you want to know about Vtuber tracking, click here.
- Click here to contact us in case of problems with full body tracking devices.
- Click here for a list of full body tracking device manufacturers
How does full body tracking work in VR?
What is the difference between FBT and people who are not full body tracking?
Are there different types of devices for full body tracking and what are the advantages and disadvantages of each?
1. optical full body tracking (using a base station and Vive tracker)
2. IMU-based full-body tracking (which does not require an external sensor and the sensor is attached to the body)
3. camera full body tracking (using a camera and motion capture).
These are. The names are made up by me to make them easier to understand for the average user.
Each has its own characteristics, with optical systems being strong in floor recognition, IMU systems being weak against magnetic forces and various others.
Even though they are full body tracking devices, they have different mechanisms for recognising the movements of the entire body.
The general classification is shown in the diagram.
The camera method analyses the images from the camera and estimates the posture.
Camera and optical systems cannot reproduce movement if there are obstructions such as bedding. In contrast, IMU systems are resistant to obstructions, but accuracy is generally worse than optical systems. There is a wide range of camera methods, from those that can be done with a smartphone to those that require a fast connection to transmit image data and the processing power of the CPU or GPU to analyse the data.The most accurate reproduction of movements such as dancing on VRchat is done with optical methods such as Vive trackers, so it is clear that the IMU method is not a panacea. It can be seen that the IMU method is not universal.
Lack of reproducibility and accuracy can ultimately lead to factors such as not being able to experience a sense of oneness with the avatar, which can ultimately lead to the end of full body tracking. So what do you want to use it for? It is important to clarify the Your budget, the movements you want to achieve, how immersive you want it to be, etc. will determine the right full body tracking for you. We have compiled a list of different applications.
How many people have full body tracking? What devices do they use?
Compared to the 2022 survey, the ranking remained unchanged
【アンケート調査内容2】フルトラになるために使用したい、現在しているデバイスは何ですか?
希望回答数:100
拡散希望なので、拡散全然OK!詳細は、前ツイートあるので、元ツイート参照
haritorax:@shiftall_jp
unimotion:@uni_motion
vive tacker:@ViveJapanSup— ヒロ/VRCフルトラ猫研究所所長 FullBody Tracking Cat (@hiro124_VRC) August 1, 2022
Summary: Full body tracking devices within VRchat used by everyone
Around half of the total are vive tacker, the remaining 30% are haritra, 5% unimotion, mocopi is still a small number
**Just to clarify, the survey was created with the aim of VRchat users, but it is possible that after the survey was spread through RT, it could be used for Vtuber use. Please note that the number of responses inevitably decreases the further down the questionnaire goes, and that the number of responses varies depending on RT.
How is full body tracking used?
Recommendations for each device by movement for full body tracking
We have compiled a list of recommended devices by the movements you often do in the previous survey.
ムーブの種類 | ムーブの説明 | IMU方式/Joy-conなど *デバイスや環境による差が激しいです | VIVEトラッカー(光学式) | TDPT/MocapForAll/ARマーカー等 |
---|---|---|---|---|
おはつい | Twitter等でおはようのあいさつと一緒に添付する写真。静止画。 | 可能 | おすすめ | 可能 |
VR睡眠 | 毛布やブランケットを被ってフルトラ状態で寝ること | 可能 | ×認識しない | ×認識しない |
座る | 机やいすや床に座る。VRchatは話しているときの方が多い | 可能 | 可能(座った際に腰トラッカーが隠れやすく、腰トビが発生しやすい) | 条件付きで可(膝同士をつけると認識しない) |
ラジオ体操 | ラジオ体操をみんなでやるイベント等あります | 可能 | おすすめ | 可能 |
簡単な踊り | 盆踊りのようなゆったりとした踊り | 可能だけど遅い | おすすめ | 条件付きで可(特定角度のみできる) |
激しい踊り | シャッフルダンスのような激しい踊り | 可能だけどおすすめしない | おすすめ | |
ひろさんムーブ | ひろがフルトラテスト用で使うくねくねした特殊動き | 可能だけど遅い | おすすめ | 特定角度、条件のみ |
Immersion is about realistic motion reproduction and low calibration!
Introduction of various full-body tracking devices
VIVE Tracker is the one that reproduces the movements most accurately. In the following video, I tried it on each device in the same environment! The movement and smoothness is totally different! The vive tracker has the best performance. The third avatar from the left is using vivetracker.
[1] Most popular! VIVE Tracker Budget: from 80,000 yen
The easiest initial installation on the market. Immersive feeling, movement reproducibility, price are all high. Can be purchased from non-official sources if stock is available.
Why buy a VIVE Tracker if it’s so expensive? Reason: Because it is the easiest and most powerful product on the market.
The tracker can be easily adjusted from 6 to 11 points, depending on the day and the number of tracking points, which can be quickly expanded by purchasing a belt to attach the tracker to.
With other devices, they are not available on the market and cannot be purchased immediately. Initial set-up is also easier than with other IMU systems, for example. Price, low availability and difficulty of installation are disadvantages. Compared to camera-related full body tracking, it has to be installed in the same way as IMU systems.
You can use the same Vive tracker 3.0 all the time. The total outlay is higher, but even if you change the type of moves or need to move more intensely, you can update the base station without having to change the tracker itself
Video showing the difference between Base Station 1.0 and 2.0!
The biggest problem is that the Base Station cannot be bought immediately even though it is a commercial product
GOOD!
Used products are available on the market and easy to obtain
High street and many people have access to it, so there is a lot of information available
Easy to install. Easy to add. Far fewer configuration problems.
Response time is fast and start-up time is practical and sufficient
Overwhelmingly few problems and few calibration cycles; enjoys more than 30 minutes of immersion
Recognises the floor well, and feet do not swell on the floor or swing from side to side
High repeatability due to detection and tracking of the absolute coordinates of the tracker to accurately measure the distance from the base station
The reproducibility of realistic movements is the best among these, so if you want to reproduce dancing, intense movements or immersive experiences, this is the one you should choose.
Finger tracking is also very easy, requiring only the installation of an Index controller.
BAD ×
Too popular and not well stocked, even though many used products are available on the market.
Expensive. Expensive, as each tracker costs 19 000 yen and a base station is also required separately
Can’t hang a blanket or anything when v-sleeping, and if there is a barrier, it will fly away and become squishy.
Installation costs are very high to start full body tracking.
Need to install a dongle on the PC side.
USB extension for the dongle, charging cable, etc. are required and expensive
For more information, including the official website, click here.
[2] Unimotion Price: ¥30,000-50,000
As for prices, prices start from the ¥30,000 range and vary depending on the number of tracking points.
GOOD
Can be used to hang blankets and other items when v-sleeping.
144 Hz mode is available, which allows for smoother motion compared to other IMU systems.
Battery-powered, so it is easy to use even where there is no power supply.
Has an upper body mode and can be used for Vtuber operations.
BAD
Battery powered, which means that the batteries need to be changed daily
Poor reproduction of real movements compared to VIVE trackers
Few users, so there are not many people to ask if you have any problems.
Compared to VIVE Tracker, after calibration, the body gradually shifts and the sense of unity is lost.
Cannot be used without a Wifi environment.
Slips on the floor
Tracker belt is harder to remove than Haritra Wireless or Eoz Tracker Belt.
Initial set-up to create the tracker belt + device compartment takes time.
For other details on Unimotion, see this article, which is lengthy.
[3] HaritoraX Wireless price: ¥30,000-¥50,000
GOOD
∙ Light and small.
∙ Compared to Unimotion and mocopi, the tracker belt is easier to remove with a one-touch detachable mechanism.
∙ The belt can be connected via a dedicated dongle or Bluetooth.
∙ The belt is elastic.
∙ Rechargeable via USB.
BAD
・The initial set-up is a pain in the ass. Some of them require 12 button presses x 6.
Compared to the VIVE Tracker, the body gradually shifts after calibration, and the sense of unity is lost.
・When using Bluetooth, it is necessary to check the number of other connected devices on the PC side.
・The reproducibility of realistic movements is worse than with the VIVE Tracker.
・The charging cable for simultaneous connection is special. Charging is more troublesome than with the VIVE Tracker.
・It is easy to attach the left leg/knee and the right leg/knee by mistake. It is necessary to reattach it again if it is attached by mistake.
・Compared to the VIVE Tracker, the HaritoraConfigrator needs to be calibrated separately for about 10 seconds, which is a hassle.
For other details on Unimotion, see this article, which is lengthy.
[4] mocopi Price: ¥40,000- + (separate smartphone required)
mocopiでVRchat上のフルトラをしてみた【自腹レビュー】(モコピ比較レビュー)
mocopiはソニーが発売しているモーションキャプチャーデバイスです。一応VRchatにも対応しているとのことで今回トライをしています。以降はVRchat上での話です。注意:今回の記事は、古いバージョ...
GOOD
・Light and small
・Can be used outside.
・Can be charged by simply plugging one terminal into the special case.
・The phone can acquire and record motion data on its own.
・A new type of IMU-based full-transistor device that can be used either via SteamVR or OSC.
BAD
No geomagnetic sensor, so less realistic movement reproduction than Haritra Wireless or Unimotion.
No elbow extension kit, so elbow tracking is not possible.
For VRchat, less cosmetic and less realistic movement reproduction than other Fulltra devices
Requires a separate smartphone
Floor slipping phenomenon is stronger
Many modes, including lower body enhancement mode and SlimeVR mode, and realistic movement reproduction and movement changes depending on the mode
For more details, see this article, which is lengthy.
HaritoraX Wireless, Unimotion, VIVE Tracker or mocopi Which is better at reproducing realistic movements?
There is another verification video comparing mocopi with slimeVR, VIVE tracker and HaritoraX, which can be found here.
[5] HaritoraX (hereafter HaritoraX (wired)) Price: ¥30,000-¥50,000
A wired IMU-based full-body tracking device, available from 15 September 2022 onwards, with easier availability due to a revised production regime, which makes reservations easier to take. It is suitable for people who have no money at all for their first IMU-based fulltracer. Reproducibility is naturally worse than trackers. Tracker belts etc. are also larger; often used by VR sleepers. They are inexpensive and informative. However, it is wired, so it is very cumbersome and quite a few people say they have broken their LAN line. It is also convenient because it can be charged with one touch; VR sleepers should include it in their considerations!
Previously, in order to buy a HaritraX, you had to ‘apply’ to the manufacturer and ‘win the lottery’. These conditions were very strict, and although some people were naturally able to buy one, not everyone who applied for the lottery was in a position to win. This led to a situation where the Fultra could not be immediately available. In the last few days, there have been some immediate delivery conditions. Visit the official website. The following video shows how Haritra works.
・Using HaritoraX (*subtitles required).
For other details, please see the HaritraX summary in chronological order. As for prices, prices vary depending on the number of tracking points in the range of 30,000 yen and up. For more information,see this article
GOOD (All information is based on what we have heard from people who use them)
∙ It is recommended as an entry-level machine for full-body tracking because it is cheap, in the 20,000-30,000 yen range, and can be expanded.
∙The information on the tracker belt is particularly good. There is a lot of information on tracker belts in particular.
∙Relatively easy to install.
∙The tracker belt is relatively easy to install.
∙The tracker belt can be used as a blanket when sleeping, so the tracker does not fall off. Can be used continuously.
BAD (All information is based on what we have heard from people who use them)
∙The reproducibility of movement is poor compared to the VIVE Tracker.
∙The wiring is cumbersome and gets caught on your feet when you sleep in VR.
∙The wired connection is a nuisance and gets caught on your feet when you sleep in VR.
Slippery floor.
∙Compared to the VIVE Tracker, it takes 10 seconds to calibrate with the ∙HaritoraConfigrator, and it’s a hassle to do it on the VRchat side.
[6] Xintracker: ¥30,000-¥50,000.
GOOD
∙ Cheap.
∙ Fast to buy and ship.
-Wireless LAN + lithium-ion battery, so it is shielded and can be simply recharged.
BAD
・Production numbers are low.
・The IMU system is still in its infancy and there are few users.
・The floor slipping phenomenon, which is peculiar to the IMU system, is occurring.
公式サイト等の情報はこちらをご覧ください。
[7] Home-made (SlimeVR) Budget: ¥10,000- (*Home-made is completely at your own risk.)
GOOD
Cheap.
Once you get into the industry, you make and improve and improve, and you get into making devices, not just full-trap body tracking.
BAD
Homebrewing is entirely at your own risk. It is not recommended on this website.
The difference in reproducibility depends on the device purchased, and the difference is very large.
It depends on the person’s technical skills and is his/her own responsibility. The cost of the parts can all be wasted.
The degree of difficulty is high for people who make their own devices.
Tools are required separately.
But there are manufacturer’s products in circulation, and making your own is not something I would recommend to newcomers, because you’re on your own.
It’s only for people who can make it themselves, so I’ll just introduce on this website that there are people who make their own devices.
Camera method.
This is a type of full body tracking that uses a camera to read motion, AI and posture estimation to reflect the movement on VRchat.
They tend to be less repeatable and faster than tracker ones. What are the major full body trackers other than full body trackers, and how do they use full body tracking in VRchat? This is a good question, but money is currently expensive for major full body tracking! Not available! There are several problems such as.
I think this minor full body tracking will be for those who can take the time and effort. Here is what we are currently aware of.
[8] MocapForAll Budget: ¥30,000 (¥10,000 for software, ¥20,000 for camera, etc.)
GOOD
Can be done without anything to attach
Easy to start with just one unit and two cameras
Easy to buy as it uses commercially available webcams
Can move faster than TDPT
BAD
GPU power required; RTX3060 is considered necessary.
At least two cameras are needed and the two cameras are identical. Alternatively, there needs to be no delay.
Limited poses that can be done compared to major full body tracking.
Needs to be re-calibrated and adjusted once
Requires more space than other full body tracking for different poses and movements
[9] Vseeface Budget: ¥10,000 for software itself (free of charge), ¥10,000 for camera, etc. (also very useful for VTuber use)
Not many people use it on its own. If you are using TDPT or Leap Motion, which will come up later, mainly for Vtuber use, you will know this software.
It is a way to do full body tracking in VRChat using a single webcam, but it can be done by connecting the VMC protocol with MocapForAll and others mentioned earlier. It is very versatile, free of charge, and may serve as a connection to other software. For example, by combining VseeFace + TDPT or VseeFace + MocapForAll, it is possible to create full body + face + hands, etc. See the TDPT video below for more details.
【10】TDPT Budget: Free software, ¥3,000 for camera, etc. (also very useful for VTuber use)
This is a course for Vtubers, but you can learn more about the use of TDPT in Friday’s video by Bistan.
GOOD
It can be done without anything to attach.
It is cheaper than MocapForAll and requires less time and effort.
It can be done with a single camera and is very easy to use.
It is easy to start with only the cost of a camera and an application. Easy to obtain and start right away.
Easy to purchase because it uses a camera.
Easy to purchase because it uses a camera.
BAD
When the camera is out of view, it stops working and moves strangely.
Poses are limited compared to major Full-Body tracking.
Movement is sluggish compared to MocapForAll.
The reproducibility of movement is low compared to the optical type, and the floor is slippery.
【11】AR marker use Budget: ¥10,000 for software itself (free of charge), ¥10,000 for camera, etc.
【12】Kinect use Budget: ¥3,000 (used price, etc.)
GOOD
It can be done without anything to attach.
Anyway, it is possible to introduce a FBT at a low cost.
Easy to purchase because it uses a camera.
BAD
Not recommended. It is becoming an old technology.
Movement is choppy compared to MocapForAll. Requires movement to be recognized by the camera
Limited poses possible compared to major full-traffic cameras.
その他
【13】VIVE Tracker (Ultimate) Budget: ¥90,000-.
[VIVE Ultimate Tracker] Basic information.
VIVEトラッカー (Ultimate)
Maximum of 5 trackers (no matter how hard you try, up to 8 trackers)
31,000 yen (tax included) per unit
Weight: 94 g Charging time: 2.2 hours on average with Quick Charge 3.0
No longer requires a PC, no longer needs a base station, just plug the VIVE wireless dongle into the headset.
Connectivity Dedicated 2.4 GHz/5 GHz Wi-Fi
VIVE Wireless Dongle required for connectivity: VIVE XR Elite, VIVE Focus 3; support for other standalone and PC VR headsets is planned.
Support for other standalone and PC VR headsets is currently planned.
[14] Using HMD controllers and other devices as trackers Budget: ¥20,000 – unknown
https://note.com/praecipua/n/nf7268ddd0b2f
https://hoshigari-gamer.com/vive-controller-tracker-change/
Using HMD controllers and other devices as trackers
For current VRchat applications, if it is easy to do, inexpensive anyway, and you can adjust the software relationship yourself, it would be the recommended method.
If you can install a base station, you can get full body tracking at a low cost and with good accuracy. It is recommended for students and others who cannot afford the initial investment.
GOOD
Reliability is relatively high with others because of the use of the manufacturer’s official products, and it is easy to connect
Easy to install because it uses the manufacturer’s official products
Can be obtained at low cost
BAD
Because the method is outside the manufacturer’s warranty, you are responsible for any problems that may occur
Because it is used for purposes other than its intended use, it tends to cause problems such as being too heavy or not fitting well with the body.
Preparation is necessary because it is an unofficial method of the manufacturer.
Tends to be frustrating because the controller and HMD are attached to the body and are heavy.
[15] How to use a Nintendo Joy-con as a tracker Budget: For the number of Joy-cons.
GOOD
For those who have many, the tracker fee is unnecessary
The belt and other accessories of the ring-fit can be diverted without modification
BAD
Because the method is outside the manufacturer’s warranty, you are responsible for any problems that may occur
Because it is used for purposes other than its intended use, it tends to cause problems such as being too heavy or not fitting well with the body.
Preparation is necessary because it is an unofficial method of the manufacturer.
Stilted movement and poor battery life.
Since it is a Nintendo product, it is necessary to try it with the feeling of leaving luck in Nintendo’s hands (it may become unusable due to updates, etc.), but there is no shortage of stock, so this may be a groundless fear.
[16] How to use a smartphone as a tracker substitute.
http://vrherokichi.com/2020/09/15/vsmarttracker/
GOOD
For those who have a lot, tracker fees are unnecessary.
BAD
Because the method is outside the manufacturer’s warranty, you are responsible for any problems that may occur
Because it is used for purposes other than its intended use, it tends to cause problems such as being too heavy or not fitting well with the body.
Preparation is necessary because it is an unofficial method of the manufacturer.
Stilted movement and poor battery life.
[17] Tundra Tracker (depending on procurement status)
The base station (the environment must be capable of the light house method) is the first and most important factor here.
Please note that new items on Mercury may be stolen!
https://twitter.com/Tundra_Labs_JP/status/1775389753531420795
GOOD
Lightweight
Easy to install. Easy to add
Fast response time
BAD
Not commercially available and therefore harder to obtain than VIVE trackers
Reasons why no companies appear when searching for ‘フルトラ’.
Are there any full-body tracking devices that are not possible due to differences in HMDs?
It would be helpful to see the official website or something accurate, if the HMD is compatible with SteamVR, you can basically use it for VRchat flutra. If you’re not sure, you can ask the official website or HP, “Does it support VRchat or SteamVR?” IMU companies have a contact point where you can ask them by discord or other means. If you want to do full body tracking with Quest series, please refer to the following article. If you want to do full body tracking in the Quest series, please refer to the following article.
QuestPro+ViveTracker+Indexコンで、究極の無線HMD+指トラ+11点フルトラ+フェイシャル+アイトラッキングになるまでの流れを紹介!【無線フルトラ+アイトラ+顔トラ】
[extra] What about virtual trackers?
If the HMD is Quest series + VirtualDesktop, you can use the virtual tracker function.
However, in the case of QuestPro, it is not quite full body tracking as the feet do not move, etc., and the accuracy is worse than the full body tracking of the camera, but you can feel the tracking accuracy of the upper body.
【最後に】この記事を作成した経緯について
If you are very knowledgeable, you may have created a world, held a meeting by yourself, or disclosed information on Twitter, rather than creating a website or web page. After learning about the types and words on this site, it would be easier to introduce various types of full body tracking if you visit the sites of people who are actually using it, follow them on Twitter, or ask them directly about their actual experiences.
This site provides the following information on how to become a full body tracking system.
1. People who have never heard of full body tracking in VRchat or could not take the beginner’s guide.
2. for those who cannot meet their Japanese full body tracking friends in time.
I am writing this article with an emphasis on how to become a full body tracker right away for the following reasons:Â
Now, if you want to be introduced immediately, you can get BS and tracker, if you don’t mind waiting a little longer, you can get Haritra, Gin Tracker, etc….
If you want to know the results of the survey on the usage of different full body tracking devices, click here.
【2023年5月速報用】最大回答1123票! #第二回VRCフルトラ国勢調査 調査結果 twitter: @hiro124_VRC
唐突で大変申し訳ありませんが、#第二回VRCフルトラ国勢調査 を開始します。今回も、質問を考えながら、やっていく予定です。デバイスも大変増えてきたので、それらの人気具合などを把...
If you want to know about Vtuber tracking, click here.
VtuberのLive2D配信用のトラッキングデバイスはこちら!
VRChatの市販アバターで3Dフルトラ+アイトラ+フェイシャル+ハンドトラッキングでVtuberさんが3D配信、動画投稿する方法を一覧にして紹介!【2024年8月版】
Vtuberのトラッキングデバイスは、2D配信時は上半身トラッキング、3D配信時は、フルトラ+フェイシャルトラッキングと要求する精度が違ってきます。また、スマホをフェイストラッキングのツールとして使う...
Click here to contact us in case of problems with full body tracking devices.
IMU方式のフルトラデバイス(HaritoraXシリーズ、Unimotion)のトラブルが発生した場合の問い合わせ先
当サイトでは、フルトラデバイス(ハリトラ、Unimotion等)のキャリブレーションなどのトラブルが発生した場合の問い合わせを受けますが、主な連絡先はこちらになります。
Click here for a list of full body tracking device manufacturers
VRChatフルトラ用デバイス&ソフト作成しているところ一覧&悪質な販売業者にお気を付けください
デバイス名等で検索しやすい、わかりやすい一覧を作成しました。ユニモーションの検索結果で来られた方は、詳しいレビューなどはこちらにありますので、ご確認下さい https://vrchat-fb...
おわり