*Este artículo fue creado utilizando entrada de voz con IA (Aqua Voice). Tenga en cuenta que puede haber algunas inconsistencias.
Full-Body Tracking for DJs, Musicians, EWI Players, and Creators
Hola. ¿Cómo están todos?
Soy Hiro del Laboratorio de Full Body Tracking.
This is a follow-up to the previous articles: “I Can’t Recommend Full-Body Tracking Just Because You Say ‘I Want to Dance'” and “VR Theater and Dance: Can You Put Your Movements into Words?”
This time, I’m writing about choosing full-body tracking for music creators and people who don’t move much. Music DJs, VJs, rappers, instrumentalists, and electronic wind instrument players. These groups are actually often active in rather unique environments within VRChat.
For DJs, VJs, and Rappers
Music DJs, VJs, and rappers. For this crowd, IMU-based tracking gets quite challenging.
There are mainly two reasons:
- Magnetic interference issues (surrounded by speakers everywhere)
- Long play sessions (exceeding the limits of IMU)
Recent IMUs with 6-axis have reduced drift to some extent, but it still drifts a bit here and there. Their play sessions are extremely long, and using IMU continuously through those extended periods is a pretty tough proposition.
DJs Should Mount Trackers on Their Back Side
If you’re doing DJ work, you probably have a desk in front of you, so it’s better to mount trackers on your back side. If you put them on the front, there will be moments when they get hidden from the base stations.
This kind of “placement ingenuity” is something only someone who knows their own movements can think of. That’s exactly why knowing your own movements matters.
How your arms move during a typical session, which direction your upper body faces. If you can put those things into words, you can determine for yourself where trackers should go.
For Instrumentalists
Next, let’s talk about people who play instruments.
Instrumentalists are in a tricky spot, because the answer changes depending on the type of instrument.
For string instruments, for example, regular VIVE trackers might work fine. But if you want to use hand tracking, that changes the story.
Piano Players Should “Free Their Hands”
The issue is how to use hand tracking.
The worst-case scenario is when trackers are too heavy and interfere with your actual playing. If you play piano, it’s better to keep your hands free. If equipment prevents you from performing naturally, the gear is just getting in the way.
When I go to street-performance-style events, there are people who simply sit in front of their computer and play. I think that’s totally fine, but if you want a sense of unity with your avatar, you need to choose your equipment carefully.
Quest 3’s Camera Tracking Is Also an Option
Personally, I think if you have a Quest 3, using its camera-based inside-out tracking (AI body tracking) is still a much better option for now.
Things change quite a bit if you want to express your full body more precisely, though.
Some might argue that IMU-based tracking could work in that case, but piano players often have electronic pianos surrounded by speakers, which could make magnetic interference a serious concern.
At the end of the day, this is something that can only be determined by your playing time and environment.
For Wind Instrument and Electronic Wind Instrument Players
I’ll be honest — this is a pretty challenging area.
For instruments like trumpet that produce solid real-world volume, I think any option works — base station systems, Ultimate Tracker, or IMU-based trackers.
The challenge lies with electronic wind instruments like Kawai’s EWI.
The EWI Story — Only Some Will Understand
It’s a bit hard to explain what an EWI is, but if you think of the F1 opening theme (T-SQUARE’s “TRUTH”), those who know will get it. Personally, I prefer the original player’s performance over the third-generation player’s, but let’s set that aside.
The EWI itself doesn’t produce particularly loud acoustic sound, but it involves intricate finger movements and distinctive physical gestures. If you play wind instruments, you probably also emphasize neck movements and looking-down motions as part of your performance.
How much of that can be reproduced with full-body tracking in VRChat?
I think performing on an EWI while wearing a head-mounted display is already a pretty incredible feat in itself.
The Facial Tracking Barrier
My sense is that finger movements can probably be tracked. However, when it comes to lip movements (expressions), you’d need a headset with facial tracking like Quest Pro.
The problem is that Quest Pro itself doesn’t pick up mouth area movements very well when you have an instrument raised to your lips. That’s the dilemma.
If you go with a facial tracker, something like the facial expression tracker for VIVE Focus 3 or VIVE XR Elite might barely work. If even that falls short, you’d need to get creative with an external camera setup.
This area truly presents difficult challenges. Reproducing electronic wind instrument performance in full-body tracking is still a deep and unresolved territory.
A Misconception Among People Who Don’t Move Much
Finally, let me say something about “people who don’t move much.”
The idea that “I don’t move much, so a cheap option is fine” — this is the biggest misconception.
It’s not just about whether you move or not. You should define how much drift you’re willing to tolerate after you do move, and choose based on that.
People who don’t move much actually feel the discomfort of drift more acutely. After all, you’re not moving, but your avatar is slowly sliding off position. Whether you can tolerate that discomfort is something only you can determine for yourself.
My honest take is that people who don’t move much will actually be happier choosing a reliable domestic manufacturer.
Domestic Manufacturers Are the Safe Zone
Some people buy cheap wired IMU options thinking “At that price, why not?” — but basically, if you stick with domestic manufacturers, you’ll land in a solid zone.
The reason is pretty simple: Japanese VRChatters are extremely picky about full-body tracking drift (positional displacement). They’re really, really picky. Because of that, domestic manufacturers select quite high-quality components for their commercially available products.
Conversely, cheap overseas products are often questionable in that regard.
There’s hardly any field where the phrase “penny wise, pound foolish” applies as aptly as the full-body tracking industry.
Conclusión: Only You Know Your Own Movements
I’ve written this across three installments now, but ultimately the only thing I want to say is this:
What do you want to achieve in VRChat?
How do you want to move?
Only you can decide that.
I’ve seen all kinds of people, and I’ve bought and tested all kinds of devices with my own money. So once your type is clear, I can give you a highly accurate recommendation.
But determining that “type” isn’t my job — it’s yours.
Not Quite a Car Company Job Interview, But…
Writing all this, it’s starting to feel like one of those job interviews at an automotive company where you talk about your dreams. But don’t worry, there’s no need to be that serious.
Corporate job interviews are basically looking for reasons to reject candidates. But the Full Body Tracking Lab is not that. We’re not asking because we want to disqualify you. We’re asking because we want to suggest the perfect device for you.
You don’t need to passionately describe your dreams. Just try to put into words “I want to move like this” or “I want to enjoy this kind of experience.”
Once you can do that, come read my articles. On the site, there are device comparisons, reviews, and guides organized by user type. I’ve tested every single one myself.
Then I’m sure you’ll start to see the right device for you.
Para cerrar
Full-body tracking is, at its core, a technology for “infusing your avatar with your own movements.”
For that, you need to know your own movements. If you don’t know them, no matter how expensive the device you buy, it probably won’t work out. Conversely, someone who truly knows their own movements can maximize even inexpensive equipment.
So here’s what I’ll ask of you, having read this far.
Next time you come to me for device advice, don’t say “I want to dance.” Say “I want to do this kind of dance.” Whether it’s “I want to play piano while sitting” or “I want to play EWI while standing” — anything works.
The more specific you are, the better the answer I can give you.
Only you know your own movements. When you can put that into words, your full-body tracking selection process is already half done.
Bueno, eso es todo por hoy.
Gracias por leer las tres partes hasta el final.
Les habla Hiro.
¡Gracias por leer! ¡Síguenos en X y suscríbete a nuestro canal de YouTube!