Rig your own 3D Vtuber with Perfect Sync in 30 minutes

Rig your own 3D Vtuber with Perfect Sync in 30 minutes

Genre
Tutorial
Date
Oct 14, 2022
Snippet
DIY your own 3D vtuber model for <$20
Notes to self
notion image

Introduction

If you're looking to stream, save money and get into the vtuber world then this is the perfect tutorial for you!
Disclaimer: You will need to use Vroid studio for the base but it's also really easy to use and surprisingly flexible if you know what you’re doing.
This article will jump straight into the rigging phase after you create the model in Vroid Studio. I’ve linked some Vroid tutorials at the bottom of this article to help you give vtuber the look you want.

Programs you will need

Program
Price
Get it from
VRoid Studio
Free
VMagicMirror
Free
HANA Tool
1,000 JYP =~ 10 USD
Unity VRM
Free
Unity
Free
*iFacialMocap
$5.99
iOS App store (iPhone 10+)
TOTAL: ~$16
*Optional - but necessary for better face tracking

Here is the model I rigged using this method in motion! (Please excuse my horrible bitrate)
Video preview

Rigging

Step 1: Vroid Studio

  1. create your avatar in Vroid Studio
    1. notion image
  1. while in the editor, click on the export icon and export as vrm
    1. notion image
  1. Reduce polygons > UNCHECK remove transparent meshes
    1. notion image
  1. Click Export
  1. Name your vrm saved file and click export again
  1. Name the file and save it to a spot on your computer that you will remember

Step 2: Unity

  1. open unity hub
  1. create a new unity 3d project
    1. notion image
  1. Wait for Unity to load
  1. In the top menu bar, go to Assets > Import Package > Custom Package
    1. notion image
  1. Import UniVRM-0.99.4_8d33.unitypackage OR the latest UniVRM unitypackage
  1. Click import
    1. notion image
  1. If a menu called “Script updating consent” appears, select No.
  1. Click Accept All
    1. notion image
  1. Then close
    1. notion image
  1. drag and drop your [modelName].vrm vtuber avatar into unity assets (vrm NOT Vroid)
    1. notion image
  1. wait for VRM to generate a .prefab of your model
    1. Note: If there is red text at the bottom of Unity giving you a warning, ignore it for now
  1. drag and drop the newly generated [modelName].prefab into the hierarchy window
    1. notion image
  1. Again go to Assets > import package > custom package ...
    1. notion image
  1. This time, Import HANA_Tool_v4_0_0_VRM_En.unitypackage
    1. notion image
  1. Click import and wait for it to finish importing
  1. The top menu bar will now have new options.
  1. Now, go to HANA_Tool > Reader
    1. notion image
  1. Click the top right circle with dot and change the Game Object to 'Face' where it currently says None (Skinned Mesh Render)
    1. notion image
  1. Select the version you want (ex. PerfectSync_VRoid_v1_0_0_Female.txt)
  1. Click 'Read BlendShapes' Once finished, press OK, and close out the menu
    1. notion image
  1. To check it worked click the upside down triangle next to your object, select Face. Under 'BlendShapes' there will be a list of new BlendShapes your model has
    1. notion image
  1. Go to HANA_Tool > ClipBuilder
  1. Click the top right circle with dot and change the Game Object to '[modelName].prefab' Click 'Clip Build'
    1. notion image
  1. Wait for the process to finish, press OK, and then close out of the menu
  1. Now, to export go to VRM0 > Export to VRM0.x
  1. Make sure the lang (language) is En
  1. Change the ExportRoot to [modelName].prefab
    1. notion image
  1. Add a version type (ex. v1)
  1. Press 'Export
  1. Exit unity

Step 3: Vmagic Mirror

  1. Now you can import your model into vMagicMirror
  1. Set up vMagicMirror - Getting Started | VMagicMirror (malaybaku.github.io)
  1. (Optional) Connect iFacialMocap to vMagicMirror (how-to guide in vMagicMirror)
  1. You’re done!
 

Tips and Conclusion

I hope this tutorial helped! Here are some extra steps you can take to give your Vtuber an extra layer of pizazz:
  • Mess around with custom expressions in Vtube studio to add your own personality to your 3D model
  • You can change eye movement sensitivity in vMagicMirror

Additional Resources

  1. How I made a Vtuber Model for $15 - Vroid Studio | Vtuber Tech - YouTube
  1. 【Vtuber Tutorial】How to use HANA_tool blendshapes for high quality Vtuber face tracking on VUP - YouTube