How to Creat LipSync in CK

[Djlegends]

Latest update has released lipsync ability but things have changes a bit so decided to make this tutorial for creating lipsync

Warning: for those reading this I will not cover how to convert your audio to .WEM there are plenty of guides for this; head here if questions of making audio in CK 

https://www.youtube.com/watch?v=x7y4knnvhzE&t=1s&pp=ygUSc3RhcmZpZWxkIGF1ZGlvIGNr

 

Important: There must be no spaces in the game/CK path. Otherwise, CK will throw an error.

 

Double ensure that your **PLUGIN NAME HAS NO SPACES!**

Example of right way to do it: 
`NG+FrameworkExamplePlugin.esp`
Wrong way to do it:
`NG+ Framework Example Plugin.esp`

 

 

#1 load the plugin that has your audio converted and ready to go (my example will be AnimTest.esp)

 

#2 Once plugin has loaded head to Audio under toolbar and click on "Run FaceFX Compiler"

 

#3 if you click on the right setting you would see this page click on the active plugin that you want to generate the facial animations and then click "compile" for this example I will be compiling a WIP Companion Mod Note: Only .wav is required to generate .ffxanim.

Data\Sound\Voice\<master_file>\<voice_type>\<response_id>.wav

 

 

 

#4  if you had did those parts correctly you would see this page pop up on your end
      Note: this will appear if you have no .wav files in your plugin

 

 

#5 End results should look like this

 

https://imgur.com/a/segfWsy
 

Edited November 25, 2024 by Djlegends
added fail case scenario

[Bluegunk]

Excellent! Thanks!

[Djlegends]

43 minutes ago, Bluegunk said:

Excellent! Thanks!

your welcome didn't even needed the CK wiki to understand this lol
will tackle WWise setup for those ready to get that working

[Reigor]

Tried this. Ran into the following errors (see attached image).

 

Now the NPCMAdoringFan ones might be from the added lines I made for changing the Adoring Fangirl's appearance in dialogue. They don't have audio which I haven't gotten around to making.

 

The GenericEvenToned ones I'm not so sure about.

 

And finally, testing it game, there was no lipsync.  Tried on both a bsa and loose file version.

[Djlegends]

6 hours ago, Reigor said:

Tried this. Ran into the following errors (see attached image).

 

Now the NPCMAdoringFan ones might be from the added lines I made for changing the Adoring Fangirl's appearance in dialogue. They don't have audio which I haven't gotten around to making.

 

The GenericEvenToned ones I'm not so sure about.

 

And finally, testing it game, there was no lipsync.  Tried on both a bsa and loose file version.

it shows that theres no .wav files, just like you cannot compile scripts without its source .psc you cannot create lipsync without its source .wav

[Bluegunk]

Hi DJLegends

 

I was trying this process with the Female Vasco Mod, and I converted all the WEMs to WAVs. So I'm ready to go.

And I get the  0 FX ANIM files....  page.

And that's it. Nothing, anywhere!  No apparent output, the ESM remains unchanged. No lip sync in game, nothing.

 

I'd copied the mod and associated WAVs into the game's data folder, too.

 

I guess I'm missing something really obvious!

[Djlegends]

5 minutes ago, Bluegunk said:

Hi DJLegends

 

I was trying this process with the Female Vasco Mod, and I converted all the WEMs to WAVs. So I'm ready to go.

And I get the  0 FX ANIM files....  page.

And that's it. Nothing, anywhere!  No apparent output, the ESM remains unchanged. No lip sync in game, nothing.

 

I'd copied the mod and associated WAVs into the game's data folder, too.

 

I guess I'm missing something really obvious!

think you can send me these files so I can test?

[Bluegunk]

Which ones - the WAVs, I assume?    I'll send them along in a moment. I'd deleted them in frustration!

[Bluegunk]

Right, here we are. Translated to Wavs using FooBar2000.

 

 

Vasco.7z

[Djlegends]

6 hours ago, Bluegunk said:

Which ones - the WAVs, I assume?    I'll send them along in a moment. I'd deleted them in frustration!

you do know that you need to rename the .wav into the formid right?

[Djlegends]

this video shows you how to compile from wav to .wem

they need to have the sam formid index then it can compile

[Bluegunk]

2 minutes ago, Djlegends said:

you do know that you need to rename the .wav into the formid right?

No. I'd assumed the file name was the Form ID.  Thanks!

 

I know Joseph's video. Very useful.

[Djlegends]

okay wtf I can't generate lipsync now?!?!

[Djlegends]

nvm figured out the issue will update the guide

[Reigor]

I saw this as well. 

 

Complete Guide -Creating Lip Sync for Voice Files in Starfield-A Resource for Modders at Starfield Nexus - Mods and Community

[Reigor]

@Djlegends

 

1. Should the .wav and .wem files be located in the same folder?

For example: sound/voice/Starfield.esm/npcadoringfan

2. Does the .esm part (in the above example) need to match the filename of the active .esp? 

I can get stuff to process if I select Starfield.esm but then that processes ALL of Starfield.esm not just the npcadoringfan.

 

If I run it with adoringfangirl.esp (I made it have no spaces) I still get a similar output as I posted above. I tried switching the voice type from male to female with the same point.

 

As this point I am thinking that I will need to run it using the Starfield.esm, since this is a conversion of the original, just let it run on ALL voices in the game and then separate out the npcadoringfan files afterwards.  

 

EDIT: Ok selecting the Starfield.esm actually worked and the output was only the npcadoringfan. Now to move on to the next step w/ all these ffanim files.

 

EDIT2: That worked! Got lipsync in the game. Now have to pack everything up in the bsa format and get it out to folks.

Edited November 27, 2024 by Reigor

[Djlegends]

53 minutes ago, Reigor said:

@Djlegends

 

1. Should the .wav and .wem files be located in the same folder?

For example: sound/voice/Starfield.esm/npcadoringfan

2. Does the .esm part (in the above example) need to match the filename of the active .esp? 

I can get stuff to process if I select Starfield.esm but then that processes ALL of Starfield.esm not just the npcadoringfan.

 

If I run it with adoringfangirl.esp (I made it have no spaces) I still get a similar output as I posted above. I tried switching the voice type from male to female with the same point.

 

As this point I am thinking that I will need to run it using the Starfield.esm, since this is a conversion of the original, just let it run on ALL voices in the game and then separate out the npcadoringfan files afterwards.  

 

EDIT: Ok selecting the Starfield.esm actually worked and the output was only the npcadoringfan. Now to move on to the next step w/ all these ffanim files.

yes for both