Lip sync - Revision history

AFRLme at 22:45, 1 May 2022

2022-05-01T22:45:34Z

AFRLme at 20:16, 10 June 2020

2020-06-10T20:16:15Z

AFRLme at 16:00, 17 October 2018

2018-10-17T16:00:55Z

AFRLme at 15:43, 17 October 2018

2018-10-17T15:43:44Z

AFRLme at 15:42, 17 October 2018

2018-10-17T15:42:57Z

AFRLme at 15:31, 17 October 2018

2018-10-17T15:31:46Z

AFRLme at 15:20, 17 October 2018

2018-10-17T15:20:07Z

AFRLme at 15:09, 17 October 2018

2018-10-17T15:09:22Z

AFRLme at 14:50, 17 October 2018

2018-10-17T14:50:37Z

AFRLme at 14:48, 17 October 2018

2018-10-17T14:48:06Z

@@ Line 92: / Line 92: @@
 [[File:Lip sync 3.png|frameless|800px]]
-Once you have done that, it's time to open up Rhubarb. Press <kbd>⌘</kbd>+<kbd>R</kbd> to open up the '''Run''' dialog box.
+Once you have done that, it's time to open up Rhubarb. Press <kbd>⊞</kbd>+<kbd>R</kbd> to open up the '''Run''' dialog box.
 & now comes the technical mumbo-jumbo part... by default Rhubarb will use all of the available mouth shapes, A-H, & X for pauses in the audio, but G, H & X mouth shapes are entirely optional.

@@ Line 129: / Line 129: @@
 ! style="text-align:left" | Name !! style="text-align:left" | Description
 |-
-| [[media:Lip sync demo.zip|lip_sync_demo.zip]] || A working .ved file, complete with resources. Check out the readme.txt file for instructions.
+| [[media:Lip_sync_demo_(fixed).zip|lip_sync_demo_(fixed).zip]] || A working .ved file, complete with resources. Check out the readme.txt file for instructions.
 |}{{toc}}

@@ Line 114: / Line 114: @@
 Here is a quick example of extendedShapes being used (h is omitted)...
-  rhubarb -o 10101.ogg.tsv -d 10101.txt --extendedShapes GX''
+  rhubarb -o 10101.ogg.tsv -d 10101.txt --extendedShapes GX 10101.wav''
 |}

← Older revision		Revision as of 15:43, 17 October 2018
Line 117:		Line 117:
	\|}		\|}

−	The final step is to copy/move the tsv file you just generated into the same folder as the speech audio file that you will be using. & voila, you are done!	+	The final step is to copy/move the tsv file you just generated into the same folder as the speech audio file that you will be using in Visionaire Studio. & voila, you are done!

@@ Line 45: / Line 45: @@
 | ''Quick note #1: the tsv lip sync files can contain either the mouth shape letters or animation frame numbers, so feel free to edit the tsv files & use numbers instead if you want to go beyond basic lip sync animations - maybe your characters contain animations for a wide range of emotions, or you want the head to face a different direction than where the body is facing, etc.''
 |-
-| ''Quick note #2: Rhubarb can generate lip sync data from both wav & ogg (vorbis) audio file formats.
+| ''Quick note #2: Rhubarb can generate lip sync data from both wav & ogg (vorbis) audio file formats.''
 |}
@@ Line 114: / Line 116: @@
   rhubarb -o 10101.ogg.tsv -d 10101.txt --extendedShapes GX''
 |}
@@ Line 125: / Line 129: @@
 ! style="text-align:left" | Name !! style="text-align:left" | Description
 |-
-| [[media:Mask example.zip|mask_example.zip]] || A working .ved file, complete with resources. Check out the readme.txt file for instructions.
+| [[media:Lip sync demo.zip|lip_sync_demo.zip]] || A working .ved file, complete with resources. Check out the readme.txt file for instructions.
 |}{{toc}}

@@ Line 105: / Line 105: @@
   rhubarb -o 10101.ogg.tsv -d 10101.txt 10101.wav
 Ok, so what have we just typed? Let's break it down shall we?
-  rhubarb -- we just declared the app we want to use
+  rhubarb -o output_file -d speech_transcript input_file
- -o 10101.ogg.tsv -- this is the output file that we want to generate (it should be the same name as the actual speech recording you will be using)
-  -d 10101.txt -- this is the text input file, which is used to generate more accurate lip sync data (it's entirely optional)
+{| class="ts" style="width:100%"
-.wav -- this is the input audio file that we want to generate lip sync data for.
+|-
+| ''Quick note: you can choose which extended mouth shapes to use by including the --extendedShapes option in the command prompt window, but be aware that if you omit mouth shapes that you will need to manually edit the tsv files to replace all instances of X (if included) with the relevant animation frame number instead of X).
 == Reference Video ==

@@ Line 94: / Line 94: @@
 & now comes the technical mumbo-jumbo part... by default Rhubarb will use all of the available mouth shapes, A-H, & X for pauses in the audio, but G, H & X mouth shapes are entirely optional.
-Let's start off with generating a lip sync tsv file with the default settings - but,first, before we can do that, we need to make sure that the correct location is set in the command prompt window. In my case I created the lip_sync folder under d:\lip_sync\, so for me to specify that location I need to type...
+Let's start off with generating a lip sync tsv file with the default settings - but,first, before we can do that, we need to make sure that the correct location is set in the command prompt window. In my case I created the '''lip_sync''' folder under '''d:\lip_sync\''', so for me to specify that location I needed to type...
   d:
 followed by...
   cd d:\lip_sync\
-into the command prompt window.
+into the command prompt window & I ended up with something like this...

@@ Line 39: / Line 39: @@
 This extended mouth shape is optional. Whether there should be any visible difference between the rest position <span style="font-size:16px;">Ⓧ</span> and the closed talking mouth <span style="font-size:16px;">Ⓐ</span> depends on your art style and personal taste. If you decide not to use it, you can specify so using the extendedShapes option.
 |}
@@ Line 75: / Line 82: @@
 Next, you should create a new txt file & give it the same name as the audio file. Open it up & type up the content of the audio file in text format.
 {| class="ts" style="width:100%"
 |-
-| ''Quick note: this step is entirely optional, but it is recommended because it helps Rhubarb generate more accurate lip sync data.''
+| ''Quick note: this step is entirely optional, but it is highly recommended as it helps Rhubarb generate more accurate lip sync data.''
 |}
 [[File:Lip sync 3.png|frameless|800px]]
@@ Line 85: / Line 92: @@
 Once you have done that, it's time to open up Rhubarb. Press <kbd>⌘</kbd>+<kbd>R</kbd> to open up the '''Run''' dialog box.
-{| class="ts" style="width:100%"
+& now comes the technical mumbo-jumbo part... by default Rhubarb will use all of the available mouth shapes, A-H, & X for pauses in the audio, but G, H & X mouth shapes are entirely optional.
 == Reference Video ==

@@ Line 8: / Line 8: @@
 This tutorial will show you how to setup [https://github.com/DanielSWolf/rhubarb-lip-sync Rhubarb Lip Sync], how to generate lip sync files from an audio recording containing speech, & how to make your talk animations lip sync ready.
-Now, before you even consider using Rhubarb, you will need to create talk animations that represent these mouth shapes (see below). The animation frames should be ordered like so: A = 1, B = 2, C = 3, D = 4, E = 5, F = 6, G = 7, H = 8, X = 9. ''The table below is from the official Rhubarb GitHub page.''
+Now, before you even consider using Rhubarb, you will need to create talk animations that represent the mouth shapes in the table below. The animation frames should be ordered like so: A = 1, B = 2, C = 3, D = 4, E = 5, F = 6, G = 7, H = 8, X = 9. ''The table below is from the official Rhubarb GitHub page.''
 {| class="ts" style="width:100%"

@@ Line 36: / Line 36: @@
 This extended mouth shape is optional. Depending on your art style and the angle of the head, the tongue may not be visible at all. In this case, there is no point in drawing this extra shape. If you decide not to use it, you can specify so using the extendedShapes option.
 |-
-| style="text-align:center; vertical-align:middle;" | <span style="font-size:20px;">Ⓐ</span> || [[File:Lisa-X.png|frameless|122px|link=]] || Idle position. This mouth shape is used for pauses in speech. This should be the same mouth drawing you use when your character is walking around without talking. It is almost identical to <span style="font-size:16px;">Ⓐ</span>, but with slightly less pressure between the lips: For <span style="font-size:16px;">Ⓧ</span>, the lips should be closed but relaxed.
+| style="text-align:center; vertical-align:middle;" | <span style="font-size:20px;">Ⓧ</span> || [[File:Lisa-X.png|frameless|122px|link=]] || Idle position. This mouth shape is used for pauses in speech. This should be the same mouth drawing you use when your character is walking around without talking. It is almost identical to <span style="font-size:16px;">Ⓐ</span>, but with slightly less pressure between the lips: For <span style="font-size:16px;">Ⓧ</span>, the lips should be closed but relaxed.
 This extended mouth shape is optional. Whether there should be any visible difference between the rest position <span style="font-size:16px;">Ⓧ</span> and the closed talking mouth <span style="font-size:16px;">Ⓐ</span> depends on your art style and personal taste. If you decide not to use it, you can specify so using the extendedShapes option.