UnrealVoxta 0.1.1
 
Loading...
Searching...
No Matches
LipSyncGenerator Class Reference

LipSyncGenerator Internal helper class with static functions for generating lipsync data for audio. More...

#include <LipSyncGenerator.h>

Static Public Member Functions

static void GenerateA2FLipSyncData (const TArray< uint8 > &rawAudioData, TWeakPtr< Audio2FaceRESTHandler > A2FRestHandler, TFunction< void(ULipSyncDataA2F *)> callback)
 Generate the A2F curves in a background thread and attach them to the ULipSyncDataA2F instance.
 
static ULipSyncDataCustomGenerateCustomLipSyncData ()
 Generate an empty ULipSyncDataCustom wrapper, currently only used for integration tests.
 

Detailed Description

LipSyncGenerator Internal helper class with static functions for generating lipsync data for audio.

Downloads the data from the VoxtaServer REST api, converting it into a SoundWave, and generating lipsync data.

Note: The private API hooks into callbacks from background-threads, use care when changing the implementation.

Member Function Documentation

◆ GenerateA2FLipSyncData()

void LipSyncGenerator::GenerateA2FLipSyncData ( const TArray< uint8 > & rawAudioData,
TWeakPtr< Audio2FaceRESTHandler > A2FRestHandler,
TFunction< void(ULipSyncDataA2F *)> callback )
static

Generate the A2F curves in a background thread and attach them to the ULipSyncDataA2F instance.

Note: Returned object of ULipSyncDataA2F* is attached to Root on creation, to avoid premature deletion.

Parameters
rawAudioDataThe raw audiodata in bytes.
A2FRestHandlerWeak pointer to the A2F REST API handler; the callback is skipped if the handler is no longer valid.
callbackThe callback that will be triggered when the A2F curves have been created and imported back into the gamethread.

◆ GenerateCustomLipSyncData()

ULipSyncDataCustom * LipSyncGenerator::GenerateCustomLipSyncData ( )
static

Generate an empty ULipSyncDataCustom wrapper, currently only used for integration tests.

Note: Returned object of ULipSyncDataCustom* is attached to Root on creation, to avoid premature deletion.

Returns
A pointer to the newly created instance of ULipSyncDataCustom

The documentation for this class was generated from the following files: