While your digital human is being used, there are a number of messages that may be emitted via UneeqOptions => messageHandler. The following document describes these messages in detail.



AvatarAnswerContentMessage

The avatar's answer to a question (HTML Content). uneeqMessageType: "AvatarAnswerContent"

content: string If hasDisplayHtml = true, this content will contain the HTML provided by the displayHTML instruction. If hasDisplayHtml = false, this content will contain the answer value.

hasDisplayHtml: boolean

transcriptId: string







AvatarAnswer

The avatar's answer to a question.

uneeqMessageType: "AvatarAnswer"

answer: string

answerAvatar: string

answerSpeech: string

transcriptId: string





AvatarAvailable

An avatar is available.

uneeqMessageType: "AvatarAvailable"





AvatarQuestion

The question the user asked.

uneeqMessageType: "AvatarQuestion"

question: any

transcriptId: any





AvatarRequestCompleted

The Avatar has completed processing a text or instruction request.

uneeqMessageType: "AvatarRequestCompleted"

reason: string





AvatarRequestIgnored

The Avatar has ignored a request to speak.

uneeqMessageType: "AvatarRequestIgnored"

reason: string





AvatarTextInputFinished

[Deprecated] Avatar has finished speaking the message. Deprecated, use FinishedSpeaking

uneeqMessageType: "AvatarTextInputFinished"





AvatarUnavailable

There are no avatars currently available.

uneeqMessageType: "AvatarUnavailable"





ClientMediaStreamUpdate

Provides streaming status updates for both client and server side.

uneeqMessageType: "ClientMediaStreamUpdate"

clientStreamingAudio: boolean

clientStreamingVideo: boolean

serverStreamingVideo: boolean

serverStreamingAudio: boolean





ClientPerformanceMessage

These WebRTC statistics help identify if session quality is being impacted by client-side conditions. Messages are sent every 5 seconds, and are visible in the console if enableClientPerformanceMessage = true.

uneeqMessageType: "ClientPerformanceMessage"

clientPerformance: ClientPerformanceStats





ConnectionLost

Connection has been lost.

uneeqMessageType: "ConnectionLost"

connectionState: PublishSubscribeState





DeviceError

An error has occurred with the users device.

uneeqMessageType: "DeviceError"

error: Error





DeviceListUpdated

The device list has been changed or retrieved for the first time.

uneeqMessageType: "DeviceListUpdated"

devices: Devices





DeviceNotFoundError

Selected device is not found.

uneeqMessageType: "DeviceNotFoundError"

deviceId: string

msg: string





DevicePermissionAllowed

User has given permission to use devices.

uneeqMessageType: "DevicePermissionAllowed"





DigitalHumanUnmuted

The digital human has been unmuted. You will also receive this message at the start of a session if the digital human starts unmuted.

uneeqMessageType: "DigitalHumanUnmuted"





FinishedSpeaking

Digital human has finished speaking the message.

uneeqMessageType: "FinishedSpeaking"





Instructions

Instructions payload has been sent from NLP. Instructions may be set within your NLP as JSON.

uneeqMessageType: "Instructions"

instructions: JSON stringified object containing the content set within your NLP JSON field.





MicActivityError

An error occurred with mic activity messages.

uneeqMessageType: "MicActivityError"





MicActivity

Message is sent upon activity of the user microphone.

uneeqMessageType: "MicActivity"

level: integer





MicActivityNotSupported

Mic activity messages are not supported by the users browser.

uneeqMessageType: "MicActivityNotSupported"





OnlineStatusUpdate

Clients network status has changed.

uneeqMessageType: "OnlineStatusUpdate"

online: boolean





Ready

Service is ready to be used.

uneeqMessageType: "Ready"





RecordingStarted

User has started a recording successfully.

uneeqMessageType: "RecordingStarted"





RecordingStopped

User has stopped recording successfully.

uneeqMessageType: "RecordingStopped"





ServiceUnavailable

Service is unavailable.

uneeqMessageType: "ServiceUnavailable"

error: any





SessionEnded

Session has been ended successfully.

uneeqMessageType: "SessionEnded"





SessionError

A session error has occurred.

uneeqMessageType: "SessionError"

error: string





SessionInfo

Session info message used for testing.

uneeqMessageType: "SessionInfo"

info: string





SessionLive

Session is Live, avatar video is active.

uneeqMessageType: "SessionLive"





SessionPaused

Session has been paused successfully.

uneeqMessageType: "SessionPaused"





SessionResumed

Session has been resumed successfully.

uneeqMessageType: "SessionResumed"





SetCameraSuccess

Users camera has been set successfully.

uneeqMessageType: "SetCameraSuccess"

deviceId: string





SetMicSuccess

Users microphone has been set successfully.

uneeqMessageType: "SetMicSuccess"

deviceId: string





SetSpeakerSuccess

Users speaker has been set successfully.

uneeqMessageType: "SetSpeakerSuccess"

deviceId: string





StartedSpeaking

Digital human has started speaking a message.

uneeqMessageType: "StartedSpeaking"





Warning

General warning message.

uneeqMessageType: "Warning"

msg: string





WebRtcData

WebRTC data channel message.

uneeqMessageType: "WebRtcData"

data: any





WebRtcData

WebRTC stats message (diagnostics).

uneeqMessageType: "WebRtcStats"

stats: any