特定于唯一设备流的 UMIM 事件流。
流的唯一标识符。
接受以下消息之一
已获取新的管道。管道将 IM 连接到最终用户设备 (stream_uid)。此事件在基于事件的实现中告知 IM 关于新管道的可用性。
{
"type": "PipelineAcquired",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"stream_uid": "string",
"session_uid": "string",
"user_uid": "string"
}
管道已释放且不再可用。管道将 IM 连接到最终用户设备 (stream_uid)。此事件在基于事件的实现中告知 IM 关于已释放的管道。
{
"type": "PipelineReleased",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"stream_uid": "string",
"session_uid": "string",
"user_uid": "string"
}
{
"type": "PipelineUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"stream_uid": "string",
"session_uid": "string",
"user_uid": "string"
}
特定于唯一设备流的 UMIM 事件流。
流的唯一标识符。
接受以下消息之一
{
"type": "AttentionUserActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_engagement",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"user_id": "string"
}
{
"type": "AttentionUserActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_engagement",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"attention_level": 0
}
{
"type": "AttentionUserActionUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_engagement",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_updated_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"attention_level": 0
}
{
"type": "CustomBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string",
"custom_action_name": "string",
"results": {}
}
{
"type": "CustomBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"custom_action_name": "string",
"parameters": {}
}
{
"type": "CustomBotActionUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"custom_action_name": "string",
"updates": {}
}
操作已完成执行。操作完成可能是因为操作已完成或失败(自然完成),也可能是因为它被 IM 停止。执行的成功(或失败)使用 status_code 属性标记。
{
"type": "CustomUserActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"user_id": "string",
"custom_action_name": "string",
"results": {}
}
{
"type": "CustomUserActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"custom_action_name": "string",
"parameters": {}
}
正在运行的操作提供(部分)结果。正在进行的操作可以提供有关操作当前状态的部分更新。ActionUpdated 应始终更新操作对象的有效负载并提供更新类型。
{
"type": "CustomUserActionUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_updated_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"custom_action_name": "string",
"updates": {}
}
{
"type": "ExpectationBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
交互系统向 IM 传达它可以处理对指定事件的期望。如果系统能够处理期望,则必须发送 ExpectationBotActionStarted 事件。接收 ActionStarted 事件并不能保证如何处理期望,但它为 IM 提供了一种了解系统是否甚至能够处理期望的方法。对于交互系统中任何 Action Server 都不支持的事件的期望,将不会发送 ExpectationBotActionStarted 事件。如果系统无法处理某些机器人期望,IM 可能会停止传达它们。
{
"type": "ExpectationBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
机器人已停止主动等待。请注意,此操作仅在显式请求时停止,通过调用发送 StopExpectationSignalingBotAction 。否则,该操作将无限期地继续。
{
"type": "ExpectationSignalingBotActionFinished ",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
机器人已开始主动等待指定模式上的事件。
{
"type": "ExpectationSignalingBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "FacialGestureBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_face",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "FacialGestureBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_face",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
操作已完成执行。操作完成可能是因为操作已完成或失败(自然完成),也可能是因为它被 IM 停止。执行的成功(或失败)使用 status_code 属性标记。
{
"type": "FacialGestureUserActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_face",
"action_info_modality_policy": "replace",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"user_id": "string"
}
{
"type": "FacialGestureUserActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_face",
"action_info_modality_policy": "replace",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"expression": "string"
}
{
"type": "GestureBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_gesture",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "GestureBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_gesture",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "GestureUserActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_upper_body",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"user_id": "string",
"gesture": "string"
}
交互系统检测到用户手势的开始。注意:系统检测到手势的时间可能与用户开始执行手势的时间不同。
{
"type": "GestureUserActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_upper_body",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"user_id": "string"
}
{
"type": "MotionEffectCameraActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_motion_effect",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "MotionEffectCameraActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_motion_effect",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "PipelineUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"stream_uid": "string",
"session_uid": "string",
"user_uid": "string"
}
机器人已移回此操作之前的原始位置。这可能是中立位置,也可能是被此操作覆盖的任何 PositionBotAction 的位置,现在获得了“焦点”。
{
"type": "PositionBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_position",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "PositionBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_position",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "PositionBotActionUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_position",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"position_reached": "string"
}
{
"type": "PostureBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_posture",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "PostureBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_posture",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "PresenceUserActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_presence",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"user_id": "string"
}
{
"type": "PresenceUserActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_presence",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"user_id": "string"
}
{
"type": "RestApiCallBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "web_request",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string",
"response": {}
}
{
"type": "RestApiCallBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "web_request",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
相机拍摄已停止。相机已返回到之前的拍摄(中立拍摄)或任何被覆盖的 ShotCameraAction 操作指定的拍摄。
{
"type": "ShotCameraActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_shot",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "ShotCameraActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_shot",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "TimerBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "time",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
{
"type": "TimerBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "time",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
机器人话语已完成,可能是因为话语已传递给用户,或者操作已停止。
{
"type": "UtteranceBotActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string",
"final_script": "string"
}
在 UtteranceBotAction 期间提供更新的文本。这些事件对应于话语的某一部分传递给用户的时间。在支持语音输出的交互系统中,这些事件应与用户听到部分文本的时间对齐
{
"type": "UtteranceBotActionScriptUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"interim_script": "string"
}
机器人已开始产生话语。此事件应尽可能与用户接收话语的时刻对齐。例如,在交互式头像系统中,一旦文本到语音 (TTS) 流发送给用户,Action Server 就会发送该事件。
{
"type": "UtteranceBotActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
{
"type": "UtteranceUserActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"user_id": "string",
"final_transcript": "string"
}
如果交互系统支持,则提供更新的说话强度级别。
{
"type": "UtteranceUserActionIntensityUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_updated_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"intensity": 0
}
{
"type": "UtteranceUserActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_started_at": "2019-08-24T14:15:22Z",
"user_id": "string"
}
在 UtteranceUserAction 期间提供更新的文本
{
"type": "UtteranceUserActionTranscriptUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"action_updated_at": "2019-08-24T14:15:22Z",
"user_id": "string",
"interim_transcript": "string"
}
每当用户直接与场景中呈现的选择进行交互,但未确认取消选择时,交互系统都会发出 ChoiceUpdated 事件。
{
"type": "VisualChoiceSceneActionChoiceUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"current_choice": [
"string"
]
}
每当用户在与选择的视觉表示交互时确认或尝试中止选择时。示例包括:单击“确认”按钮,“单击关闭”
{
"type": "VisualChoiceSceneActionConfirmationUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"confirmation_status": "confirm"
}
选择操作已由 IM 停止。(没有用户操作会导致 Action Server 完成操作)。
{
"type": "VisualChoiceSceneActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string",
"final_choice": [
"string"
]
}
{
"type": "VisualChoiceSceneActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
每当用户在与表单的视觉表示交互时确认或尝试中止表单输入时。示例包括:单击“确认”按钮,“单击关闭”
{
"type": "VisualFormSceneActionConfirmationUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"confirmation_status": "confirm"
}
表单操作已由 IM 停止(没有用户操作会导致 Action Server 完成操作)。
{
"type": "VisualFormSceneActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string",
"final_inputs": [
{
"id": "string",
"value": "string",
"description": "string"
}
]
}
每当用户直接与场景中呈现的表单输入进行交互,但尚未确认输入时,交互系统都会发出 Updated 操作。这允许 IM 对部分输入做出反应,例如,如果用户正在键入电子邮件地址,则机器人可以对部分输入做出反应(机器人可能会在用户在表单字段中键入“@”后说“现在只缺少域名”)。
{
"type": "VisualFormSceneActionInputUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"interim_inputs": [
{
"id": "string",
"value": "string",
"description": "string"
}
]
}
{
"type": "VisualFormSceneActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
每当用户确认或尝试中止屏幕中显示的视觉信息时。示例包括:单击“确认”按钮,“单击关闭”
{
"type": "VisualInformationSceneActionConfirmationUpdated",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_updated_at": "2019-08-24T14:15:22Z",
"bot_id": "string",
"confirmation_status": "confirm"
}
信息操作已由 IM 停止(没有用户操作会导致 Action Server 完成操作)。
{
"type": "VisualInformationSceneActionFinished",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_finished_at": "2019-08-24T14:15:22Z",
"is_success": true,
"was_stopped": true,
"failure_reason": "string",
"bot_id": "string"
}
系统已开始向用户呈现信息。
{
"type": "VisualInformationSceneActionStarted",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"action_started_at": "2019-08-24T14:15:22Z",
"bot_id": "string"
}
特定于唯一设备流的 UMIM 事件流。
流的唯一标识符。
接受以下消息之一
机器人意图的结构化表示。如果 IM 传达机器人的当前意图,则应由 IM 生成此事件。机器人意图可能会导致意图的不同多模式表达。
{
"type": "BotIntent",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"intent": "string"
}
{
"type": "ChangeCustomBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string",
"custom_action_name": "string",
"parameters": {}
}
需要更改正在运行的操作的参数。更新正在运行的操作对于长时间运行的操作(例如,头像动画)很有用,这些操作可以动态地调整其行为。例如,点头动画可以根据语音活动级别更改其速度。
{
"type": "ChangeCustomUserAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"user_id": "string",
"custom_action_name": "string",
"parameters": {}
}
更改计时器的持续时间。如果持续时间减少,这可能会导致计时器立即停止(将发送 TimerBotActionFinished 事件)。
{
"type": "ChangeTimerBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "time",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string",
"duration": 0
}
{
"type": "ChangeUtteranceBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"bot_id": "string",
"intensity": 0
}
{
"type": "ContextUpdate",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"data": {}
}
{
"type": "CustomEvent",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"name": "string",
"data": {}
}
已获取新的管道。管道将 IM 连接到最终用户设备 (stream_uid)。此事件在基于事件的实现中告知 IM 关于新管道的可用性。
{
"type": "PipelineAcquired",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"stream_uid": "string",
"session_uid": "string",
"user_uid": "string"
}
管道已释放且不再可用。管道将 IM 连接到最终用户设备 (stream_uid)。此事件在基于事件的实现中告知 IM 关于已释放的管道。
{
"type": "PipelineReleased",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"stream_uid": "string",
"session_uid": "string",
"user_uid": "string"
}
启动操作的事件。所有其他可以启动的操作都从此基本规范继承。 action_uid 用于区分同一操作的多次运行。
{
"type": "StartCustomBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string",
"custom_action_name": "string",
"parameters": {}
}
机器人期望在不久的将来在 UMIM 事件总线上发生某个事件。此可选事件可以允许 Action Server 优化其功能。例如,负责处理相机帧的 AS 可以根据 IM 的期望启用/禁用某些视觉算法(例如,BotExpectation(event=PositionChangeUserActionStarted) 可以允许 AS 启动计算量更大的运动跟踪器以获得更好的分辨率/精度)。
{
"type": "StartExpectationBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"expected_event": {}
}
机器人正在等待特定模式的事件。
{
"type": "StartExpectationSignalingBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"modality": "bot_speech"
}
{
"type": "StartFacialGestureBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_face",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"bot_id": "string",
"facial_gesture": "string"
}
{
"type": "StartGestureBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_gesture",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"bot_id": "string",
"gesture": "string"
}
{
"type": "StartMotionEffectCameraAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_motion_effect",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"bot_id": "string",
"effect": "string"
}
{
"type": "StartPositionBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_position",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"position": "string"
}
{
"type": "StartPostureBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_posture",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"posture": "string"
}
{
"type": "StartRestApiCallBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "web_request",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string",
"request_type": "get",
"url": "string",
"headers": {},
"payload": {}
}
{
"type": "StartShotCameraAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_shot",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"shot": "string",
"start_transition": "string"
}
{
"type": "StartTimerBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "time",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string",
"duration": 0,
"timer_name": "string"
}
机器人应开始产生话语。根据交互系统的不同,这可能是机器人发送文本消息或虚拟化身与用户交谈。
{
"type": "StartUtteranceBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"bot_id": "string",
"script": "string",
"intensity": 0
}
{
"type": "StartVisualChoiceSceneAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"prompt": "string",
"image": "string",
"support_prompts": [
"string"
],
"options": [
{
"id": "string",
"text": "string",
"image": "string"
}
],
"choice_type": "selection",
"allow_multiple_choices": true
}
在场景中向用户呈现一个视觉表单,该表单请求用户输入某些内容。
{
"type": "StartVisualFormSceneAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"prompt": "string",
"image": "string",
"support_prompts": [
"string"
],
"inputs": [
{
"id": "string",
"value": "string",
"description": "string"
}
]
}
{
"type": "StartVisualInformationSceneAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"title": "string",
"summary": "string",
"support_prompts": [
"string"
],
"content": [
{
"text": "string",
"image": "string"
}
]
}
{
"type": "StopCustomBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "custom",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string",
"custom_action_name": "string",
"parameters": {}
}
IM 传达它已停止其期望。这通常发生在期望已满足(例如,已收到事件)或发生其他情况改变了交互过程时。
{
"type": "StopExpectationBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
{
"type": "StopExpectationSignalingBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_expectation",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
停止面部表情或表达。所有手势都有有限的生命周期,并“自行”结束(例如,在交互式虚拟化身系统中,“微笑”手势可以通过 1 秒的动画剪辑来实现,在该剪辑中,某些面部骨骼会进行动画处理)。IM 可以使用此操作在表情自然结束之前停止它。
{
"type": "StopFacialGestureBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_face",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"bot_id": "string"
}
停止手势。所有手势都有有限的生命周期,并“自行”结束。手势旨在强调某种情况或陈述。例如,在交互式虚拟化身系统中,`affirm` 手势可以通过 1 秒的动画剪辑来实现,在该剪辑中,虚拟化身点头两次。IM 可以使用此操作在手势自然结束之前停止它。
{
"type": "StopGestureBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_gesture",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"bot_id": "string"
}
停止相机效果。所有效果都有有限的生命周期,并“自行”结束(例如,在交互式虚拟化身系统中,“抖动”效果可以通过 1 秒的相机运动来实现)。IM 可以使用此操作在相机效果自然结束之前停止它。
{
"type": "StopMotionEffectCameraAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_motion_effect",
"action_info_modality_policy": "override",
"action_info_lifetime": "limited",
"bot_id": "string"
}
停止保持位置。机器人将返回到调用前的位置。位置保持操作具有无限的生命周期,因此除非 IM 调用 Stop 操作,否则机器人将无限期地保持该位置。或者,StartPositionBotAction 操作可以被覆盖,因为模态策略是 Override。
{
"type": "StopPositionBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_position",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
停止姿势。姿势没有生命周期,因此除非 IM 调用 Stop 操作,否则机器人将无限期地保持该姿势。
{
"type": "StopPostureBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_posture",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
停止相机镜头。相机将返回到此操作开始之前的镜头。ShotCameraAction 操作具有无限的生命周期,因此除非 IM 调用 Stop 操作,否则相机将无限期地保持该镜头。
{
"type": "StopShotCameraAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "camera_shot",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string",
"stop_transition": "string"
}
{
"type": "StopTimerBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "time",
"action_info_modality_policy": "parallel",
"action_info_lifetime": "limited",
"bot_id": "string"
}
停止机器人的话语。只有在收到 UtteranceBotActionFinished 后,操作才会停止。对于不支持此事件的交互系统,操作将继续正常运行直到完成。交互管理器应处理停止话语的时间与话语实际完成的时间之间的任意延迟。
{
"type": "StopUtteranceBotAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "bot_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"bot_id": "string"
}
指示 IM 已收到所需的信息,并且 Action Server 应尽快将 Utterance 视为已完成。例如,这可以指示 Action Server 减少保持时间(用户语音中的静音持续时间,直到我们认为语音结束已到达)。
{
"type": "StopUtteranceUserAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "user_speech",
"action_info_modality_policy": "replace",
"action_info_lifetime": "limited",
"user_id": "string"
}
{
"type": "StopVisualChoiceSceneAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
{
"type": "StopVisualFormSceneAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
{
"type": "StopVisualInformationSceneAction",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"action_uid": "string",
"action_info_modality": "information",
"action_info_modality_policy": "override",
"action_info_lifetime": "indefinite",
"bot_id": "string"
}
{
"type": "UserIntent",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"intent": "string"
}
{
"type": "UserMovement",
"uid": "string",
"event_created_at": "2019-08-24T14:15:22Z",
"source_uid": "string",
"tags": {},
"movement": "string",
"parameters": {}
}
机器人意图的结构化表示。如果 IM 传达机器人的当前意图,则应由 IM 生成此事件。机器人意图可能会导致意图的不同多模式表达。
需要更改正在运行的操作的参数。更新正在运行的操作对于长时间运行的操作(例如,头像动画)很有用,这些操作可以动态地调整其行为。例如,点头动画可以根据语音活动级别更改其速度。
更改计时器的持续时间。如果持续时间减少,这可能会导致计时器立即停止(将发送 TimerBotActionFinished 事件)。
操作已完成执行。操作完成可能是因为操作已完成或失败(自然完成),也可能是因为它被 IM 停止。执行的成功(或失败)使用 status_code 属性标记。
正在运行的操作提供(部分)结果。正在进行的操作可以提供有关操作当前状态的部分更新。ActionUpdated 应始终更新操作对象的有效负载并提供更新类型。
交互系统向 IM 传达它可以处理对指定事件的期望。如果系统能够处理期望,则必须发送 ExpectationBotActionStarted 事件。接收 ActionStarted 事件并不能保证如何处理期望,但它为 IM 提供了一种了解系统是否甚至能够处理期望的方法。对于交互系统中任何 Action Server 都不支持的事件的期望,将不会发送 ExpectationBotActionStarted 事件。如果系统无法处理某些机器人期望,IM 可能会停止传达它们。
机器人已停止主动等待。请注意,此操作仅在显式请求时停止,通过调用发送 StopExpectationSignalingBotAction 。否则,该操作将无限期地继续。
机器人已开始主动等待指定模式上的事件。
操作已完成执行。操作完成可能是因为操作已完成或失败(自然完成),也可能是因为它被 IM 停止。执行的成功(或失败)使用 status_code 属性标记。
交互系统检测到用户手势的开始。注意:系统检测到手势的时间可能与用户开始执行手势的时间不同。
已获取新的管道。管道将 IM 连接到最终用户设备 (stream_uid)。此事件在基于事件的实现中告知 IM 关于新管道的可用性。
管道已释放且不再可用。管道将 IM 连接到最终用户设备 (stream_uid)。此事件在基于事件的实现中告知 IM 关于已释放的管道。
机器人已移回此操作之前的原始位置。这可能是中立位置,也可能是被此操作覆盖的任何 PositionBotAction 的位置,现在获得了“焦点”。
相机拍摄已停止。相机已返回到之前的拍摄(中立拍摄)或任何被覆盖的 ShotCameraAction 操作指定的拍摄。
启动操作的事件。所有其他可以启动的操作都从此基本规范继承。 action_uid 用于区分同一操作的多次运行。
机器人期望在不久的将来在 UMIM 事件总线上发生某个事件。此可选事件可以允许 Action Server 优化其功能。例如,负责处理相机帧的 AS 可以根据 IM 的期望启用/禁用某些视觉算法(例如,BotExpectation(event=PositionChangeUserActionStarted) 可以允许 AS 启动计算量更大的运动跟踪器以获得更好的分辨率/精度)。
机器人正在等待特定模式的事件。
机器人应开始产生话语。根据交互系统的不同,这可能是机器人发送文本消息或虚拟化身与用户交谈。
在场景中向用户呈现一个视觉表单,该表单请求用户输入某些内容。
IM 传达它已停止其期望。这通常发生在期望已满足(例如,已收到事件)或发生其他情况改变了交互过程时。
停止面部表情或表达。所有手势都有有限的生命周期,并“自行”结束(例如,在交互式虚拟化身系统中,“微笑”手势可以通过 1 秒的动画剪辑来实现,在该剪辑中,某些面部骨骼会进行动画处理)。IM 可以使用此操作在表情自然结束之前停止它。
停止手势。所有手势都有有限的生命周期,并“自行”结束。手势旨在强调某种情况或陈述。例如,在交互式虚拟化身系统中,`affirm` 手势可以通过 1 秒的动画剪辑来实现,在该剪辑中,虚拟化身点头两次。IM 可以使用此操作在手势自然结束之前停止它。
停止相机效果。所有效果都有有限的生命周期,并“自行”结束(例如,在交互式虚拟化身系统中,“抖动”效果可以通过 1 秒的相机运动来实现)。IM 可以使用此操作在相机效果自然结束之前停止它。
停止保持位置。机器人将返回到调用前的位置。位置保持操作具有无限的生命周期,因此除非 IM 调用 Stop 操作,否则机器人将无限期地保持该位置。或者,StartPositionBotAction 操作可以被覆盖,因为模态策略是 Override。
停止姿势。姿势没有生命周期,因此除非 IM 调用 Stop 操作,否则机器人将无限期地保持该姿势。
停止相机镜头。相机将返回到此操作开始之前的镜头。ShotCameraAction 操作具有无限的生命周期,因此除非 IM 调用 Stop 操作,否则相机将无限期地保持该镜头。
停止机器人的话语。只有在收到 UtteranceBotActionFinished 后,操作才会停止。对于不支持此事件的交互系统,操作将继续正常运行直到完成。交互管理器应处理停止话语的时间与话语实际完成的时间之间的任意延迟。
指示 IM 已收到所需的信息,并且 Action Server 应尽快将 Utterance 视为已完成。例如,这可以指示 Action Server 减少保持时间(用户语音中的静音持续时间,直到我们认为语音结束已到达)。
机器人话语已完成,可能是因为话语已传递给用户,或者操作已停止。
在 UtteranceBotAction 期间提供更新的文本。这些事件对应于话语的某一部分传递给用户的时间。在支持语音输出的交互系统中,这些事件应与用户听到部分文本的时间对齐
机器人已开始产生话语。此事件应尽可能与用户接收话语的时刻对齐。例如,在交互式头像系统中,一旦文本到语音 (TTS) 流发送给用户,Action Server 就会发送该事件。
如果交互系统支持,则提供更新的说话强度级别。
在 UtteranceUserAction 期间提供更新的文本
每当用户直接与场景中呈现的选择进行交互,但未确认取消选择时,交互系统都会发出 ChoiceUpdated 事件。
每当用户在与选择的视觉表示交互时确认或尝试中止选择时。示例包括:单击“确认”按钮,“单击关闭”
选择操作已由 IM 停止。(没有用户操作会导致 Action Server 完成操作)。
每当用户在与表单的视觉表示交互时确认或尝试中止表单输入时。示例包括:单击“确认”按钮,“单击关闭”
表单操作已由 IM 停止(没有用户操作会导致 Action Server 完成操作)。
每当用户直接与场景中呈现的表单输入进行交互,但尚未确认输入时,交互系统都会发出 Updated 操作。这允许 IM 对部分输入做出反应,例如,如果用户正在键入电子邮件地址,则机器人可以对部分输入做出反应(机器人可能会在用户在表单字段中键入“@”后说“现在只缺少域名”)。
每当用户确认或尝试中止屏幕中显示的视觉信息时。示例包括:单击“确认”按钮,“单击关闭”
信息操作已由 IM 停止(没有用户操作会导致 Action Server 完成操作)。
系统已开始向用户呈现信息。
枚举。
请求类型
枚举。
枚举。