ONIOKODeveloper
Flow charts

Extended Avatar live

An Extended Avatar in conversation with a person. Perception runs during the conversation, Memory gives continuity across conversations.

PartnerPersonTrustPerceptionMemory
Overview
Overview

Extended Avatar live

An Extended Avatar in conversation with a person, in the browser or in the partner app. Perception runs during the conversation, Memory gives the avatar continuity across conversations.

  1. Person: In conversation
  2. Partner app: Browser SDK, realtime
  3. Avatar: Presence layer
  4. Consent: Per conversation
  5. Perception: Live signals
  6. Memory: Conversation to conversation
  7. Partner server: Server SDK

Scroll. The map follows.

Station 1 of 7 · PERSON

Person

Gives consent in the interface at the start, can see at any time that perception is active, can switch it off.

Goes inNothing from outside
Comes outVoice, expression, posture
  • Visible state: active or off
  • One click ends perception
Station 2 of 7 · PARTNER

Partner app

Embeds the browser SDK: capture, live session, consent in the UI, availability handling. The partner designs the interface, the SDK provides the mechanics.

Goes inConsent state
Comes outLive stream bound to a session
  • No keys with server rights in the browser
  • Availability is shown, not hidden
Station 3 of 7 · PARTNER

Avatar

Face, voice, continuity. The avatar receives from Perception what is perceivable right now, and from Memory what is known from earlier conversations.

Goes inSignals Context
Comes outAnswer with face and voice
  • The avatar stays the avatar, interpretation stays with the human
Station 4 of 7 · TRUST

Consent

Consent is not a checkbox at the start. It constrains every call. Without valid consent for this subject, Perception returns "unavailable" and Memory writes nothing.

Goes inSubject identity (pseudonymous allowed) Purpose, scope, duration Revocation, deletion request
Comes outAllow or block per call Deletion receipt Export package
  • Chosen moments, no continuous recording
  • No emotion labels, no scoring, no diagnosis
  • Revocation applies to running sessions at once
Station 5 of 7 · PERCEPTION

Perception

Reads observable signals from face, voice and body over time. Describes, never judges. "Unavailable" is a valid state, not an error.

Goes inAudio, video or stream bound to a session Timestamps Consent reference
Comes outMeasured signals per time segment Availability state Source reference
  • No labels, only measurable things
  • Every signal carries its source
  • The human keeps the interpretation
Station 6 of 7 · MEMORY

Memory

Keeps entries per person across sessions, with source and provenance intact. Distinguishes statement, confirmation, interpretation, hypothesis and correction.

Goes inEntries from the session or the partner system Signals from Perception Corrections by the human
Comes outQueryable entries with source History over time Export and deletion per subject
  • Sources stay visible
  • Interpretations are marked as such
  • Deletion removes entries and derivations
Station 7 of 7 · PARTNER

Partner server

Holds the keys with server rights, orchestrates sessions, processes events, triggers export and deletion.

Goes inEvents: result ready, session closed
Comes outCreate and close sessions Deletion request
  • Idempotent calls
  • Verify event signatures

Steps

  1. Person. Consents in the interface, sees that perception is active, can switch it off with one click.
  2. Partner app. Embeds the browser SDK: capture, live session, consent UI, availability handling.
  3. Avatar. Receives live signals and context from earlier conversations. Stays the avatar.
  4. Consent. Per conversation.
  5. Perception. Live signals.
  6. Memory. Conversation to conversation.
  7. Partner server. Holds server keys, orchestrates sessions, processes events, triggers export and deletion.

The browser never holds keys with server rights. Availability is shown to the person, never hidden.

The map as a diagram

The same stations as a flat diagram, for printing or internal alignment. Click a box for inputs and outputs.

PARTNER · CLIENTONIOKOPARTNER · SERVERPERSONPersonIn conversation1PARTNERPartner appBrowser SDK, realtime2PARTNERAvatarPresence layer3TRUSTConsentPer conversation4PERCEPTIONPerceptionLive signals5MEMORYMemoryConversation to conversation6PARTNERPartner serverServer SDK7

Robot in the home

A companion robot with its own voice layer. ONIOKO perceives how people respond and remembers across days. The voice layer stays the voice.

Practice and consulting

Professions with human contact. A session is recorded deliberately, ONIOKO delivers a report on observable signals, the professional keeps the interpretation.