fn_registry/dev/issues/0151-matrix-client-pc-livekit-calls.md at master

Files

T

egutierrez daef7ea190 feat(matrix): MAS migration helpers + 2 flows + 15 issues + capability group

Helper functions (matrix-mas capability group):
- mas_client_register_bash_infra: register/sync OAuth clients via mas-cli
- mas_syn2mas_migration_bash_infra: dry-run + apply user migration to MAS
- synapse_msc3861_enable_go_infra: edit homeserver.yaml MSC3861 block (with diff)
- wellknown_oidc_patch_go_infra: patch well-known JSON with msc2965.authentication
- synapse_login_flows_check_go_infra: health-check post-migration login flows

Flows + issues for custom Matrix clients (PC + Android):
- 0010 matrix-client-pc: Wails + React+Mantine (issues 0147-0153)
- 0011 matrix-client-android: Kotlin + Compose (issues 0154-0161)
- 0162 enable MAS as auth provider (Synapse delegate) — EXECUTED on VPS
- 0163 custom admin panel propio (sustituye synapse-admin)

Production state (organic-machine.com):
- Synapse migrated SQLite -> Postgres
- MSC3861 active, password_config disabled
- 21 users + 41 access_tokens migrated via syn2mas
- 4 MAS clients registered (element, matrix_pc, matrix_android, admin_panel)
- synapse-admin container removed + Coolify route deleted
- well-known patched with org.matrix.msc2965.authentication

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-24 22:53:33 +02:00

3.5 KiB

Raw Permalink Blame History

id, title, status, priority, created, related_flows, related_issues, dependencies, tags

title

status

priority

created

related_flows

related_issues

dependencies

Objetivo

Llamadas via LiveKit SFU (ya activo en organic-machine.com:7880-7882). Backend Go genera JWT con livekit-server-sdk-go. Frontend React usa livekit-client JS para join room, manejar tracks (mic/cam/screen), UI con tiles participantes, controles. Soporta 1:1 + grupales hasta 16 (limite config actual).

Tareas

Backend Go:
- MatrixService.RequestCallToken(matrixRoomID) -> (token, livekitRoomURL).
  - Mapea Matrix roomID -> LiveKit room name (hash determinista).
  - Genera JWT con claim room, identity (matrix userID), ttl 30min.
  - Permisos: canPublish=true, canSubscribe=true, canPublishData=true.
- Publicar event Matrix m.call.member para sincronizar quien esta en call (MSC3401).
Frontend React:
- Hook useLiveKitCall(matrixRoomID):
  - Pide token al backend.
  - Conecta Room de livekit-client.
  - Expone participants, tracks, localTracks, state.
  - Auto-publish microfono on connect (mute default).
- Componente CallPanel:
  - Grid tiles participantes (1, 2, 4, 9, 16 layout).
  - Tile principal con speaker activo (active-speaker detection del SDK).
  - Controles bottom: mic, cam, screen share, raise hand, leave.
  - PiP mode: cuando minimizado, tile flotante en esquina.
- Boton "Start call" en header del room (icono telefono).
- Boton "Join call" si hay call activa (segun m.call.member events).
- Notifs ring incoming call: audio + desktop notif.
Backend ICE/TURN:
- Verificar LiveKit config tiene TURN configurado (NAT traversal). Si no, anadir coturn container.
Tests:
- e2e/test_call_1to1.sh — 2 clientes (Wails + Element Web), 30s call, audio+video flow.
- e2e/test_call_screen_share.sh — compartir pantalla, otro cliente ve el track.
- e2e/test_call_4_participants.sh — 4 clientes simultaneos, no crash.

Funciones del registry a crear

livekit_token_gen_go_infra — JWT generator con livekit-server-sdk-go.
matrix_call_member_go_infra — wrapper para publicar/leer m.call.member state events.
useLiveKitCall_ts_ui — hook React.
CallPanel_ts_ui — componente UI completo de call.
CallTile_ts_ui — tile individual con video + nombre + speaker indicator.

Acceptance

Boton "Start call" en room DM con otro user.
Otro cliente (Element Web) ve ring + acepta -> 2 tiles con video+audio.
Mute mic + apagar cam funciona y se refleja en el otro lado.
Screen share: tile separado aparece para todos los participantes.
4 participantes simultaneos sin crash ni audio cortado.
Hangup limpia recursos (no tracks fantasma, no peer connections abiertas).

Notas

LiveKit room name: sha256(matrix_room_id + secret) truncado a 32 chars. Asi cualquier cliente que conozca el matrix_room_id puede computar el room name (no es secret).
Token TTL 30min, refresh proactivo a los 25min.
Codecs: H.264 + VP8 fallback para compatibilidad navegadores. Audio: Opus 32kbps.
E2EE en calls: LiveKit soporta E2EE simetrico (insertable streams API). TBD para version posterior — flow inicial usa SRTP only (cifrado SFU<->client, no e2e).
Sygnal push para incoming calls: enviar VoIP push con TTL bajo para wake-up moviles (relevante para issue 0158 Android).

3.5 KiB Raw Permalink Blame History