| .. | ||
| quic_edge.proto | ||
| README.md | ||
QUIC edge v1 wire format
Scope and topology
QUIC edge v1 carries two functions over one authenticated QUIC connection:
- a reliable bidirectional control stream for node registration, heartbeat, current local IP addresses, the advertised gRPC endpoint and media metadata;
- QUIC DATAGRAM payloads for lossy, real-time audio and video.
Robot arm, AGV and other device-control APIs remain on the existing cmvr-es gRPC server. The QUIC node descriptor advertises that server's current endpoint; it does not move robot-control RPCs onto QUIC.
cmvr-es -- custom QUIC edge v1 --> Java receiver / edge gateway
|
+-- WebTransport/HTTP3 --> browser
A browser cannot connect to this custom QUIC ALPN directly. The gateway must terminate v1, register the node, reassemble media fragments and expose WebTransport (or another browser-supported media API). Browser sessions do not participate in edge-node registration or heartbeat.
Build and host-safe defaults
MsQuic is optional at configure time. It can be installed under
dependency/<arch>/third_party/msquic/<version> or supplied explicitly:
cmake -S . -B build \
-DCMVR_ENABLE_MSQUIC_BACKEND=ON \
-DCMVR_MSQUIC_ROOT=/absolute/path/to/msquic
cmake --build build -j2
cmake --install build
Without MsQuic the project still builds, but enabling the QUIC task fails with
an explicit error. The repository default keeps quic_edge disabled. The
existing inbound gRPC server remains enabled independently.
To enable node presence without media:
- Configure the gateway address, ALPN
cmvr-quic-edge/1, TLS trust, node ID, advertised gRPC endpoint and heartbeat values incmvr-es/config/tasks/quic_edge_task/quic_edge_task.pb.txt. Certificate paths are relative to the cmvr-es configuration root, for examplecerts/quic_gateway_ca.pem. - Leave
tracksempty, setquic_edge.enable: true, and enable thequic_edgeTaskManager entry.
To add a media uplink, also enable the camera/microphone in DeviceManager and
add a matching tracks entry. A zero-track configuration is valid: unavailable
media must not suppress node registration, IP reporting or heartbeat.
maximum_frame_bytes must fit in one atomically admitted DATAGRAM batch; reduce
it or increase datagram_send_queue_depth when changing the DATAGRAM size.
Reliable control stream
The edge opens one bidirectional reliable stream after the QUIC handshake. Both directions carry a sequence of length-prefixed protobuf messages:
uint32_be protobuf_length
protobuf EdgeControlEnvelope
The length excludes the four-byte prefix. Each receiver must reject a frame
larger than its configured control-frame limit. protocol_version is 1.
message_sequence increases independently in each direction; gaps are allowed,
but duplicates and reordering are rejected. The edge resets its outbound
control sequence on every connection, so its first NodeRegisterRequest
currently has message_sequence=0; gateways must not assume the sequence starts
at 1. Heartbeat uses a separate sequence so its acknowledgement remains
explicit.
The legal session order is:
- The edge sends
NodeRegisterRequestas its first application message after every QUIC connect or reconnect. It includesnode_id,boot_id, software version, the current IPv4/IPv6 interface snapshot and advertised gRPC endpoint. - The gateway replies with
NodeRegisterResponse. Media and heartbeat must not start untilaccepted=trueand a non-emptysession_idare received. - The edge sends
NodeHeartbeatat the negotiated interval. The gateway returnsNodeHeartbeatAckwith the samesession_idand exactacknowledged_sequence. A missing, rejected or mismatched ACK causes the edge to reconnect and register again after its configured backoff. - If media tracks are available, the edge sends
MediaSessionOpen, binding itssession_epochto the acceptedsession_id, followed by track descriptors. The edge calls reliable descriptor send before DATAGRAM send for a new generation. QUIC does not guarantee arrival order across a reliable stream and DATAGRAMs, so a gateway must boundedly buffer or drop media whose session or generation metadata has not arrived yet. - The gateway may send
ProtocolError; a fatal error closes the connection. The current edge receive path otherwise accepts onlyNodeRegisterResponseandNodeHeartbeatAck. AlthoughMediaSessionCloseis present in the v1 schema, the current edge neither sends it nor accepts it inbound. Gateways must not depend on that message until both sides implement and test it.
The edge sends a fresh local-interface snapshot in every heartbeat, so an IP
change is reported without a second protocol. These addresses are edge claims.
observed_source_ip is authoritative for the public/NAT-facing address and must
be derived by the gateway from the authenticated QUIC peer, never copied from a
client field. heartbeat_interval_ms=0 in the registration response means the
edge retains its configured interval.
DATAGRAM negotiation is required only when at least one media track is enabled. The reliable registration and heartbeat path remains valid for a zero-track node or while all media sources are unavailable.
Media source registration, device start/keyframe callbacks and DATAGRAM packetization run on a dedicated media worker. Reliable registration and heartbeat therefore continue while a media source is slow or unavailable; the reliable send path serializes heartbeat and media metadata so envelope sequence order remains strict.
MediaSourceHub is protocol-neutral and gives each adapter an independent,
single-consumer subscription cursor. Its source-start callback receives a
cancellation predicate and must check it around potentially blocking device
startup. QUIC reconnect/stop and gRPC client cancellation can therefore abandon
startup without blocking presence or process shutdown. Ring overflow keeps the
newest bounded set of immutable frames, advances a slow cursor to the oldest
retained frame, and reports the exact dropped count so protocol adapters can
mark a discontinuity and request a new video keyframe.
Media DATAGRAM wire format
Every media DATAGRAM starts with this fixed 64-byte, network-byte-order header:
| Offset | Size | Field |
|---|---|---|
| 0 | 4 | magic CMQD (0x434d5144) |
| 4 | 1 | protocol version (1) |
| 5 | 1 | media kind (1 video, 2 audio) |
| 6 | 2 | flags |
| 8 | 2 | header size (64) |
| 10 | 2 | fragment index |
| 12 | 2 | fragment count |
| 14 | 2 | payload size |
| 16 | 4 | track ID |
| 20 | 4 | codec generation token |
| 24 | 8 | media session epoch |
| 32 | 8 | DATAGRAM packet sequence |
| 40 | 8 | media frame sequence |
| 48 | 8 | monotonic capture timestamp in microseconds |
| 56 | 4 | complete frame size |
| 60 | 4 | fragment byte offset in the complete frame |
Flag bit 0 marks a video keyframe, bit 1 is reserved and must currently be
zero, and bit 2 marks a discontinuity. Codec initialization bytes are carried
reliably in MediaTrackDescriptor. QUIC already authenticates each DATAGRAM,
so the application header has no redundant checksum.
Receivers must key reassembly by (session_epoch, track_id, frame_sequence),
drop incomplete frames at their playback deadline, and reject fragments whose
offset plus payload exceeds frame_size. A new session epoch invalidates all
fragments retained from a previous connection. frame_sequence is generated
by the QUIC edge service and remains strictly increasing per track throughout
the media epoch, including after a device source restarts.