dendrite/roomserver
Till 331a6f221b
Some checks failed
Dendrite / WASM build test (push) Has been skipped
Dendrite / Linting (push) Failing after 15s
Dendrite / Unit tests (push) Failing after 9s
Dendrite / Build for Windows (push) Failing after 35s
Dendrite / Initial tests passed (push) Failing after 1s
Dendrite / Integration tests (push) Has been skipped
Dendrite / Upgrade tests (push) Has been skipped
Dendrite / Upgrade tests from HEAD-2 (push) Has been skipped
Dendrite / Sytest (SQLite Cgo) (push) Has been skipped
Dendrite / Sytest (PostgreSQL) (push) Has been skipped
Dendrite / Sytest (SQLite native) (push) Has been skipped
Dendrite / Complement (PostgreSQL) (push) Has been skipped
Dendrite / Complement (SQLite native) (push) Has been skipped
Dendrite / Complement (SQLite Cgo) (push) Has been skipped
Dendrite / Integration tests passed (push) Failing after 1s
Dendrite / Build for Linux (push) Successful in 4m9s
Dendrite / Update Docker images (push) Has been cancelled
Harmony backports (#3581)
Backport a few things from Harmony.

### Pull Request Checklist

<!-- Please read
https://matrix-org.github.io/dendrite/development/contributing before
submitting your pull request -->

* [ ] I have added Go unit tests or [Complement integration
tests](https://github.com/matrix-org/complement) for this PR _or_ I have
justified why this PR doesn't need tests
* [x] Pull request includes a [sign off
below](https://element-hq.github.io/dendrite/development/contributing#sign-off)
_or_ I have already signed off privately

---------

Signed-off-by: Till Faelligen <2353100+S7evinK@users.noreply.github.com>
Co-authored-by: Kegan Dougal <7190048+kegsay@users.noreply.github.com>
2025-06-19 07:49:03 +00:00
..
acls Speed up loading ACLs on startup (#3469) 2024-12-19 20:24:52 +00:00
api Update the license headers to mention the commercial license 2024-10-18 16:14:08 +02:00
auth Update the license headers to mention the commercial license 2024-10-18 16:14:08 +02:00
internal Harmony backports (#3581) 2025-06-19 07:49:03 +00:00
producers Update the license headers to mention the commercial license 2024-10-18 16:14:08 +02:00
state Update the license headers to mention the commercial license 2024-10-18 16:14:08 +02:00
storage Speed up loading ACLs on startup (#3469) 2024-12-19 20:24:52 +00:00
types Various fixes in fetchAuthEvents (#3447) 2024-12-17 19:18:05 +01:00
version Update the license headers to mention the commercial license 2024-10-18 16:14:08 +02:00
README.md use go module for dependencies (#594) 2019-05-21 21:56:55 +01:00
roomserver.go Update the license headers to mention the commercial license 2024-10-18 16:14:08 +02:00
roomserver_test.go Rename the go package 2024-10-17 17:33:45 +02:00

RoomServer

RoomServer Internals

Numeric IDs

To save space matrix string identifiers are mapped to local numeric IDs. The numeric IDs are more efficient to manipulate and use less space to store. The numeric IDs are never exposed in the API the room server exposes. The numeric IDs are converted to string IDs before they leave the room server. The numeric ID for a string ID is never 0 to avoid being confused with go's default zero value. Zero is used to indicate that there was no corresponding string ID. Well-known event types and event state keys are preassigned numeric IDs.

State Snapshot Storage

The room server stores the state of the matrix room at each event. For efficiency the state is stored as blocks of 3-tuples of numeric IDs for the event type, event state key and event ID. For further efficiency the state snapshots are stored as the combination of up to 64 these blocks. This allows blocks of the room state to be reused in multiple snapshots.

The resulting database tables look something like this:

+-------------------------------------------------------------------+
| Events                                                            |
+---------+-------------------+------------------+------------------+
| EventNID| EventTypeNID      | EventStateKeyNID | StateSnapshotNID |
+---------+-------------------+------------------+------------------+
|       1 | m.room.create   1 | ""             1 | <nil>          0 |
|       2 | m.room.member   2 | "@user:foo"    2 | <nil>          0 |
|       3 | m.room.member   2 | "@user:bar"    3 | {1,2}          1 |
|       4 | m.room.message  3 | <nil>          0 | {1,2,3}        2 |
|       5 | m.room.member   2 | "@user:foo"    2 | {1,2,3}        2 |
|       6 | m.room.message  3 | <nil>          0 | {1,3,6}        3 |
+---------+-------------------+------------------+------------------+

+----------------------------------------+
| State Snapshots                        |
+-----------------------+----------------+
| EventStateSnapshotNID | StateBlockNIDs |
+-----------------------+----------------|
|                     1 |           {1}  |
|                     2 |         {1,2}  |
|                     3 |       {1,2,3}  |
+-----------------------+----------------+

+-----------------------------------------------------------------+
| State Blocks                                                    |
+---------------+-------------------+------------------+----------+
| StateBlockNID | EventTypeNID      | EventStateKeyNID | EventNID |
+---------------+-------------------+------------------+----------+
|             1 | m.room.create   1 | ""             1 |        1 |
|             1 | m.room.member   2 | "@user:foo"    2 |        2 |
|             2 | m.room.member   2 | "@user:bar"    3 |        3 |
|             3 | m.room.member   2 | "@user:foo"    2 |        6 |
+---------------+-------------------+------------------+----------+