source: docs/P1-ConceptualModel/wiki/ERModel.md@ 0cee8ec

= Entity-Relationship Model v.04 =

== Diagram ==

[[Image(ERModel_v04.png, 800px)]]

Notation: Chen. Rectangles are entity sets, diamonds are relationships, ellipses
are attributes, underlined ellipses are primary keys, the dashed ellipse is a
derived attribute. A double line between an entity set and a relationship marks
'''total participation''' (every instance of that entity set must participate); a
single line marks partial participation.

Two deliberate modeling decisions worth stating up front:

 * '''No foreign keys appear in the diagram.''' Connections between entity sets are expressed as relationships, per the notation. Foreign-key columns appear only in the relational model in [wiki:RelationalDesign].
 * '''`Holds` and `Contains` are relationships, not entity sets.''' Both are M:N and both carry their own attributes, which is exactly what a Chen relationship is for. They become tables (`holdings`, `watchlist_items`) only in P2.

== Data requirements ==

Each entity set is given as a short rationale for why it exists as its own set,
its keys, and its attributes as a table. Each relationship is given as its
cardinality and participation, a short rationale, and — where it carries data —
an attribute table.

=== Entity sets ===

==== Users ====
Registered participants of the platform. Every action in the simulation is
attributed to a user, and the two balance attributes are what makes the
simulation work: cash that is free to trade is tracked separately from cash
that is currently committed to open positions, so the platform can refuse a
purchase without having to recompute the whole portfolio first.

'''Keys:''' candidates `{id}`, `{username}`, `{email}`; primary key '''`id`'''. A
surrogate UUID was chosen because it is opaque and stable — `username` and
`email` are both things a user may legitimately want to change later, and
every relationship in the diagram points at `Users`, so a mutable key would
propagate changes across the whole database.

||= Attribute =||= Type =||= Constraints =||
|| `id` || UUID || PK, required ||
|| `username` || text(50) || required, unique ||
|| `email` || text(255) || required, unique, contains `@` ||
|| `full_name` || text(200) || optional ||
|| `password_hash` || text(255) || required — never the password itself; the prototype stores a SHA-256 hex digest ||
|| `available_balance` || numeric(18,4) || required, default 0, ≥ 0 ||
|| `invested_balance` || numeric(18,4) || required, default 0, ≥ 0 ||
|| `reserved_balance` || numeric(18,4) || required, default 0, ≥ 0 — cash set aside for the user's open buy orders (added in v04, after P7) ||
|| `created_at` || timestamptz || required, defaults to now ||
|| `updated_at` || timestamptz || optional (null until first change) ||

==== Cryptos ====
The catalog of crypto assets the platform knows about. Kept separate from
`Markets` because an asset exists independently of the pairs it is traded in —
the same asset can be quoted against several currencies, and a user's holding is
in the ''asset'', not in a particular pair.

'''Keys:''' candidates `{id}`, `{symbol}`; primary key '''`id`''', for the same
reason as in `Users`. `symbol` is kept as a unique natural key because that is
what users type and see.

||= Attribute =||= Type =||= Constraints =||
|| `id` || UUID || PK, required ||
|| `symbol` || text(20) || required, unique (e.g. `BTC`) ||
|| `name` || text(255) || required (e.g. `Bitcoin`) ||
|| `created_at` || timestamptz || required, defaults to now ||

==== Markets ====
A tradeable pair: one crypto asset quoted in one currency, e.g. BTC/USD. This is
where prices live, and it is the thing an order is placed ''on''. Modeled as its
own entity set rather than an attribute of `Cryptos` because a market has its own
lifecycle — it can be deactivated without deleting the asset — and because
trades, candles and orders all reference the pair, not the asset.

'''Keys:''' candidates `{id}`, `{crypto_id, quote_currency}` — that pair is
unique by definition, since a given asset can only be quoted once per
currency; primary key '''`id`''', so that the many entity sets referencing a
market carry one narrow column instead of a composite key.

||= Attribute =||= Type =||= Constraints =||
|| `id` || UUID || PK, required ||
|| `quote_currency` || text(3) || required, default `USD` ||
|| `is_active` || boolean || required, default true — inactive markets are hidden from the trading menus but keep their history ||
|| `created_at` || timestamptz || required, defaults to now ||

==== Orders ====
A user's instruction to buy or sell on a market. Needed as a separate entity set
because an order is a record of ''intent'' that outlives its execution: it keeps
the requested quantity and price even after it has been filled, which is what
makes the ledger auditable.

Placing an order is what triggers a '''reservation''' of whatever it commits:
the crypto being sold (`Holds.reserved_quantity`, below) on a sell, and the
cash (`Users.reserved_balance`) on a buy. Since v04 (after P7) an order can
wait in the order book and be filled in parts, so `status` is a real
lifecycle driven by `filled_quantity`: `open` (nothing filled yet),
`partially_filled`, `executed` (completely filled), or `cancelled`, which
releases what is still reserved. See
[wiki:UseCase0005] for the reserve-then-settle
sequence and
[wiki:AdvancedDatabaseDevelopment]
for the rules that keep it consistent.

'''Keys:''' candidate `{id}` only — there is no natural key, since the same user
can place two identical orders on the same market in the same second, and both
are legitimately distinct; primary key '''`id`'''.

||= Attribute =||= Type =||= Constraints =||
|| `id` || UUID || PK, required ||
|| `side` || text || required, `buy` or `sell` ||
|| `type` || text || required, `market` or `limit` (both executed since P7) ||
|| `status` || text || required, `open`, `partially_filled`, `executed` or `cancelled` ||
|| `quantity` || numeric(20,4) || required, > 0 ||
|| `filled_quantity` || numeric(20,4) || required, default 0, between 0 and `quantity` — how much has been traded; remaining = `quantity − filled_quantity` (added in v04, after P7) ||
|| `price` || numeric(18,6) || the limit price; for a market order, the market price when it was placed ||
|| `placed_at` || timestamptz || required, defaults to now ||
|| `executed_at` || timestamptz || optional, set when the order settles ||

==== Transactions ====
The financial ledger: every movement of virtual cash, in one place. This exists
so that a balance is never just a number someone edited — it is the sum of an
auditable list of entries, which is also what the "explain every step" goal of
the project needs.

'''Keys:''' candidate `{id}` only; primary key '''`id`'''.

||= Attribute =||= Type =||= Constraints =||
|| `id` || UUID || PK, required ||
|| `type` || text || required, `deposit`, `buy`, `sell` or `fee` ||
|| `amount` || numeric(18,4) || required, signed — negative for money leaving the cash balance, positive for money arriving ||
|| `currency` || text(3) || required, default `USD` ||
|| `created_at` || timestamptz || required, defaults to now ||
|| `description` || text || optional, free-form ||

==== !MarketTrades ====
Individual executed trades on a market, from the user's own fills and from the
market simulator. This is the single source of truth for the current price: the
price of a market is the price of its most recent trade, never a column someone
writes directly.

'''Keys:''' candidate `{id}` — `{market_id, executed_at}` looks unique in
principle, but two trades can share a timestamp, so it is not a safe key;
primary key '''`id`''' (a plain auto-incrementing integer here rather than a
UUID, because this is the highest-volume entity set and it is only ever read
in timestamp order, never referenced by anything else).

||= Attribute =||= Type =||= Constraints =||
|| `id` || integer || PK, required, auto-generated ||
|| `executed_at` || timestamptz || required ||
|| `price` || numeric(18,6) || required, > 0 ||
|| `quantity` || numeric(20,6) || required, > 0 ||
|| `side` || text || optional, `buy` or `sell` ||
|| `source` || text(50) || required, default `simulation` — distinguishes a simulated trade from a user's own fill (`user`) ||

Since v04 (after P7) a trade also records which orders it filled, through the
relationships `FillsBuy` and `FillsSell` below.

==== !OrderEvents ====
''Added in v04, after P7.'' The audit trail of an order: one event for its
placement, one for every (partial) fill, and one for a cancellation. The
`Orders` row only holds the current state; this entity keeps the history of
how the order got there. Events are recorded automatically by the database.

'''Keys:''' candidate `{id}` only; primary key '''`id`''' (auto-incrementing
integer, events are only read in order).

||= Attribute =||= Type =||= Constraints =||
|| `id` || integer || PK, required, auto-generated ||
|| `event_type` || text || required, `placed`, `partially_filled`, `filled` or `cancelled` ||
|| `quantity` || numeric(20,4) || required — the ordered quantity for `placed`, the filled amount for a fill, the unfilled rest for `cancelled` ||
|| `price` || numeric(18,6) || optional — the order price, or the trade price for a fill ||
|| `status_after` || text || required, the order's status after the event ||
|| `created_at` || timestamptz || required, defaults to now ||

==== !MarketCandles ====
OHLCV aggregates per market and timeframe — the data a price chart is drawn
from. Stored rather than computed on the fly because the point of the project is
a chart-driven interface, and re-aggregating the whole trade history for every
screen refresh does not scale.

'''Keys:''' candidates `{id}`, `{market_id, timeframe, candle_time}` — a market
has exactly one candle per timeframe per time bucket; primary key '''`id`''', the
composite is enforced as a uniqueness rule because it is the real-world
constraint and it is what prevents duplicate candles.

||= Attribute =||= Type =||= Constraints =||
|| `id` || integer || PK, required, auto-generated ||
|| `timeframe` || text || required, `1m`, `5m`, `1h` or `1d` ||
|| `open`, `high`, `low`, `close` || numeric(18,6) || all required ||
|| `volume` || numeric(20,6) || required ||
|| `candle_time` || timestamptz || required — the start of the bucket ||

==== Watchlists ====
A named list of assets a user wants to monitor. A separate entity set rather than
a flag on the relationship between users and assets, because a user may want
several lists ("long term", "watching today") and each needs its own name.

'''Keys:''' candidate `{id}` — `{user_id, name}` would also work if list names
were required to be unique per user, which the model does not impose, so it is
not listed as a candidate key; primary key '''`id`'''.

||= Attribute =||= Type =||= Constraints =||
|| `id` || UUID || PK, required ||
|| `name` || text(100) || required ||
|| `created_at` || timestamptz || required, defaults to now ||

=== Relationships ===

==== !QuotedOn — Cryptos (1) : Markets (N), total on Markets ====
Ties a market to the asset it trades. One asset can be quoted in many markets;
every market must have exactly one asset, hence total participation on the
`Markets` side. No attributes.

==== !PlacedOn — Markets (1) : Orders (N), total on Orders ====
Records which market an order was placed on. Every order must name a market;
a market may have no orders yet. No attributes.

==== Places — Users (1) : Orders (N), total on Orders ====
Records who placed an order. Every order belongs to exactly one user; a new
user has no orders. No attributes.

==== Records — Users (1) : Transactions (N), total on Transactions ====
Attributes each ledger entry to a user. Every entry belongs to exactly one
user. No attributes.

==== Settles — Orders (1) : Transactions (N), partial on both sides ====
Links a ledger entry to the order that caused it. Partial on the
`Transactions` side because deposits have no originating order, and partial on
the `Orders` side because an order that never executes never produces a
ledger entry — which is why the corresponding column is nullable in P2. No
attributes.

==== Fills — Markets (1) : !MarketTrades (N), total on !MarketTrades ====
Every executed trade happened on exactly one market. No attributes.

==== !FillsBuy — Orders (1) : !MarketTrades (N), partial on both sides ====
''Added in v04, after P7.'' The buy order a trade filled. An order can be
filled by many trades (partial fills); a trade fills at most one buy order,
and none when the simulated market was the buyer. No attributes.

==== !FillsSell — Orders (1) : !MarketTrades (N), partial on both sides ====
''Added in v04, after P7.'' The sell order a trade filled, symmetric to
`FillsBuy`. A trade between two users' orders participates in both. No
attributes.

==== Logs — Orders (1) : !OrderEvents (N), total on !OrderEvents ====
''Added in v04, after P7.'' Every event belongs to exactly one order. No
attributes.

==== Aggregates — Markets (1) : !MarketCandles (N), total on !MarketCandles ====
Every candle summarises trades of exactly one market. No attributes.

==== Owns — Users (1) : Watchlists (N), total on Watchlists ====
Every watchlist belongs to exactly one user. No attributes.

==== Holds — Users (M) : Cryptos (N), partial on both sides, '''with attributes''' ====
A user's position in an asset. M:N because one user holds many assets and one
asset is held by many users, and partial on both sides because a user may hold
nothing and an asset may be held by nobody. Modeled as a relationship rather
than an entity set because a position has no identity of its own — it is
entirely described by ''which user'', ''which asset'', and how much.

`reserved_quantity` mirrors `available_balance`/`invested_balance` on `Users`:
two independently updated stored numbers, with the amount actually free to use
computed on demand rather than stored (`quantity − reserved_quantity` here,
`available_balance` alone on the cash side). Without it, nothing stopped a
user from placing a second sell order against crypto already promised to a
first one — `quantity` alone cannot tell "owned" apart from "owned, but
already committed elsewhere." See history, v03.

||= Attribute =||= Type =||= Constraints =||
|| `quantity` || numeric(20,4) || required, ≥ 0 — total amount owned ||
|| `reserved_quantity` || numeric(20,4) || required, default 0, `0 ≤ reserved_quantity ≤ quantity` — committed to the user's own open sell orders, not yet removed from the position ||
|| `avg_price` || numeric(18,6) || required, ≥ 0, '''derived''' (dashed ellipse) — the weighted average of the prices at which the position was accumulated; derivable from the buy history, stored anyway so unrealised P/L can be shown without replaying the whole ledger ||
|| `created_at` || timestamptz || required, defaults to now ||
|| `updated_at` || timestamptz || optional ||

==== Contains — Watchlists (M) : Cryptos (N), partial on both sides, '''with attribute''' ====
Which assets are on which watchlist. M:N: a list holds many assets, an asset
appears on many lists. Partial on both sides — an empty list is valid and an
asset need not be on any list.

||= Attribute =||= Type =||= Constraints =||
|| `added_at` || timestamptz || required, defaults to now — recorded so a list can be shown in the order the user built it ||

== Entity-Relationship Model History ==

 * '''v01''' — First complete version. Built from the entity notes in `ep-diagram.md` (the initial hand-written model), with three changes made to that initial model while drawing it:
   1. `Markets` was promoted from an implied attribute of the asset to its own entity set, so that prices, orders, trades and candles can all reference a pair rather than an asset.
   2. `holdings` and `watchlist_items` were re-expressed as the M:N relationships `Holds` and `Contains` with their own attributes, instead of entity sets with foreign keys — the initial notes listed them as tables, which is a relational concept that does not belong in a Chen ERD.
   3. `avg_price` was marked as a derived attribute rather than a plain one, to make the denormalisation explicit rather than hidden.
 * '''v02''' — Student review pass over the AI-generated v01 in the TerraER GUI.
 * '''v03''' — Added `reserved_quantity` to `Holds`, and reworded `Orders.status` to state its reserve → settle → (cancel) lifecycle explicitly, instead of leaving `open`/`cancelled` as unused enum values. Triggered by a design review that pointed out the model had no way to stop a user from placing a second sell order against crypto already promised to a first, unsettled one — `quantity` alone cannot distinguish "owned" from "owned, but already committed." Also redrawn more compactly: every entity and relationship (with its own attributes moved along with it) was pulled proportionally toward the diagram's centroid, shrinking the canvas by roughly 45% with the same topology and no new overlaps. See [wiki:ERModelAIUsage] for the reasoning and how the diagram file itself was produced, and [wiki:RelationalDesign] and [wiki:UseCase0005] for how the new attribute is enforced.
 * '''v04 — after P7.''' Phase 7 (order, balance and trade consistency) needed data the model did not have, so the model was extended to stay in line with the database:
   * `Users.reserved_balance`: cash reserved by open buy orders;
   * `Orders.filled_quantity` and the status value `partially_filled`: orders can now be filled in parts;
   * the relationships `FillsBuy` and `FillsSell` between `Orders` and `MarketTrades`: which orders a trade filled;
   * the entity set `OrderEvents` with the relationship `Logs`: the automatically recorded history of every order.

  Nothing existing was removed or changed. See
  [wiki:AdvancedDatabaseDevelopment].
  The diagram files are `ERModel_v04.xml` / `ERModel_v04.png`; earlier versions
  are kept.

Reasoning for the AI-assisted part of this phase, and the full interaction log,
are on [wiki:ERModelAIUsage].