Commit graph

107 commits

Author SHA1 Message Date
Dagur Valberg Johannsson
58fd9595d7
Convert hash columns from TEXT to BLOB storage
Migrate all 32-byte hash fields from TEXT (64-char hex) to BLOB
(32 bytes) for ~50% storage savings on hash columns.

Changes:
- Add src/db/blob.rs with ToBlob/FromBlob traits for hash types
- Update all table schemas to use BLOB for hash columns
- Replace .to_hex() with .to_blob() for DB inserts
- Replace ::from_hex() with ::from_blob() for DB reads
- Use SQL hex() function where API responses need hex strings
- Bump DB_VERSION from 4 to 5

Affected tables: tx, pool, pool_history_entry, utxo_spending,
utxo_funding, user_action, auth_chain_entry, bcmr_data,
bcmr_failure, bcmr_well_known, crc20, crc20_candidates,
delphi_entry, cached_token_metrics

Fixes #1
2026-01-22 08:30:17 +01:00
Dagur Valberg Johannsson
be1499db7c
Fix token search dedup to prefer entries with metadata
When a token has both an auth_chain_entry (without BCMR) and a CRC20
entry (with name/symbol), the dedup logic now keeps the metadata
instead of returning NULL.
2026-01-21 15:23:42 +01:00
Dagur Valberg Johannsson
d85bc2c9db
Update copyright headers 2026-01-21 12:37:13 +01:00
Dagur Valberg Johannsson
1dabcc756c Merge branch 'shutdown' into 'master'
Add graceful shutdown for background threads

See merge request riftenlabs/riftenlabs-indexer!51
2026-01-21 11:36:47 +00:00
Dagur Valberg Johannsson
ec20a2ad75 Add graceful shutdown for background threads
Introduce a shutdown flag and Rocket fairing that signals background
threads to exit cleanly when Ctrl+C is pressed. Affects the indexing
thread, metrics updater, and block receiver loop.
2026-01-21 12:23:08 +01:00
Dagur Valberg Johannsson
46fb62d29b Fix bcmr_failure unique constraint for multi-token transactions
Remove errant UNIQUE INDEX on (utxo, txid) that conflicted with the
PRIMARY KEY (token_id, utxo, txid). A single transaction can update
auth chains for multiple tokens, requiring the same (utxo, txid) pair
to exist with different token_ids. The unique index blocked this.

The index was also unnecessary - EXPLAIN QUERY PLAN shows the PRIMARY
KEY index is used for all bcmr_failure lookups.

Add test covering multi-token failure recording.
2026-01-21 10:17:49 +01:00
Dagur Valberg Johannsson
50cd23dd34
Add RPC call to retrieve pool ID
Add a call that returns a pool ID given an utxo
2026-01-09 15:29:05 +01:00
Dagur Valberg Johannsson
a6c6159eba
Add Chipnet support 2026-01-09 13:46:58 +01:00
jakobsn
8fd14cc65b Manage several entries one txid 2025-11-17 09:21:51 +00:00
jakobsn
e053d52a76 Resolve "Olando auth-header not tracked" 2025-11-07 13:53:47 +00:00
Dagur Valberg Johannsson
861b9d16aa Merge branch 'volume-index' into 'master'
Add a volume index

See merge request riftenlabs/riftenlabs-indexer!41
2025-10-13 06:25:02 +00:00
Dagur Valberg Johannsson
ff3438ca9f
Add index to BCMR lookup 2025-10-08 14:03:20 +02:00
Dagur Valberg Johannsson
8be4cf894e
Add a volume index
Significantly improves cpu load of volume queries
2025-10-08 13:56:36 +02:00
jakobsn
885dde9534 Resolve "Panic occurred: attempt to multiply with overflow" 2025-10-03 13:32:37 +00:00
Jakob Notland
3b70e3e932 Format 2025-09-17 12:08:03 +02:00
Jakob Notland
af97a75540 Consider blockheight before timestamp 2025-09-17 12:05:24 +02:00
Jakob Notland
46462284e8 Clean 2025-09-17 11:52:22 +02:00
Jakob Notland
4d2336d9d7 clean 2025-09-17 11:27:05 +02:00
Jakob Notland
7e7f5b9bc7 Expose first pool created timestamp 2025-09-17 11:11:21 +02:00
jakobsn
6f25872ef7 Delete zero-tvl tokens from cached list. Allow zero-tvl search on exact tokenId 2025-09-16 09:10:54 +00:00
jakobsn
debe1630f4 Handleyoungtokenpricedifferences 2025-09-11 07:36:06 +00:00
jakobsn
f83f472656
Goodsearchandsort 2025-09-05 13:53:10 +00:00
Dagur Valberg Johannsson
8dc824860c
bug: Fix volume for periods with no trades
Return 0 in volume rather than query error.
2025-08-19 11:45:12 +02:00
Dagur Valberg Johannsson
ec49bf765b
Improve pool visitor queries; make price a visitor
This adds a big performance boost to pool visitor queries, also moving
token price queries to use the visitor model.
2025-08-19 02:37:28 +02:00
Dagur Valberg Johannsson
14a7486c1d
rpc: Add /volume endpoints
Add /volume endpoints that use the new token/sats delta entries for
faster volume queries.
2025-08-18 09:53:40 +02:00
Dagur Valberg Johannsson
6e0a56e33b
Add traded sats delta to pool history entry
Will make it faster to calculate volume.
2025-08-15 22:26:03 +02:00
Dagur Valberg Johannsson
6c13775475
Add simple db version check 2025-08-15 22:26:03 +02:00
Dagur Valberg Johannsson
5017713ab2
bug: TVL filtered by token
Fix query bug for TVL filtered by token and add a test.
2025-08-15 14:55:54 +02:00
Dagur Valberg Johannsson
dc0457de9f
Remove duplicate code; make use of pool visitor 2025-07-18 17:09:56 +02:00
Dagur Valberg Johannsson
8284b03528
Improve TVL queries
Fixes #8
2025-07-18 14:13:08 +02:00
Dagur Valberg Johannsson
7d9352cf53
Fix clippy issues 2025-07-16 13:52:46 +02:00
Dagur Valberg Johannsson
460a1fc7f1
Add arbitrary int support 2025-07-16 09:30:17 +02:00
jakobsn
b17b8a3947 Resolve "Oracle prices" 2025-06-17 14:04:26 +00:00
Dagur Valberg Johannsson
78e391560f
Added support for delphi oracle
This allows fetching historical asset prices from the blockchain.
2025-05-21 13:33:26 +02:00
Dagur Valberg Johannsson
84ea84f4be
Filter tokens with no liquidity 2025-02-17 21:10:16 +01:00
Dagur Valberg Johannsson
4bf31c0131
Don't trigger parallel cache updates 2025-02-17 21:07:26 +01:00
Dagur Valberg Johannsson
5bb841f5c5
bug: don't crash on db read failure 2025-02-14 18:02:48 +01:00
Dagur Valberg Johannsson
0b4da0287d
bug: Fix tvl in token list 2024-11-28 10:27:35 +01:00
Dagur Valberg Johannsson
39131d4670
bug: Fix current price calculation 2024-11-28 08:45:21 +01:00
Dagur Valberg Johannsson
1f3ffa42a2
rpc: Add pool owner/token to history 2024-11-13 13:24:06 +01:00
Dagur Valberg Johannsson
b1e88ff261
rpc: Add pool history call 2024-11-13 11:28:27 +01:00
jakobsn
1248929fb4 Search tokens 2024-10-31 10:55:29 +00:00
Dagur Valberg Johannsson
058f751a21
Improve querying for active pools
By using new field in the pool history entry table, we can improve the
query time for finding active cauldron pools.

This change also fixes a datatype issue in the table where TEXT was used
instead of INT.
2024-10-25 14:45:37 +02:00
Dagur Valberg Johannsson
96a960a6bd
Improve mempool removal speed
Remove multiple in one query and trust in `ON DELETE CASCADE` to do its
job.
2024-10-25 14:32:04 +02:00
Dagur Valberg Johannsson
19b3a3d3ea
Update tests for new table layout
Also rewrote tests to use insert functions
2024-10-24 09:12:12 +02:00
Dagur Valberg Johannsson
e4e7ec3b71
Add aggregated APY endpoint
Add an endpoint that gives a APY value across multiple micro-pools
2024-10-23 16:54:06 +02:00
Dagur Valberg Johannsson
751c1df6a7
Add CRC20 index 2024-10-21 13:35:24 +02:00
jakobsn
07c75b1a7e Tokens page 2024-10-14 11:18:50 +00:00
Dagur Valberg Johannsson
3abbdbc177
Add timestamp to pools table
To speed up historical price queries, add timestamp to pools.
This denormalizes the database a bit for improved query performance.
2024-10-08 17:22:37 +02:00
Dagur Valberg Johannsson
528cc79725
API call for latest transactions 2024-09-25 13:39:06 +02:00