Commit Graph

263 Commits

Author SHA1 Message Date
TAMARA LIPOWSKI
0cf444c5f9 fix: Remove failing Balancer V3 tests
- These were also failing in python.
2025-09-18 11:18:25 -04:00
TAMARA LIPOWSKI
0226bda482 fix: Compare lowercase component IDs
- This was failing. Make this more lenient so the user can specify component id in the test file in a non-case-sensitive manner.
- Also switched around a wrong token order which was causing a failure (not sure we care about token order but we may in the future? Python didn't care...)
2025-09-18 11:18:25 -04:00
TAMARA LIPOWSKI
779c690b6d fix: Fix python tests
- These are just used for comparison purposes and will eventually be deleted.
- Also balancer v3 test fix: add protocol_system to yaml, and remove "excludePaths" from protobuf in substreams.yaml (this entry was not supported)
2025-09-18 11:18:25 -04:00
adrian
b1315d1863 test: remove test_composable_stable_pool_creation for balancer-v2 2025-09-17 10:27:44 +02:00
adrian
e1d0c58e64 test: add ci workflow for substreams tests 2025-09-17 10:27:44 +02:00
adrian
183c034204 chore: remove ./substreams/target/wasm32-unknown-unknown/release/*.d files 2025-09-16 11:31:19 +02:00
adrian
d728440048 feat: add evm and wasm files 2025-09-16 11:31:19 +02:00
dianacarvalho1
22843cfd3b feat: Add encoding to test suite (#259)
* feat: Add encoding to test suite

Use execution from simulation
Add protocol_system to all test files and pass it to run tycho
Add encoding_utils.rs

#time 5h 0m

#time 1m

#time 7m

* refactor: Move encoding swap to its own method to simplify main code

Rename encoding_utils.rs to encoding.rs

#time 20m


#time 0m

#time 0m
2025-09-11 14:30:49 +01:00
adrian
24504d0f94 feat: add docker image to build binaries used in tests 2025-09-10 16:36:08 +02:00
Zizou
ed43a079c9 feat: update balancer v2 spkg to make it return old slot values (#252)
* feat: update balancer v2 spkg to make it return old slot values

This is needed for the new DCI version that uses old values to look into exactly what part of the slot change and compare with the retrigger offset

* refactor: use crate registry instead of github

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-09-09 10:38:35 +02:00
kayibal
655fae77ab chore: Bump tycho-substreams version 2025-09-05 12:37:40 +01:00
adrian
eac74450bc test: add test for the token balances validation 2025-09-04 17:46:27 +02:00
kayibal
61ad26c17a feat: Add previous_value field to ContractSlot
This change is required by the DCI to properly detect potential address changes (retriggers) on packed storage slots.
2025-09-03 16:35:32 +01:00
kayibal
8b4611f9bb feat: Add previous_value field to ContractSlot
This change is required by the DCI to properly detect potential address changes (retriggers) on packed storage slots.
2025-09-03 16:35:32 +01:00
adrian
87c9a8b60f test: check that all the existing substreams integration test files can be parsed 2025-09-03 08:55:29 -04:00
Zizou
6fba0b3b3d fix: update sdk version for uniswapv3/v4 and ekubo (#227)
This is following the bugfix in https://github.com/propeller-heads/tycho-protocol-sdk/pull/213

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-06-30 16:40:00 +00:00
die-herdplatte
1ff97ff43f Ekubo TWAMM & MEV-resist integration (#192)
* Add Ekubo TWAMM support

* Change order of words

* Account TWAMM order balances

* Fix tracking wrong component balance deltas

Swapped and PositionUpdated are the only events affecting pool TVL

* Fix fee addition

Fees are a .64 instead of a .128 since v2 & the result is rounded

* Consistent naming

* cargo fmt

* Add method for selecting store method from change type

* Only store the affected sale rate delta on OrderUpdated events

* Remove unnecessary parameterization

* Index Ekubo MEV-resist pools

* cargo clippy
2025-06-30 14:45:08 +00:00
Louise Poole
58324a199f chore: fix typos 2025-06-26 12:33:31 +02:00
Louise Poole
c2bb3a8ca8 chore: fix cargo auto-resolution of tycho dependencies 2025-06-26 12:33:01 +02:00
mrBovo
fc0fb1e540 BalancerV3: SwapAdapter and Substreams (#126)
* feat: add balancer swapAdapter and Substreams

* fix: undo tycho-substreams logs, ignore abi on rustmft

* ci: prevent warnings from failing CI

* ci: skip size check on CI

* chore: forge fmt

* feat: vault balance from storage

Vault contract tokenBalance message are set according to the vault
storage changes in the `_reserveOf` storage variable VaultStorage.sol
contract
This was the culprit that caused the failure in simulation since
balancer enforces the invariant that `token.balanceOf(vault_addr) == _reservesOf[token]`

* ci: warnings

* fix: avoid duplicated balance changes

* fix: order by ordinal

* chore: format

* feat: extract new contracts before extracting balance changes

* feat: skip unnecessary steps if no balance change is found

* refactor: filter out account balances for tokens that aren't part of any protocol components.

On the indexer side, when we receive an account balance, we need to know about the token. This commit ensure that the token was introduced before we emit any account balance with it.

* refactor: don't index liquidity buffers.

Liquidity buffers rely on rate providers. Therefore we need DCI (feature to be able to index previously created contract) to deal with them.

* refactor: cleanup tests and add docstrings

* chore: lock tycho-substreams version

* ci: set Foundry workflow to use stable foundry

* feat(DCI): Add DCI Entrypoints to BalancerV3 components (#218)

* refactor: fix typo in weighted_pool_factory_contract name

* feat: add rate_providers static attributes

* feat: add DCI entrypoints to BalancerV3 components

* fix: set default trade price to Fraction(0, 1)

* feat: remove buffers as components

Buffers are to be used internally by Boosted pools (stable/weighted pools that use ERC4626 tokens). They are not to be treated as a separate swap component.

* test: update test blocks

Extend tests some tests block range to ensure liquidity was added to the pool and can be simulated on

* feat: remove buffers as components

Remove balance updates for buffer components

* feat: listen for pool pause/unpause events

* chore: formating

* fix: encoding call data

* test: update Balancer V3 tests to use DCI

* test: set indexer log level to info

* docs: add comment on support of boosted pools

* feat: update balancer v3 package version

---------

Co-authored-by: Thales <thales@datarevenue.com>
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
Co-authored-by: Louise Poole <louise@datarevenue.com>
Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>
2025-06-26 12:19:39 +02:00
Louise Poole
dfa87f662d fix(balancer_v2): skip adding zero address rate_provider entrypoints (#224) 2025-06-25 15:52:49 +00:00
Louise Poole
1c6c2c53c7 chore: bump tycho-substreams crate version (#223)
* chore: bump tycho-substreams crate version

* chore: update cargo.lock
2025-06-25 17:48:46 +02:00
Louise Poole
d4670d4312 chore: remove duplicate tycho-substreams from cargo.lock (#222) 2025-06-24 13:46:44 +02:00
Zizou
27f178de59 fix(sdk): properly handle deletion -> creation -> deletion sequence (#213)
* fix(sdk): properly handle deletion -> creation -> deletion sequence

This commit resolves a bug that occurred when an attribute underwent a deletion, followed by creation, and then another deletion. The system would incorrectly ignore the final deletion because the attribute was mistakenly marked as newly created during the process.

* docs: fix typo

Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>
2025-06-24 09:41:10 +00:00
Louise Poole
648a3bf419 fix: skip processing balances of bpt tokens (#220) 2025-06-19 16:27:26 +02:00
tvinagre
3f1beeab7c fix: Make get_block_storage_changes public (#214)
* fix: Make get_block_storage_changes public

* Make RpcTraceData caller optional

* feat: Create function to decode list of addresses
2025-06-16 21:40:39 +00:00
Zizou
7da01c745b feat: Balancer V2 DCI integration (#219)
* feat: Add DCI Entrypoints to BalancerV2 components

* fix: miscellaneous fixes before Balancer V2 resync

This commit fixes the entrypoints created by Balancer v2 packages, removes some disabled factories and remove support for BPT tokens (this is still to be investigated but so far we won't be able to support them)

* refactor: fix CI and bump version

* chore: update comments

---------

Co-authored-by: Thales <thales@datarevenue.com>
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
Co-authored-by: Louise Poole <louise@datarevenue.com>
2025-06-16 11:35:59 +02:00
Zizou
2620a5442d chore: add repository URL to ethereum-maverick-v2.yaml (#212)
* chore: add repository URL to ethereum-maverick-v2.yaml

* chore: bump maverick-v2 version.

This bump is needed because we changed the version of `tycho-substreams` in a previous commit (to fix the bug with contract creation).

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-23 17:21:44 +02:00
Zach
fb0a57bf07 feat: Add Maverick V2 adapter and substreams (#167)
Co-authored-by: Thales <thales@datarevenue.com>
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-23 17:07:15 +02:00
dianacarvalho1
a7841af383 feat: Add entrypoint utils and define EntryPointParams (#211)
* feat: Add entrypoint utils and define EntryPointParams

#time 23m


#time 0m

* fix: Make TraceData mandatory

#time 2m

* fix: Make component_id in EntryPointParams optional

#time 1m
2025-05-20 17:47:25 +01:00
zizou
7e73061f8e chore: add repository URL to substreams.yaml for ethereum_balancer_v2 2025-05-19 13:49:34 +02:00
Louise Poole
c778e7dee2 feat: extend DCI message structs (#210)
* feat: extend DCI message structs

* chore: add entrypoint params placeholder to transaction builder

* fix: rename call_data as calldata
2025-05-16 11:04:55 +02:00
Louise Poole
b13360c92b fix: change Entrypoint signature type to string (#209) 2025-05-14 15:42:44 +02:00
Zizou
43764fa5cb refactor: update test config to include coins (#208)
* refactor: update test config to include `coins`

* refactor: rename package to `ethereum_curve` and add repository URL in substreams.yaml

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-14 12:37:12 +02:00
dianacarvalho1
edee4b0b6b feat: Add get_block_storage_changes (#203)
* feat: add DCI message definitions

#time 4m

#time 2m

* fix: Make entrypoints into a HashSet instead of Vec

#time 0m

* fix: Rollback on message index change in ContractSlot

#time 5m

* feat: Add get_block_storage_changes

#time 34m


#time 0m

* Update substreams/crates/tycho-substreams/src/block_storage.rs

Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>

* Update substreams/crates/tycho-substreams/src/block_storage.rs

Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>

* fix: Filter out calls that are reverted and sort change by ordinal

#time 0m

* fix: Improve performance of get_block_storage_changes

We expect this util function to collect and handle a lot of information repeatedly (on every single block). So top performance optimisation (both memory and computation) is vital to minimise substream lags.

#time 6m

* fix: Use filter and flat_map instead of if and for loops

#time 1m

---------

Co-authored-by: Louise Poole <louise@datarevenue.com>
Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>
2025-05-14 09:18:07 +00:00
Zizou
e8bde64a23 fix: update tycho-substreams version in all vm packages (#206)
This is needed after https://github.com/propeller-heads/tycho-protocol-sdk/pull/201

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-14 10:57:22 +02:00
Zizou
62b178ad8f feat(curve): add coins in static attributes (#205)
* feat(curve): add coins in static attributes

This will be used by tycho-execution when executing swaps on the pool. It is needed because the `exchange` function takes token indexes and not addresses as input.

* style: make clippy happy with `format!`

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-13 18:57:06 +02:00
dianacarvalho1
2a77cf965c feat: Add entrypoint (#202)
* feat: add DCI message definitions


#time 4m

#time 0m

* feat: Add add_entrypoint to TransactionChangesBuilder

#time 15m


#time 0m

* fix: Make entrypoints into a HashSet instead of Vec

#time 0m

* fix: Rollback on message index change in ContractSlot

#time 5m

* fix: Ignore examples in docstrings when running cargo test

---------

Co-authored-by: Louise Poole <louise@datarevenue.com>
2025-05-13 11:31:36 +00:00
Zizou
52d502198e fix: stop using buggy account_creations for creation tagging. (#201)
the `call.account_creations` field had been deprecated by Substreams because of some edge cases where a new account wasn't detected.
This commit removes the usage of this field in our sdk contract extraction logic and some others specific places. We decided to rely on the call type instead. This approach should be much more robust.

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-13 12:25:14 +02:00
Louise Poole
ee41e63775 feat: Update uniswap v3 package to use big endian encoding (#199)
* feat: update uniswap v3 package to big endian encoding

* chore: update use of format macro to make clippy happy
2025-05-05 13:54:11 +00:00
Louise Poole
409cf15864 Revert "chore: update format! macro use to satisfy latest clippy version (#194)" (#196)
This reverts commit f29de67f1f.
2025-04-25 18:09:38 +02:00
Louise Poole
f29de67f1f chore: update format! macro use to satisfy latest clippy version (#194) 2025-04-25 15:13:01 +00:00
Zizou
63f9c89429 fix: small fix and refactor after testing EkuboV2 (#188)
* fix: add `balance_owner` attribute for ekubo_v2 components

* refactor: rename `ekubo` into `ekubo-v2`

* refactor: freeze `substreams-helper` version in ekubo V2 module

* docs: improve integration test comment

* docs: add TODO to remove `balance_owner` in favor of `AccountBalances`

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-27 13:45:03 +00:00
die-herdplatte
e4609bed0b Ekubo Integration (#172)
* fix: Implement ethereum-ekubo

* fix: Remove unnecessary store

* fix: Correct balance accounting

* Adjust deltas by fee at PositionUpdated event

* Add partial Ekubo integration

* Generalize Hexable

* Native Ekubo integration

* cargo fmt & clippy

---------

Co-authored-by: kayibal <alan@datarevenue.com>
Co-authored-by: Zizou <111426680+zizou0x@users.noreply.github.com>
2025-03-27 12:29:39 +01:00
Zizou
002d42d100 feat: add Uniswap V2 config for Unichain (#187)
* feat: add Uniswap V2 config for Unichain

* refactor: add URLs for Uniswap V2 config

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-27 10:38:29 +01:00
kayibal
0313c9b498 chore: Publish tycho-substreams to crates.io 2025-03-26 17:47:26 +01:00
Zizou
e0b2977417 feat: Add UniswapV3 config for Unichain (#184)
* feat: Add UniswapV3 config for Unichain

* refactor: add url in UniswapV3 configs

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-26 11:41:33 +01:00
Zizou
7ec5f0fb1f feat: add unichain config for uniswapv4 (#180)
* feat: add unichain config for uniswapv4

* refactor: remove `sf/substreams` from excluded proto.

This folder has been removed because it was not used, so we don't need to have it in the excluded paths anymore.

* refactor: add url into substreams config for uniswap v4 modules

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-25 16:47:55 +00:00
Louise Poole
aa378e6ef5 fix: handle token balances on add_contract_changes (#181) 2025-03-21 11:34:37 +02:00
Zizou
18d8969227 refactor: better attribute name for Pancakeswapv3 module (#179)
Also fixes an issue with inconsistent version tag between cargo and substreams files

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-19 11:50:01 +01:00