284 Commits

Author SHA1 Message Date
dianacarvalho1
a7841af383 feat: Add entrypoint utils and define EntryPointParams (#211)
* feat: Add entrypoint utils and define EntryPointParams

#time 23m


#time 0m

* fix: Make TraceData mandatory

#time 2m

* fix: Make component_id in EntryPointParams optional

#time 1m
2025-05-20 17:47:25 +01:00
zizou
7e73061f8e chore: add repository URL to substreams.yaml for ethereum_balancer_v2 2025-05-19 13:49:34 +02:00
Louise Poole
c778e7dee2 feat: extend DCI message structs (#210)
* feat: extend DCI message structs

* chore: add entrypoint params placeholder to transaction builder

* fix: rename call_data as calldata
2025-05-16 11:04:55 +02:00
Louise Poole
b13360c92b fix: change Entrypoint signature type to string (#209) 2025-05-14 15:42:44 +02:00
Zizou
43764fa5cb refactor: update test config to include coins (#208)
* refactor: update test config to include `coins`

* refactor: rename package to `ethereum_curve` and add repository URL in substreams.yaml

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-14 12:37:12 +02:00
dianacarvalho1
edee4b0b6b feat: Add get_block_storage_changes (#203)
* feat: add DCI message definitions

#time 4m

#time 2m

* fix: Make entrypoints into a HashSet instead of Vec

#time 0m

* fix: Rollback on message index change in ContractSlot

#time 5m

* feat: Add get_block_storage_changes

#time 34m


#time 0m

* Update substreams/crates/tycho-substreams/src/block_storage.rs

Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>

* Update substreams/crates/tycho-substreams/src/block_storage.rs

Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>

* fix: Filter out calls that are reverted and sort change by ordinal

#time 0m

* fix: Improve performance of get_block_storage_changes

We expect this util function to collect and handle a lot of information repeatedly (on every single block). So top performance optimisation (both memory and computation) is vital to minimise substream lags.

#time 6m

* fix: Use filter and flat_map instead of if and for loops

#time 1m

---------

Co-authored-by: Louise Poole <louise@datarevenue.com>
Co-authored-by: Louise Poole <louisecarmenpoole@gmail.com>
2025-05-14 09:18:07 +00:00
Zizou
e8bde64a23 fix: update tycho-substreams version in all vm packages (#206)
This is needed after https://github.com/propeller-heads/tycho-protocol-sdk/pull/201

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-14 10:57:22 +02:00
Zizou
62b178ad8f feat(curve): add coins in static attributes (#205)
* feat(curve): add coins in static attributes

This will be used by tycho-execution when executing swaps on the pool. It is needed because the `exchange` function takes token indexes and not addresses as input.

* style: make clippy happy with `format!`

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-13 18:57:06 +02:00
dianacarvalho1
2a77cf965c feat: Add entrypoint (#202)
* feat: add DCI message definitions


#time 4m

#time 0m

* feat: Add add_entrypoint to TransactionChangesBuilder

#time 15m


#time 0m

* fix: Make entrypoints into a HashSet instead of Vec

#time 0m

* fix: Rollback on message index change in ContractSlot

#time 5m

* fix: Ignore examples in docstrings when running cargo test

---------

Co-authored-by: Louise Poole <louise@datarevenue.com>
2025-05-13 11:31:36 +00:00
Zizou
52d502198e fix: stop using buggy account_creations for creation tagging. (#201)
the `call.account_creations` field had been deprecated by Substreams because of some edge cases where a new account wasn't detected.
This commit removes the usage of this field in our sdk contract extraction logic and some others specific places. We decided to rely on the call type instead. This approach should be much more robust.

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-05-13 12:25:14 +02:00
Louise Poole
ee41e63775 feat: Update uniswap v3 package to use big endian encoding (#199)
* feat: update uniswap v3 package to big endian encoding

* chore: update use of format macro to make clippy happy
2025-05-05 13:54:11 +00:00
Louise Poole
409cf15864 Revert "chore: update format! macro use to satisfy latest clippy version (#194)" (#196)
This reverts commit f29de67f1f.
2025-04-25 18:09:38 +02:00
Louise Poole
f29de67f1f chore: update format! macro use to satisfy latest clippy version (#194) 2025-04-25 15:13:01 +00:00
Zizou
63f9c89429 fix: small fix and refactor after testing EkuboV2 (#188)
* fix: add `balance_owner` attribute for ekubo_v2 components

* refactor: rename `ekubo` into `ekubo-v2`

* refactor: freeze `substreams-helper` version in ekubo V2 module

* docs: improve integration test comment

* docs: add TODO to remove `balance_owner` in favor of `AccountBalances`

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-27 13:45:03 +00:00
die-herdplatte
e4609bed0b Ekubo Integration (#172)
* fix: Implement ethereum-ekubo

* fix: Remove unnecessary store

* fix: Correct balance accounting

* Adjust deltas by fee at PositionUpdated event

* Add partial Ekubo integration

* Generalize Hexable

* Native Ekubo integration

* cargo fmt & clippy

---------

Co-authored-by: kayibal <alan@datarevenue.com>
Co-authored-by: Zizou <111426680+zizou0x@users.noreply.github.com>
2025-03-27 12:29:39 +01:00
Zizou
002d42d100 feat: add Uniswap V2 config for Unichain (#187)
* feat: add Uniswap V2 config for Unichain

* refactor: add URLs for Uniswap V2 config

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-27 10:38:29 +01:00
kayibal
0313c9b498 chore: Publish tycho-substreams to crates.io 2025-03-26 17:47:26 +01:00
Zizou
e0b2977417 feat: Add UniswapV3 config for Unichain (#184)
* feat: Add UniswapV3 config for Unichain

* refactor: add url in UniswapV3 configs

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-26 11:41:33 +01:00
Zizou
7ec5f0fb1f feat: add unichain config for uniswapv4 (#180)
* feat: add unichain config for uniswapv4

* refactor: remove `sf/substreams` from excluded proto.

This folder has been removed because it was not used, so we don't need to have it in the excluded paths anymore.

* refactor: add url into substreams config for uniswap v4 modules

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-25 16:47:55 +00:00
Louise Poole
aa378e6ef5 fix: handle token balances on add_contract_changes (#181) 2025-03-21 11:34:37 +02:00
Zizou
18d8969227 refactor: better attribute name for Pancakeswapv3 module (#179)
Also fixes an issue with inconsistent version tag between cargo and substreams files

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-19 11:50:01 +01:00
Zizou
4c1e773b1b feat: add Pancakeswap v3 Substreams module (#178)
* feat: Add Pancakeswap V3 Substreams module

At this point it's just hard copy of Uniswap V3. It will be adapted in the following commits to make reviewing easier.

* refactor: adapt uniswapv3 module logic for pancakeswap v3

The main change is how they handle protocol fees. Protocol fees are set by default depending on the fee of the pool.

* refactor: use new protobuf structs

The "EntityChanges" got deprecated in favor of the hybrid messages. This commit makes PancakeswapV3 module use the new structs.

* fix: set correct factory address

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
Co-authored-by: Louise Poole <louise@datarevenue.com>
2025-03-17 14:39:05 +02:00
Zizou
503a83595e refactor: remove unnecessary clones in UniswapV3 module (#177)
Also fixes a bug that would lead to emitting wrong balances if there is a `CollectProtocol` event triggered (currently not affecting because it's not enabled)

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-03-13 15:24:48 +01:00
Louise Poole
a61be78007 docs: improve initialized_accounts docs (#175)
* docs: improve initialized_accounts docs

* docs: improve initialized_accounts docs
2025-03-11 12:45:02 +00:00
Louise Poole
ae10195bca chore: remove unused substreams protobuf files (#171) 2025-03-06 12:07:29 +02:00
Louise Poole
f13c1c263b refactor(uniswap_v4): remove costly clone calls (#169)
* Removed costly `TransactionTrace` clones calls and `.clone()` at a few other places

* style: formatting

* chore: bump uniswap v4 versions to 0.2.1

* fix: fix double referencing

---------

Co-authored-by: Matthieu Vachon <matt@streamingfast.io>
2025-03-04 14:51:13 +00:00
Louise Poole
04d14db719 feat: publicly expose protobuf module (#170) 2025-03-04 16:48:14 +02:00
Louise Poole
20165c271e feat: move initial lp fee to static attributes (#161)
This initial lp fee value is used for generating the PoolKey. It is static and should be part of the ProtocolComponent static attributes.
2025-02-18 15:01:38 +02:00
Zizou
b1e7ba9e2f refactor(substreams): add rust-toolchain to the templates and modules. (#155)
* refactor(substreams): add `rust-toolchain` to the templates and modules.

This freezes the wasm output for each module, allowing us to have full control over each packages and when we break the modules hashes.

* fix(testing): allow no `initialized_accounts` in tests

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-02-17 08:29:07 +00:00
Zizou
6da2141f66 chore(substreams): add base Uniswap v4 config (#157)
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-02-13 14:44:17 +01:00
kayibal
a7e1dd9397 Use tycho-substreams erc20 abi. 2025-02-06 11:04:39 -06:00
kayibal
7302989617 Use manual updates on singleton template. 2025-02-06 11:04:39 -06:00
kayibal
22f70ca110 formatting & lints 2025-02-06 11:04:39 -06:00
kayibal
5eb08acf82 Update docs 2025-02-06 11:04:39 -06:00
kayibal
08d2c7a82e feat(template): Add template for singleton protocols.
Separate templates and add one for protocols with only a single contract.
2025-02-06 11:04:39 -06:00
kayibal
d0e73a20ea feat(template): More detailed template.
Add a more detailed protocol implementation in the template. This should allow more ppl to get started quicker. Additionally more people will follow a predetermined structure
2025-02-06 11:04:39 -06:00
tvinagre
4eea400af5 docs: remove local testing docs and point to web docs (#151) 2025-02-06 16:16:13 +00:00
Zizou
dceea46655 fmt(substreams): update auto generated files (#150)
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-02-06 17:13:25 +01:00
tvinagre
dbb79a6dca feat(testing): Improve SDK Testing module (#148)
* feat: import to tycho simulation initialized accounts defined on yaml file

* feat: update tycho-simulation dep, black formatting

* feat: Add additional logging to test runner

* feat: Fail test if expected component fails to get decoded

* feat: Warn if initialized contracts are not specified on ProtocolComponent contracts
2025-02-05 15:48:45 -03:00
tvinagre
af8643ecb4 feat: Implement UniswapV4 Native integration (#125)
* feat: initial data structure + ABI & buf models

* feat: initial modules: identify new pools and events

* feat: map liquidity and balance changes, introduce balance delta calculation from liquidity

* feat: map tick deltas

* chore: undo weird formatting

* chore: undo weird formatting

* feat: map fee changes and aggregate data to final block structure

* feat: reimplement math natively, remove alloy and univ3sdk dependencies

* chore: make clippy happy + misc improvements

* chore: add rust generated files from buf & ABI

* chore: make clippy happy

* feat: add all modules to ethereum-uniswap-v4.yaml

* chore: update yaml file to skip unnecessary buf paths

* fix: update pb mod.rs

* fix: fix hex / utf-8 encoding. working version

* fix: simplify error handling, rename yaml file to match chain & formatting

* fix: fix ChangeType for sqrt_price_x96 on Initialization

* fix: make fee a non-static attribute

* fix: add balance_owner to univ4 pool

* feat: add uniswap-v4 mainnet yaml

* fix(uniswap-v4): miscellaneous fixes for UniswapV4 (#147)

* fix(uniswap-v4): correctly decode swap event deltas.

Deltas are given from a user debt perspective by the event (negative if received by the pool, positive if sent by the pool). In our usecase we need the opposite of this. This commit uses `.neg()` on the amount to apply them correctly.

* fix(uniswap-v4): correctly compute token amounts.

We were using `get_sqrt_ratio_at_tick` at the current tick to compute the amounts. This was incorrect because it provides the price at the tick boundary, but we might be mid-tick, which could lead to erroneous balances.

We now track the current price (updated by `initialization` and `swap` events) and use it when calculating the amounts.

* fix(uniswapv4): do not account for fees in swaps.

Previously we were adding fees as balances. But they are actually not part of the TVL and we aren't accounting for fees in the position changes (withdrawals). This commit addresses this and remove the fees from the token balances.

* refactor: fix pb mod.rs

* refactor: bump version and update sepolia config

* ci: make clippy happy

* refactor: clean unimath tests

* refactor: make logic clearer and improve docstrings

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>

---------

Co-authored-by: Zizou <111426680+zizou0x@users.noreply.github.com>
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-02-05 14:19:09 +01:00
tvinagre
53ae0729ed feat: add uniswap-v3 Base yaml config (#145)
feat: add uniswap-v3 Base yaml config
2025-01-31 11:54:58 -03:00
Louise Poole
3c08359cf1 fix: allow setting of tokens balances on InterimContractChanges (#139) 2025-01-27 16:06:19 +02:00
Louise Poole
ad0a391f72 chore: clean up ambient (#136)
* fix: remove unnecessary tx field in ProtocolComponent

* chore: move ambient protobuf files to ambient module

* chore: remove dependency on common message types

This allows us to isolate the ambient specific messages within the ambient module

* feat: update ambient substream with new message structs

* chore: update substream configs

And remove use of deprecated BlockContractChanges.

* feat: implement From for AmbientProtocolComponent to ProtocolComponent
2025-01-27 10:36:13 +02:00
Louise Poole
28dd2fc858 feat: add AccountBalanceChange proto message (#137) 2025-01-23 11:00:12 +02:00
Thales
53f764972d docs: update substreams Readme.md 2025-01-22 23:15:19 -03:00
Zizou
1400fd413a refactor(substreams): reexport ABIs in tycho-substreams (#138)
Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-01-22 14:26:49 +00:00
Zizou
28c3bb9640 feat(base): add base uniswapv2 spkg (#134)
* feat(base): add base uniswapv2 Substreams spkg

* refactor: fix outdated spkg version for every uniswap v2 packages

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-01-21 15:09:27 +01:00
Louise Poole
ffd6da916a docs: improve testing docs (#133) 2025-01-16 15:49:46 +02:00
Zizou
98c63c685f refactor: stop using private pypi (#132)
* refactor: stop using private pypi

This was required because our repos were not public. Now that they are, people can directly access our Python packages and therefore they don't need access to our private codeartifact anymore

* docs: add a list of dependencies in the readme and early check in the setup env script

---------

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-01-16 09:07:57 +00:00
Zizou
5f319a6875 refactor: ensure consistent ABI iteration order in build files (#131)
Previously, build files iterated through ABIs in an inconsistent order, causing unwanted changes when the build was rerun, as the iteration order would differ. This commit resolves the issue by sorting ABIs by name, ensuring consistent formatting and preventing unintended changes in future commits.

Co-authored-by: zizou <111426680+flopell@users.noreply.github.com>
2025-01-10 11:45:14 +01:00