[easy] Missing tokens #2414
Merged
[easy] Missing tokens #2414
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Workflow run id 3823266010 approved. |
|
Workflow run id 3823266011 approved. |
Hosuke
approved these changes
Jan 3, 2023
|
lgtm, thanks! |
|
If you guys would have any chance to automize this process, we would highly appreciate it. :) |
jeff-dude
pushed a commit
to MSilb7/spellbook
that referenced
this pull request
Jan 9, 2023
jeff-dude
added a commit
that referenced
this pull request
Jan 10, 2023
* fix perp contract * update token generations & move files * mod aave sources * update erc20 schema * mod atoken sources * fix indent * aave sources alignment * update aave schema again * granary sources update * more schema updates * update ovm_optimism schema * mod aave schema * whoops - fix commas * fix commas * take - out of descriptions * fixes * expose OP erc20s as a separate detailed list * map op back to erc20 tokens * add standard to nft for op * update dbt project * add sided * Update contracts_optimism_contract_creator_address_list.sql * small * typo * Update tokens_optimism_schema.yml * adds * add dependency on snapshot * Fix dbt_project.yml * Update tokens_optimism_nft.sql * remove generated tokens for now * initialize without circular dependencies * update prices * update btc.b * forget snapshot * remove deps * aave chain insert * fix aave for loop * fix atokens select * simplify * alias * fix gran * fix gran note - granary initialized events are missing * comment out descriptor * erc20 schema * fix * Update tokens_optimism_erc20.sql * price dupe * update lists * nft list * fix unique nft * add attestation override * add mm swaps * Update tokens_optimism_nft.sql * add gysr * add nft * add erc20 * quix <> rh contract * stick * add type on atokens * add woofi * adds * Reformat aave_v3_tokens for compatibility * Fix typo * Add uniqueness test * Remove schema in config block * Reformat granary_tokens and compatibility for Trino * add token to prices * adds * add creator and update nft name * revert OaycNFT renaming * Apply CAST() to number_of_items and amount_raw * fix tofu_bnb schema * Add CAST() to fields * fix fee convention * Remove hardcoded fields from nft_trades * convert to hours (#2399) * [Easy] [Label] Implement trader platforms label (#2394) * Implemented trader platforms label * Fixed errors in spell * Added forgotten group by * Fixed columns selection * Added ordering and keeping of order for label * Fixed error in brackets * Added missing block_time column * Added time to keep order * [easy] new tokens (#2414) * Adding Aave V3 assets to tokens_avalanche_c_erc20.sql and tokens_polygon_erc20.sql (#2410) * add AAVE, EURS to arbitrum_erc20.sql * adding remaining aave v3 assets to erc20 * [CoW Protocol] Add Referral Mapping (#2377) * add referral table * remove duplicate anchor * remove unused subquery * Add Pancakeswap NFT Events (#2255) * add seed in yml file * Add Pancakeswap NFT V1 to nft trades * delete tofu * Adjust * update * update LOGIC * initial commit * update * Update models/pancakeswap/bnb/pancakeswap_bnb_nft_market_v1_event.sql Co-authored-by: 0xRob <83790096+0xRobin@users.noreply.github.com> * Update models/pancakeswap/bnb/pancakeswap_bnb_nft_market_v1_event.sql Co-authored-by: 0xRob <83790096+0xRobin@users.noreply.github.com> * add test * add * Update models/pancakeswap/bnb/pancakeswap_bnb_nft_market_v1_event.sql Co-authored-by: 0xRob <83790096+0xRobin@users.noreply.github.com> * delete liquidifty * add test file * . * update * fix unique ID * update sample file * change pancakeswap seed schema * temporary comment trade section * reinstate test and correct columns * change sample file * change seed file * add pancakeswap to nft trades * add royalty info * fix currency_symbol * guard fee logic * cast null as string * remove double column Co-authored-by: 0xRob <83790096+0xRobin@users.noreply.github.com> Co-authored-by: 0xRob <0xRobin5@gmail.com> * Migrate Balancer `vebal_slopes` abstraction (#2179) * Add balancer_vebal_slopes to schema yml file * Add veBAL related sources to sources yml file * Add balancer_vebal_slopes spell * Reorder sources * Change casting syntax * Rename datetime field from schema .yml file * Add incremental logic to vebal_slopes spell * Update models/balancer/ethereum/balancer_vebal_slopes.sql Co-authored-by: Huang Geyang <Sukebeta@outlook.com> * Update models/balancer/ethereum/balancer_vebal_slopes.sql Co-authored-by: Huang Geyang <Sukebeta@outlook.com> * Update models/balancer/ethereum/balancer_ethereum_schema.yml Co-authored-by: Huang Geyang <Sukebeta@outlook.com> * Update models/balancer/ethereum/balancer_vebal_slopes.sql Co-authored-by: Huang Geyang <Sukebeta@outlook.com> * Replace block_time unique key for block_number * Update models/balancer/ethereum/balancer_ethereum_schema.yml Co-authored-by: Huang Geyang <Sukebeta@outlook.com> * Update models/balancer/ethereum/balancer_vebal_slopes.sql Co-authored-by: Huang Geyang <Sukebeta@outlook.com> * Replace block_date for block_number in uniqueness test * Rewrite group by in full column names * Fix unmatched columns in schema.yml * add descriptions to vebal_slopes columns Co-authored-by: Huang Geyang <Sukebeta@outlook.com> Co-authored-by: Fábio Mendes <ms.fabiomendes@gmail.com> * Update cow_protocol_ethereum_referrals.sql (#2423) * Fix Source Chain ID/Name Hop Optimism (#2313) * Update hop_protocol_flows.sql * Revert "Update hop_protocol_flows.sql" This reverts commit be30148. * Update hop_protocol_optimism_flows.sql * Add BSC Dodo trades to dex.trades (#2157) * dodo-bnb-trades-real * add seed tests * seed value typo * remove depracated test * Modify dodo_bnb to aligh with dodo_eth in project.yml * combine cross-chain bnb & ethereum trades * correct ethereum dodo trades * downgrade 'dbt_utils' * Change back dbt_utils version to 0.9.2 * final tweaks * force failure * Remove extra line * correct seed file * restore deleted prices * minor formatting * cleanup dbt_project with latest standard * add freshness check Co-authored-by: Huang Geyang <Sukebeta@outlook.com> Co-authored-by: jeff-dude <jeff@dune.xyz> * script to find sources missing checks (#2401) * script to find sources missing checks + new freshness checks * T-22136: Missing ERC20 tokens (#2425) * add A LOT of missing tokens * sort + indentation * escape backtick * add missing comma * remove last comma * remove duplicate * add trim to symbol * remove trim, see if test pass * fixed trim Co-authored-by: jeff-dude <jeff@dune.xyz> * Update pull_request_template.md (#2429) * Update README.md (#2411) * T-23065 - optimism transfers: update value filter for string datatype (#2426) * update value filter for string datatype * directory cleanup * Seaport ethereum patch (#2419) * unifying seaport source * keep unique_trade_id for opensea.trades for nft.trades compatability * merge schema file * cast amount to decimal(38,0) * add test seeds * update schema.yml * Fix: minor typos (#2424) * Fix: minor typos Fix: minor typos * Fix: minor typo Fix: minor typo * Fix: minor typo Fix: minor typo * Fix: minor typo Fix: minor typo * [Quick] Updates to metadata files (#2421) * add new metadata * fix duplicate error Co-authored-by: cat <cat377550@gmail.com> * Added alphasharks.io as an aggregator (#2417) * Fix aave liquidation call (#2432) * FIX: cast to varchar in opensea_v3 trades (#2433) * cast to varchar in concat in view * define varchar length' * use batch api calls for price checker (#2431) * use batch api calls for price checker * Update dodo_ethereum_trades & add dodo_bnb_trades & split them to aggregator and pools (#2169) * update dodo_ethereum_trades && add dodo_bnb_trades * split dodo_trades to pools & aggregator on Ethereum and BNBChain * label different dodoV2 pools * fix schema & sql * add dodo_proxies on Ethereum * Modify dodo_bnb_trades to incremental view * Apply check_dex_seed and modify dodo_eth_trades to incremental view * Add DODO bnb trade seeds * Apply check_dex_seed to DODO bnb trades model * update dex_trade_seeds * fix * Add DODO bnb in project.yml * remove gitkeep in dodo * Update models/dodo/bnb/dodo_pools_bnb_trades.sql * Update check_dex_seed in dodo_ethereum_schema.yml * fix dodo_ethereum_schema * Remove schema in the config blocks * Add dodo_trades files by scoffie * add dppOracle & dppAdvanced to dodo_bnb * fix * update dbt_project on dodo * fix dodo_bnb_sources.yml * move cast to base model * update dex.trades seeds on DODO_BNBChain * final formatting & cleanup expose spell macro Co-authored-by: Huang Geyang <Sukebeta@outlook.com> Co-authored-by: jeff-dude <jeff@dune.xyz> * [CoW] Fix Fee USD Calculation (#2422) * use most natural form of fee computation when possible * add comment about imprecision * Fix failing tests (#2396) * trigger test * enable test in CI * defer in test * fix aragon * fix native token test * fix native mints unique id * fix nft trader labels * union all in nft labels * union all for performance * trigger wash_trades full refresh * fix cow protocol distinct labels * revert null wallet_address fix Co-authored-by: soispoke <66172107+soispoke@users.noreply.github.com> * Add ETH Transfers to L1 (#2440) * add eth transfers and small type fixes in op eth transfers * comment update * update schema * update transfer id * add tx to and from * add tx_to and tx_from * nit remove spaces Co-authored-by: soispoke <66172107+soispoke@users.noreply.github.com> * Token checker tweaks (#2437) * allow for case insensitive token symbol matching * adapt token checker error/warns * check for warning in test instead of error * Allow for local compile of incremental models. (#2403) * base is_incremental * add force-incremental variable * clean up dbt_project values * add version schema name * rename ovm directory * naming standards * keep optimism erc20 view name Co-authored-by: Huang Geyang <Sukebeta@outlook.com> Co-authored-by: 0xRob <0xRobin5@gmail.com> Co-authored-by: Belén Pruvost <belen@dune.com> Co-authored-by: Meghan Heintz <meghan@dune.com> Co-authored-by: Gent Rexha <gent@cow.fi> Co-authored-by: josojo <josojo@hotmail.de> Co-authored-by: mc <mattcole1093@gmail.com> Co-authored-by: Benjamin Smith <bh2smith@users.noreply.github.com> Co-authored-by: Harry <81097471+thb030100@users.noreply.github.com> Co-authored-by: 0xRob <83790096+0xRobin@users.noreply.github.com> Co-authored-by: Victor Stefenon <victorstefenon0@gmail.com> Co-authored-by: Fábio Mendes <ms.fabiomendes@gmail.com> Co-authored-by: soispoke <66172107+soispoke@users.noreply.github.com> Co-authored-by: Levis Kithinji <64379631+LeviScoffie@users.noreply.github.com> Co-authored-by: jeff-dude <jeff@dune.xyz> Co-authored-by: jeff-dude <102681548+jeff-dude@users.noreply.github.com> Co-authored-by: sohwak <59173567+sohwak@users.noreply.github.com> Co-authored-by: omahs <73983677+omahs@users.noreply.github.com> Co-authored-by: catherine-2 <95732099+catherine-2@users.noreply.github.com> Co-authored-by: cat <cat377550@gmail.com> Co-authored-by: Garv Maggu <17963209+GarvMaggu@users.noreply.github.com> Co-authored-by: Dias <dsalv@users.noreply.github.com> Co-authored-by: owen05 <owen05@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Similar to this PR: #2395
python -m src.missing_tokens
Execute on Network Network.MAINNET
Fetching V1 missing tokens for Network.MAINNET from https://dune.com/queries/1317323
2023-01-02 14:57:32,317 INFO dune_client.base_client waiting for query execution 01GNSCBVCZNDC755TMHVM131K9 to complete: ExecutionState.EXECUTING
Fetching V2 missing tokens for Network.MAINNET from https://dune.com/queries/1403073?Blockchain=ethereum
2023-01-02 14:57:37,913 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:57:43,049 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:57:48,204 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:57:53,340 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:57:58,615 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:03,747 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:08,896 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:14,043 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:19,178 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:24,329 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:29,466 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:34,615 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:39,753 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:45,145 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:50,306 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:58:55,453 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
2023-01-02 14:59:00,593 INFO dune_client.base_client waiting for query execution 01GNSCC0VVR206N1RKE78D1Z5H to complete: ExecutionState.EXECUTING
Found 30 missing tokens on V1 and 18 on V2. Fetching token details...
V1 results:
\x00E13FF16d54619024Ab3b861F25B84Bd53e8Ac1 CNLT 18
\x0263994554Ec08cc60473dbf8ceE60f9EedbF093 POWER 18
\x0283d310d682284EbC24DB33A41Bb5a01BDD140B BEEP 18
\x245186CaA063b13d0025891c0d513aCf552fB38E mooConvexCRV-ETH 18
\x2bb9867E3061353611E00f9af7197672aAB48a11 ANTIMA 9
\x3175Df0976dFA876431C2E9eE6Bc45b65d3473CC crvFRAX 18
\x3330BFb7332cA23cd071631837dC289B09C33333 RBC 18
\x3a95fFfEebDc113820e8B940254637c8477F59EF FSBF 18
\x45D74446748fB432F05E7a85bD974aBB7af5C285 WRAB 18
\x4fc424a840B5fB1BAf195963eC3737904440df1D mooConvexFraxUsdc 18
\x5465Af61733c7a930565C04e5b5B18cB0481c78e Yama 9
\x5767E329fB6c4678F54e667C9BaF695F3CF4c72a REDYD 9
\x5b3240B6BE3E7487d61cd1AFdFC7Fe4Fa1D81e64 DOLA BSP 18
\x777172D858dC1599914a1C4c6c9fC48c99a60990 SOLID 18
\x8013266cb5c9dd48bE3Ad7D1CE832874d64B3Ce1 BOOP 18
\x8e85e97ed19C0fa13B2549309965291fbbc0048b sfrxETH-stETH-rETH-BPT 18
\x8EE325AE3E54e83956eF2d5952d3C8Bc1fa6ec27 TYRANT 9
\x9ee91F9f426fA633d227f7a9b000E28b9dfd8599 stMATIC 18
\xb208b1a5664574F72d22E9e9981837310cACFeD6 SAKURA 9
\xb399511642FE1666c6a07f83483e6E4feAed9A00 SEURO 18
\xBa3335588D9403515223F109EdC4eB7269a9Ab5D GEAR 18
\xBA5DB223543a20972e7417B91323475b228dcEB3 SHI 18
\xBE1767BBE37Fd77A4b1b8d2dA86de39EA60f46Cb FOA 18
\xc97232527B62eFb0D8ed38CF3EA103A6CcA4037e lp-yCRV 18
\xD101dCC414F310268c37eEb4cD376CcFA507F571 RSC 18
\xd395DEC4F1733ff09b750D869eEfa7E0D37C3eE6 yvCurve-DOLA-FRAXBP-U 18
\xd4Df22556e07148e591B4c7b4f555a17188CF5cF TWT 9
\xe50e2fe90745A8510491F89113959a1EF01AD400 mooConvexTriCrypto 18
\xE57180685E3348589E9521aa53Af0BCD497E884d DOLAFRAXBP3CRV-f 18
\xFFC97d72E13E01096502Cb8Eb52dEe56f74DAD7B aAAVE 18
V2 results:
('0x00e13ff16d54619024ab3b861f25b84bd53e8ac1', 'CNLT', 18),
('0x0263994554ec08cc60473dbf8cee60f9eedbf093', 'POWER', 18),
('0x0283d310d682284ebc24db33a41bb5a01bdd140b', 'BEEP', 18),
('0x245186caa063b13d0025891c0d513acf552fb38e', 'mooConvexCRV-ETH', 18),
('0x3330bfb7332ca23cd071631837dc289b09c33333', 'RBC', 18),
('0x3a95fffeebdc113820e8b940254637c8477f59ef', 'FSBF', 18),
('0x4fc424a840b5fb1baf195963ec3737904440df1d', 'mooConvexFraxUsdc', 18),
('0x5465af61733c7a930565c04e5b5b18cb0481c78e', 'Yama', 9),
('0x5767e329fb6c4678f54e667c9baf695f3cf4c72a', 'REDYD', 9),
('0x777172d858dc1599914a1c4c6c9fc48c99a60990', 'SOLID', 18),
('0x8013266cb5c9dd48be3ad7d1ce832874d64b3ce1', 'BOOP', 18),
('0x8e85e97ed19c0fa13b2549309965291fbbc0048b', 'sfrxETH-stETH-rETH-BPT', 18),
('0xba3335588d9403515223f109edc4eb7269a9ab5d', 'GEAR', 18),
('0xba5db223543a20972e7417b91323475b228dceb3', 'SHI', 18),
('0xc97232527b62efb0d8ed38cf3ea103a6cca4037e', 'lp-yCRV', 18),
('0xd395dec4f1733ff09b750d869eefa7e0d37c3ee6', 'yvCurve-DOLA-FRAXBP-U', 18),
('0xe50e2fe90745a8510491f89113959a1ef01ad400', 'mooConvexTriCrypto', 18),
('0xffc97d72e13e01096502cb8eb52dee56f74dad7b', 'aAAVE', 18),
Execute on Network Network.GNOSIS
Fetching V1 missing tokens for Network.GNOSIS from https://dune.com/queries/1403053
2023-01-02 14:59:20,604 INFO dune_client.base_client waiting for query execution 01GNSCF5584RCBDK0R7EZV7C39 to complete: ExecutionState.EXECUTING
Fetching V2 missing tokens for Network.GNOSIS from https://dune.com/queries/1403073?Blockchain=gnosis
2023-01-02 14:59:26,174 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 14:59:31,333 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 14:59:36,468 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 14:59:41,602 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 14:59:46,748 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 14:59:51,891 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 14:59:57,030 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:02,450 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:07,598 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:12,740 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:17,887 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:23,027 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:28,171 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:33,315 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
2023-01-02 15:00:38,458 INFO dune_client.base_client waiting for query execution 01GNSCFAJXDJ4Z9HNKTB86FJ5V to complete: ExecutionState.EXECUTING
Found 2 missing tokens on V1 and 2 on V2. Fetching token details...
V1 results:
('BER', 18, decode('05698e7346Ea67Cfb088f64Ad8962B18137d17c0', 'hex')),
('FCL', 18, decode('e68856eb29B2FB39699286CcA7F10f90Ce8AE9De', 'hex')),
V2 results:
('0x05698e7346ea67cfb088f64ad8962b18137d17c0', 'BER', 18),
('0xe68856eb29b2fb39699286cca7f10f90ce8ae9de', 'FCL', 18),