chore(release): v2.1.0-beta

[shamardy]

Features:

• Seed Management #1939
  • Seed generation, encryption, and storage features were introduced, including a new get_mnemonic API. #2014
• A new sign_raw_transaction rpc was added for UTXO and EVM coins, this will facilitate air-gapped wallet implementation in the future. #1930

Enhancements/Fixes:

• Event Streaming #1901
  • Balance event streaming for Electrum clients was implemented. #2013
    • Balance events for UTXOs were introduced.
    • Electrum notification receiving bug was fixed.
  • Balance event streaming for EVM was added. #2041
  • Error events were introduced. #2041
  • Heartbeats were introduced to notify about streaming channel health. #2058
  • Balance event streaming for ARRR/Pirate was added. #2076
• Trading Protocol Upgrade #1895
  • Important note: Seednodes update is needed to support and rebroadcast new swap protocol messages. #2015
  • WASM storage for upgraded swaps introduced. #2015
  • Migration of old swaps data was added. #2015
  • Swaps now automatically kickstart on MM2 reload. #2015
  • File lock for swaps added, preventing the same swap from starting in different processes. #2015
  • my_swap_status, my_recent_swaps V2 RPCs introduced. #2015
  • Upgraded swaps data now accessible through V1 RPCs. #2015
  • Locked amount handling for UTXO swaps implemented. #2046
  • Conditional wait for maker payment confirmation was added before signing funding tx spend preimage on taker's side. #2046
  • active_swaps V2 RPC introduced. #2046
  • Handling accept_only_from for swap messages (validation of the sender) was implemented. #2046
  • swap_uuid for swap v2 messages was added to avoid reuse of the messages generated for other swaps. #2046
  • Maker payment immediate refund path handling was implemented. #2046
• KMD Burn #2010
  • KMD dex fee burn for upgraded swaps was added. #2046
• Hardware Wallet #964
  • Trezor now supports SegWit for withdrawals. #1984
  • Trezor support was added for EVM coins/tokens using task manager activation methods. #1962
  • Support for unsigned Tendermint transactions using Ledger's Keplr extension was added, excluding HTLC transactions and swap operations. #2148
• NFT integration #900
  • A new clear_nft_db RPC for NFT data management was added. This enables selective (based on a chain) or complete NFT DB data clearance. #2039
  • NFT can now be enabled using enable_eth_with_tokens or enable_nft, similar to enable_erc20. #2049
  • NFT swaps V2 POC was shown, which includes a NFT maker payment test using the dockerized Geth dev node. #2084
  • komodo-defi-proxy support for NFT feature was added. #2100
  • Additional checks were added for malicious token_uri links. #2100
  • clear_all parameter in clear_nft_db RPC is now optional (default: false). #2100
• WASM Worker
  • Improved environment detection to ensure the correct method is used for accessing the IndexedDB factory, accommodating both window and worker contexts. #1953, #2131
  • SharedWorker support was added, allowing any worker path in event_stream_configuration with a default to event_streaming_worker.js. #2080
• Simple Maker Bot #1065
  • Maker bot was updated to support multiple price URLs. #2027
  • testcoin was added to provider options to allow testing the maker bot using test chains assets. #2161
• IndexedDB
  • Cursor implementation was fixed, ensuring stable iteration over items. #2028
  • Advanced cursor filtering features were added, including limit, offset, and a fix for where_ condition/option. #2066
• Swap Stats DB
  • stats_swaps table now includes GUI and MM2 version data used for a swap. #2061
• P2P Layer
  • Added max_concurrent_connections to MM2 config to control the maximum number of concurrent connections for Gossipsub. #2063
• ARRR/Pirate #927
  • ARRR/Pirate wallet and Dex operations now work in browser environments / WASM. #1957, #2077
  • Syncing and activation improvements were made, including stopping sync status after main sync and refining first_sync_block handling. #2089
• EVM Transport
  • ETH websocket transport was introduced. komodo-defi-proxy signed messages were also supported for websocket transport. #2058
• Tendermint integration #1432
  • Nucleus chain support was introduced as an alternative HTLC backend to Iris. #2079
  • Tendermint fee calculation was fixed to use get_receiver_trade_fee in platform coin. #2106
  • Pubkey-only mode for Tendermint protocol was introduced, allowing use of any external wallet for wallet and swap operations. #2088
  • ibc_withdraw RPC was removed, and withdraw was refactored to support IBC transfers by automatically finding IBC channels. #2088
  • Transaction history handling was enhanced to support base64 encoded transaction values for Cosmos-based networks, preventing missing transactions in the history table. #2133
  • The precision of max amount handling was improved for Tendermint withdraw operations by simulating the transaction and removing the estimated fee. #2155
  • Account sequence numbers are now resolved locally, incorrect sequence numbers from cached responses are also avoided. #2164
• HD Wallet #1838
  • Full UTXO and EVM HD wallet functionalities were implemented. #1962
• Swap watchers #1431
  • UTXO swaps were fixed to apply events that occurred while the taker was offline, such as maker spending or watcher refunding the taker payment. #2114
• Fees Improvements #1848
  • EIP-1559 gas fee estimator and RPCs were added for ETH, including priority fee support for withdrawals and swaps, and improved gas limit for swap transactions. #2051
  • gas_limit parameter can be used in coins config to override default gas limit values. #2137
  • Default gas_limit values now ensure that Proxied ERC20 tokens have sufficient gas. #2137
• Rust Toolchain #1972
  • Toolchain was upgraded to Rust toolchain version 1.72 nightly (nightly-2023-06-01). #2149
  • rust-analyzer was added into the workspace toolchain. #2179
• CI Builds
  • MacOS builds for Apple Silicon are now provided through the CI pipeline. #2163
• Miscellaneous
  • BCH block header deserialization was fixed to match BTC's handling of KAWPOW version headers. #2099
  • Implemented root application directory .kdf under $HOME to consolidate all runtime files, enhancing user experience by following standard UNIX practices. #2102
  • Memory usage was improved a bit through preallocation optimizations. #2098
  • Swaps and orders file handling was enhanced to use .tmp files to avoid concurrent reading/writing issues. #2118
  • UTXO P2PK balance is now shown as part of the P2PKH/Legacy address balance and can be spent in withdrawals and swaps. #2053
  • wallet-only restriction was removed from max_maker_vol RPC, enabling its use for wallet-only mode assets. #2153

NB - Backwards compatibility breaking changes:

• Renamed mm2 binaries to kdf, while providing backward-compatible copies with mm2 naming; WASM binaries use kdf naming only, which is a breaking change. #2126

[cipig]

What effects does the DB changes have? If seed nodes don't save JSON files of swaps any more, then i can't use this on my seeds, else i will destroy all stats.
What about the "normal" maker nodes? will updating those will have an effect on swap JSON files on the seeds?

Other question: is there a way to tell mm2 to continue saving swap infos in files, like with a startup param?
That would help a lot, since i have other workflows that require the presence of those files, eg failed swap recovering.

[shamardy]

What effects does the DB changes have? If seed nodes don't save JSON files of swaps any more, then i can't use this on my seeds, else i will destroy all stats.
What about the "normal" maker nodes? will updating those will have an effect on swap JSON files on the seeds?

JSON files are not used for v2 swaps only which to be activated currently "use_trading_proto_v2": true has to be added to MM2.conf

Other question: is there a way to tell mm2 to continue saving swap infos in files, like with a startup param?
That would help a lot, since i have other workflows that require the presence of those files, eg failed swap recovering.

We can look into that for v2 swaps before activating it or you can use my_swap_status to get the data and save it in files yourself (adding another workflow).

[cipig]

so for v1 swaps, nothing changes? the files will still be there on makers and seeds?

i use the files on the seeds to add the swaps to MySQL which feeds different things

and on the makers i need them to refund... i need to call this manually from time to time

## maker
for i in `grep -l '"type":"MakerPaymentRefundFailed"' DB/*/SWAPS/MY/* | cut -d "/" -f 5 | cut -d "." -f 1`; do echo $i && curl -s --url "http://127.0.0.1:7783" --data "{\"userpass\":\"$userpass\",\"method\":\"recover_funds_of_swap\",\"params\":{\"uuid\":\"$i\"}}" | json_pp; done
for i in `grep -l '"type":"TakerPaymentSpendFailed"' DB/*/SWAPS/MY/* | cut -d "/" -f 5 | cut -d "." -f 1`; do echo $i && curl -s --url "http://127.0.0.1:7783" --data "{\"userpass\":\"$userpass\",\"method\":\"recover_funds_of_swap\",\"params\":{\"uuid\":\"$i\"}}" | json_pp; done

it looks in all files for "MakerPaymentRefundFailed" and "TakerPaymentSpendFailed" and calls recover_funds_of_swap with the uuid. this is needed because the automatic refund sometimes fails with "non-final" error, so only a manual call will refund those swaps

btw, what will we do with the users whose swap files need to be manually edited before refund? will it be possible to edit the stuff in the DB?

[shamardy]

and on the makers i need them to refund... i need to call this manually from time to time

## maker
for i in `grep -l '"type":"MakerPaymentRefundFailed"' DB/*/SWAPS/MY/* | cut -d "/" -f 5 | cut -d "." -f 1`; do echo $i && curl > -s --url "http://127.0.0.1:7783" --data "{\"userpass\":\"$userpass\",\"method\":\"recover_funds_of_swap\",\"params\":{\"uuid\":\"$i\"}}" | json_pp; done
for i in `grep -l '"type":"TakerPaymentSpendFailed"' DB/*/SWAPS/MY/* | cut -d "/" -f 5 | cut -d "." -f 1`; do echo $i && curl -s --url "http://127.0.0.1:7783" --data "{\"userpass\":\"$userpass\",\"method\":\"recover_funds_of_swap\",\"params\":{\"uuid\":\"$i\"}}" | json_pp; done

it looks in all files for "MakerPaymentRefundFailed" and "TakerPaymentSpendFailed" and calls recover_funds_of_swap with the uuid. this is needed because the automatic refund sometimes fails with "non-final" error, so only a manual call will refund those swaps

Sorry for the late response @cipig, For v2, you can call my_recent_swaps and do the same.

btw, what will we do with the users whose swap files need to be manually edited before refund? will it be possible to edit the stuff in the DB?

Will add it to the trading protocol upgrade checklist #1895 (comment) Maybe we can add an rpc to let you edit swap data / events in DB. We shouldn't need to manually edit swap data but sometimes it's inevitable.

[cipig]

Sorry for the late response @cipig, For v2, you can call my_recent_swaps and do the same.

Only if my_recent_swaps contain the error messages/events that happened during the swap. I search for MakerPaymentRefundFailed and TakerPaymentSpendFailed in the JSONs and then call recover_funds_of_swap for all swap uuids that had this errors. I can't do that for all swaps, that would be way too much.

[shamardy]

Only if my_recent_swaps contain the error messages/events that happened during the swap

It does for both v1 and v2 swaps https://komodoplatform.com/en/docs/komodo-defi-framework/api/legacy/my_recent_swaps/#response-success , we can even add filters for specific events in the future to make life easier.

[smk762]

No critical defects found in testing. Docs updates in progress, should be aligned by end of week