[Indexer] Optimize indexer like query to ensure all querys can use indexes

[baichuan3]

Summary

Optimize indexer to ensure all querys can use indexes.

1. Convert SQLite like query to Between And query, optimize table scan to index scan, and only take effect on the rightmost prefix.
2. Adjust the index to support all queries can be index scan, not trigger a table scan.
3. Support indexer metrics, statistics on indexer query time and write time cost.

Notice：

This operation requires rebuilding the index when the server is restarted, and the server will be unavailable during the index rebuild.

• Closes [Metrics] SQLite Metrics #2144

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
rooch-portal	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Aug 3, 2024 0:33am

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
rooch	⬜️ Ignored (Inspect)	Visit Preview		Aug 3, 2024 0:33am

[baichuan3]

testnet indexer file size

du -sh *
21G    events
32K    events-shm
4.1M    events-wal
23G    object_states
3.9M    object_states-shm
2.0G    object_states-wal
4.2G    transactions
32K    transactions-shm
4.0M    transactions-wal

SQLite explain query plan

sqlite>
explain query plan select * from object_states  where owner="1" and object_type not like '0x1::0x111%';
QUERY PLAN
`--SEARCH object_states USING INDEX idx_object_states_owner_and_object_type (owner=?)

sqlite>
explain query plan select * from object_states  where owner="1" and object_type >= '0x1::0x111' and object_type < "0x0";
QUERY PLAN
`--SEARCH object_states USING INDEX idx_object_states_owner_and_object_type (owner=? AND object_type>? AND object_type<?)

sqlite>
explain query plan select * from object_states  where  object_type >= "0x1::0x111" and object_type < "0x01::0x2";
QUERY PLAN
`--SEARCH object_states USING INDEX idx_object_states_object_type (object_type>? AND object_type<?)

[github-actions]

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

OpenSSF Scorecard

Package	Version	Score	Details

Scanned Manifest Files

[jolestar]

原来 indexer 的 like 有个 bug，比如搜索 0xabcd::test::Account, 期望是得到 Account 以及 Account, 但同时会搜索出来 0xabcd::test::AccountABC。这个问题现在这个方案还有吧？