Skip to content

osmoutils/v0.0.11

@p0mvn p0mvn tagged this 08 Apr 20:34
Closes: #XXX

## What is the purpose of the change

This PR implements ADR-006 stage:
https://www.notion.so/osmosiszone/ADR-006-Streaming-GRPC-SQS-Ingest-4e3b2ff7d23e43e2a1f3c43adc3c26bc

It entails removing Redis as a dependency and pushing updates to SQS via GRPC.

As part of this change, `poolIngester` abstraction was renamed to `poolTransformer` because it does not ingest data into Redis anymore. Rather, it only performs data transformations on pools by instrumenting TVL data. The new name reflects this.

Config was also updated, replacing Redis parameters with GRPC.

This is a PR SQS side: https://github.com/osmosis-labs/sqs/pull/153

## Testing and Verifying

The integration with SQS had been extensively tested on mainnet.

- Pools testing comparison with TFM: https://github.com/osmosis-labs/infrastructure/actions/runs/8549394756/job/23424633198

## Documentation and Release Note

  - [ ] Does this pull request introduce a new feature or user-facing behavior changes?
  - [ ] Changelog entry added to `Unreleased` section of `CHANGELOG.md`?

Where is the change documented?
  - [ ] Specification (`x/{module}/README.md`)
  - [ ] Osmosis documentation site
  - [ ] Code comments?
  - [ ] N/A



## Summary by CodeRabbit

- **New Features**
	- Added telemetry metrics for block processing and gRPC connection errors.
	- Introduced a new time operation to measure block processing duration.
- **Refactor**
	- Updated sidecar query server storage configuration to support gRPC service settings.
	- Refactored data ingestion to utilize new interfaces and structures, enhancing the integration with gRPC services.
	- Renamed and updated various components and methods for clarity and improved functionality, focusing on data transformation and gRPC client interactions.
- **Chores**
	- Updated import paths and method signatures across multiple files for consistency and maintainability.
Assets 2
Loading