Skip to content

Latest commit

 

History

History
56 lines (47 loc) · 1.37 KB

README.md

File metadata and controls

56 lines (47 loc) · 1.37 KB
Raw

Episode 009: Pulsar performance tuning

  • Hosted by Penghui Li
  • Recorded on 04/12/2020

Table of Content

  • 00:00:00 - Introduction
  • 00:12:20 - Basic concepts
  • 00:30:00 - Writing
  • 01:10:00 - Reading

Show Notes

  • Overview

    • 2.5.1 RC
    • PIP - 61 Advertised multiple addresses
    • PIP - 62 Move connectors, adapters and Pulsar Presto to separate repositories

  • Basic concepts

  • Message writing

    • Producer
      • Batch message
      • Compression
      • Pending queue
    • Broker
      • Persistence(E, Qw, Qa)
      • Bookie client ioNumThreads
      • Managed ledger worker threads
      • Broker ioNumThreads
    • Bookie
      • Journal and Ledger directories
      • Journal Sync Data
      • Journal group commit
      • Add worker threads and max pending add requests
      • DBStorage write cache
      • journalPageCacheFlushIntervalMSec(*)

  • Message reading

    • Consumer
      • Receive queue size
    • Broker
      • Managed ledger cache
      • Dispatch batch
    • Bookie
      • numReadWorkerThreads
      • maxPendingReadRequestsPerThread
      • dbStorage_rocksDB_blockCacheSize
      • dbStorage_readAheadCacheMaxSizeMb
      • dbStorage_readAheadCacheBatchSize

Reference