Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
downloader: docs on MMAP for data-files r/w and experiments with bufio (
#10074) Pros: - it allows to not pre-alloc files: #8688 - it allows to not "sig-bus" when no space left on disk (return user-friendly error). see: #8500 - but DB will be MMAP anyway and may get "sig-bus" FYI: - seems no perf difference (but i tested only on cloud drives) - erigon will anyway open it as mmap Cons: - i did implemented `fsync` for mmap ( anacrolix/torrent#755 ) - probably will need implement it for bufio: anacrolix/torrent#937 - no zero-copy: more `alloc` memory will be holded by APP (PageCache starvation). I see 2x mem usage (at `--torrent.download.slots=500` 20gb vs 40gb) - i see "10K threads exchaused" error earlier (on `--torrent.download.slots=500`). - what else?
- Loading branch information