This project is designed for providing the synchoronization of the stdout / stderr among different threads, processes, devices or hosts. The package could be used for the following cases:
- Use
syncstream.LineBuffer: Multiple threads are created. The messages (stdout) from different threads are required to be collected. - Use
syncstream.LineProcBufferin the main process, andsyncstream.LineProcMirrorin the sub-processes: Multiple sub-processes are created on the same device. The stdout / stderr of each process is redirected to aLineProcMirror, and the results are collected byLineProcBuffer. - Use
syncstream.LineFileBuffer: Multiple processes are created. These processes may be deployed on different devices (even with different platforms), but all devices could get accessed to the same shared disk. In this case, the message could be shared by locked files. Each process would hold an independentLineFileBufferpointing to the same log files. - Use
syncstream.LineHostBufferon the server side, andsyncstream.LineHostMirroron the client side: Multiple processes are deployed on different devices, and they could not share the same disk. In this case, the message are synchronized by the web service. Each process would hold aLineHostMirror, and the results would be collected byLineHostBuffer.
The basic package would not contain the file and host modules. To install the package, please use the following options:
pip install syncstream[option1,option2...]| Option | Supports |
|---|---|
file |
Install dependencies for the file module. The module provides syncstream.LineFileBuffer. |
host |
Install dependencies for the host module. The module provides syncstream.LineHostBuffer, and syncstream.LineHostMirror. |
test |
Install dependencies for running tests. |
dev |
Install dependencies for developers. |
View the documentation here: 📘 https://cainmagi.github.io/sync-stream/
See the versions in the CHANGELOG 🗒️ file.