golang_pipeline.md

搭建并行处理管道

源码仓库：这里

---

• 外部排序

外部排序架构

                                                External Sorting


                      +--------+         +-------------------+
           +--------->+  read  +-------->+  internal sorting |
           |          +--------+         +-------------------+          +-----------+
           |                                                  +-------->+  merge    |
           |                                                  +-------->+           |
+----------+                                                  |         +-----------+
|          |          +--------+         +--------------------+                     |
|          +--------->+ read   +-------->+  internal sorting  |                     |         +------------+     +------------+
|          |          +--------+         +--------------------+                     +-------->+            |     |            |
|          |                                                                                  +   merge    +---->+  retData   |
|sourceData|                                                                        +-------->+            +     +            |
|          |                                                                        |         +------------+     +------------+
|          |          +--------+         +---------------------+                    |
|          +--------->+ read   +-------->+  internal sorting   |                    |
|          |          +--------+         +---------------------+        +-----------+
+----------+                                                   +------->+  merge    |
           |                                                   |------->+           |
           |          +---------+        +---------------------+        +-----------+
           +--------->+  read   +------->+  internal sorting   |
                      +---------+        +---------------------+