refactor(query): refactor hash join spill

[Dousir9]

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

Code readability and maintainability

1. New step transition mechanism: this PR divides hash join probe/build step into three types: SyncStep, AsyncStep, and Finish, ensuring that step transition occurs in the event and this PR redesigns step transition to make the step transition logic clearer and improve code readability and maintainability.
2. Unify ProbeSpillHandler and BuildSpillHandler to HashJoinSpiller to improve code maintainability.
3. Unify the spill logic of cross join and other types.
4. Introduce HashTableType to reduce code.

Bug Fixed

1. Fix a corner case of left-related join when spill happens.
2. The left-anti join should perform probe if there is no partition on the build side.
3. Fix out of range for slice panic when spill happens.

Tests

• Add TPC-H spill test
• Add TPC-DS spill test

Performance (Databend Cloud XSMALL)

TPC-H SF100 Q18: 164s → 137s

Test script:

set join_spilling_buffer_threshold_per_proc_mb = 512;
set join_spilling_bytes_threshold_per_proc = 1;
set join_spilling_memory_ratio = 1;
select
    c_name,
    c_custkey,
    o_orderkey,
    o_orderdate,
    o_totalprice,
    sum(l_quantity)
from
    customer,
    orders,
    lineitem
where
        o_orderkey in (
        select
            l_orderkey
        from
            lineitem
        group by
            l_orderkey having
                sum(l_quantity) > 300
    )
  and c_custkey = o_custkey
  and o_orderkey = l_orderkey
group by
    c_name,
    c_custkey,
    o_orderkey,
    o_orderdate,
    o_totalprice
order by
    o_totalprice desc,
    o_orderdate;

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe): code maintainability

---

This change is 

[github-actions]

Docker Image for PR

• tag: pr-15746-9107967-1717765135

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-15746-61aa91b-1718103773

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-15746-d5f0732-1723784071

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-15746-550a9dc-1724066510

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-15746-7335d28-1724069360

note: this image tag is only available for internal use,
please check the internal doc for more details.

[zhang2014]

LGTM