CDC Server support data-dir (#1879)

[ti-chi-bot]

This is an automated cherry-pick of #1879

What problem does this PR solve?

This PR makes TiCDC support --data-dir at the server level.

What is changed and how it works?

• --data-dir is supported at the server level, default to "", if not set, it will be set by conditions:
  • if there is no other changefeed, /tmp/cdc_data will be set as default data-dir
  • if there is any changefeed with the --sort-dir set, choose the valid one with the largest available space as data-dir.
    • if there are no candidates who meet the requirement, server start failed
• --sort-dir set at both server level and changefeed level won't take effect, and default to /tmp/sorter, this means it can not be changed by both command flag or config file
  • sort dir of the server and changefeed will be set as /{data-dir}/tmp/sorter
• during server running, if the available space is lower than 10% of the disk, serve running will fail, due to trying to consume disk space (create new sort temporary file)
• warning user when set data dir and space unavailable.

Check List

Tests

• Unit test

Code changes

• Has exported function/method change
• Has exported variable/fields change
• Has interface methods change
• Has persistent data change

Side effects

• Possible performance regression
• Increased code complexity
• Breaking backward compatibility

Related changes

• Need to cherry-pick to the release branch
• Need to update the documentation
• Need to update key monitor metrics in both TiCDC document and official document

Release note

[overvenus]

Approve in advance, please merge this PR once it's ready.

[3AceShowHand]

/run-all-tests

[3AceShowHand]

/run-unit-tests

[3AceShowHand]

/run-all-tests

[3AceShowHand]

/run-all-tests

[3AceShowHand]

/run-all-tests

[3AceShowHand]

/run-all-tests

[amyangfei]

/run-all-tests

[ti-chi-bot]

[REVIEW NOTIFICATION]

This pull request has been approved by:

• amyangfei
• overvenus

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

[amyangfei]

/merge

[ti-chi-bot]

This pull request has been accepted and is ready to merge.

Commit hash: b010cca

[ti-chi-bot]

@ti-chi-bot: Your PR was out of date, I have automatically updated it for you.

At the same time I will also trigger all tests for you:

/run-all-tests

If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[ti-chi-bot]

@ti-chi-bot: Your PR was out of date, I have automatically updated it for you.

At the same time I will also trigger all tests for you:

/run-all-tests

If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[ti-chi-bot]

Merge canceled because a new commit is pushed.

[3AceShowHand]

/run-all-tests

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (release-5.0@25b082b). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff                @@
##             release-5.0      #2070   +/-   ##
================================================
  Coverage               ?   53.9479%           
================================================
  Files                  ?        164           
  Lines                  ?      17680           
  Branches               ?          0           
================================================
  Hits                   ?       9538           
  Misses                 ?       7128           
  Partials               ?       1014