Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use sparse checkout for CI/live tests and release pipelines #24146

Closed
benbp opened this issue Sep 21, 2021 · 4 comments
Closed

Use sparse checkout for CI/live tests and release pipelines #24146

benbp opened this issue Sep 21, 2021 · 4 comments
Assignees
Labels
Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Comments

@benbp
Copy link
Member

benbp commented Sep 21, 2021

We have sparse checkout templates that are used in various places to speed up pipeline job runtime, especially in repos like java and net where test recordings are substantial and make the full repo clone very large.

In java, we use sparse checkout across CI, live tests and release. Generally this results in about a 3-4 minute improvement per job and should be similar for net.

There are a few considerations with sparse checkout that need to be handled when adding support:

  1. Excluding test recordings has the most impact.
  2. Excluding other SDK and mgmt directories also has benefit, but takes more work (sometimes there are file dependencies across directories).
  3. Certain types of files need to be included everywhere or in most places, such as markdown files, xml files and CODEOWNERS files.

Related: #21789

@weshaggard @pakrym

@benbp benbp added the Central-EngSys This issue is owned by the Engineering System team. label Sep 21, 2021
@pakrym
Copy link
Contributor

pakrym commented Sep 21, 2021

Excluding other SDK and mgmt directories also has benefit, but takes more work (sometimes there are file dependencies across directories).

Can we only exclude recordings in other directories?

@benbp
Copy link
Member Author

benbp commented Sep 21, 2021

Can we only exclude recordings in other directories?

Yeah I think this would be a great starting point.

@jsquire jsquire added the EngSys This issue is impacting the engineering system. label Sep 22, 2021
Copy link

github-actions bot commented Mar 4, 2024

Hi @benbp, we deeply appreciate your input into this project. Regrettably, this issue has remained inactive for over 2 years, leading us to the decision to close it. We've implemented this policy to maintain the relevance of our issue queue and facilitate easier navigation for new contributors. If you still believe this topic requires attention, please feel free to create a new issue, referencing this one. Thank you for your understanding and ongoing support.

1 similar comment
Copy link

github-actions bot commented Apr 5, 2024

Hi @benbp, we deeply appreciate your input into this project. Regrettably, this issue has remained inactive for over 2 years, leading us to the decision to close it. We've implemented this policy to maintain the relevance of our issue queue and facilitate easier navigation for new contributors. If you still believe this topic requires attention, please feel free to create a new issue, referencing this one. Thank you for your understanding and ongoing support.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Apr 5, 2024
@github-project-automation github-project-automation bot moved this from 🤔 Triage to 🎊 Closed in Azure SDK EngSys 🤖🧠 Apr 5, 2024
@github-actions github-actions bot locked and limited conversation to collaborators Apr 5, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.
Projects
Archived in project
Development

No branches or pull requests

4 participants