Weekly Digest (19 July, 2020 - 26 July, 2020)

[weekly-digest]

Here's the Weekly Digest for iterative/dvc:

---

ISSUES

Last week 46 issues were created.
Of these, 23 issues have been closed and 23 issues are still open.

OPEN ISSUES

💚 #4284 ignore: dynamically collect dvcignore, by efiop
💚 #4283 dvc experiments checkout: option to select the best experiment regarding one metric, by gcoter
💚 #4282 dvc check-ignore command, by karajan1001
💚 #4281 LockFile class dump/load uses different libraries, by dtrifiro
💚 #4278 Get rid of .dvc files?, by jorgeorpinel
💚 #4277 ssh remote: no progress bar on push/pull, by shcheklein
💚 #4276 remote local config does not see existing remote, by shcheklein
💚 #4273 repro: make recursive by default (kill -P), by jorgeorpinel
💚 #4270 Restyle repro: update status message for dvc-added files, by restyled-io[bot]
💚 #4269 repro: update status message for dvc-added files, by sarthakforwet
💚 #4268 CML <-> DVC cache smooth integration, by DavidGOrtega
💚 #4266 'NoneType' object is not subscriptable , by DavidGOrtega
💚 #4259 DVC repro/pull/checkout hangs on sshfs, by geblanco
💚 #4257 [WIP] experiments: support local parallel execution in temp directories, by pmrowla
💚 #4256 tree,remote: add support for WebDAV, by iksnagreb
💚 #4255 plots: support multiple Y fields? [qa], by jorgeorpinel
💚 #4253 DVC PULL doesn't work when i pushed data from one GIT Repo to S3 remote storage and try pulling from other GIT Repo, by aswin-datakalp
💚 #4251 get-url should just GET files, by skshetry
💚 #4249 dvc 1.x tries to remove files in .dvcignore, by dimatura
💚 #4248 Add support for PUT method for remote http storage, by em2er
💚 #4247 get/list/import/api: subrepo support, by skshetry
💚 #4241 tests failing when not using venv and behind a firewall, by karajan1001
💚 #4239 import-url --file=something.yaml ... doesn't save stage anywhere, by Suor

CLOSED ISSUES

❤️ #4280 Restyle get/list/import/api: subrepo support, by restyled-io[bot]
❤️ #4279 Pipeline to process only new files, by rabefabi
❤️ #4275 dvc: properly handle relative symlinks, by efiop
❤️ #4274 ignore: use use_dvcignore flag, by efiop
❤️ #4272 dvc: add dvc/utils/build.py to gitignore, by efiop
❤️ #4271 config: don't switch between trees, by efiop
❤️ #4267 config: neither credentialpath nor keyfile work when rel to config filename is used, by Suor
❤️ #4265 Restyle get/list/import/api: subrepo support, by restyled-io[bot]
❤️ #4264 build: fix pyinstaller build, by efiop
❤️ #4263 tests: check if docker is present, by efiop
❤️ #4262 daemon: don't use Popen on linux/mac, by efiop
❤️ #4261 Running import-url on S3 URL gives error message "requires existing cache on 's3' remote", by nimrand
❤️ #4260 ignore-check for DVC?, by karajan1001
❤️ #4258 add toml support for ParamsDependency, by dtrifiro
❤️ #4254 dvc: wildcard outputs?, by jorgeorpinel
❤️ #4252 Restyle [TEST PR] debugging tests failure for subrepo support, by restyled-io[bot]
❤️ #4250 [TEST PR] debugging tests failure for subrepo support, by skshetry
❤️ #4246 erepo: --rev BRANCH: shallow clone, by pmrowla
❤️ #4245 dvc: separate cache and remote classes, by efiop
❤️ #4244 tree: use cache.tree to check if cache file exists, by efiop
❤️ #4243 Consolidate trees, by efiop
❤️ #4242 Optimize dvcignore, by karajan1001
❤️ #4240 dvc: get rid of BaseTree in favor of BaseRemoteTree, by efiop

LIKED ISSUE

👍 #4247 get/list/import/api: subrepo support, by skshetry
It received 👍 x3, 😄 x0, 🎉 x3 and ❤️ x3.

NOISY ISSUE

🔈 #4249 dvc 1.x tries to remove files in .dvcignore, by dimatura
It received 9 comments.

---

PULL REQUESTS

Last week, 22 pull requests were created, updated or merged.

OPEN PULL REQUEST

Last week, 1 pull request was opened.
💚 #4270 Restyle repro: update status message for dvc-added files, by restyled-io[bot]

UPDATED PULL REQUEST

Last week, 6 pull requests were updated.
💛 #4269 repro: update status message for dvc-added files, by sarthakforwet
💛 #4257 [WIP] experiments: support local parallel execution in temp directories, by pmrowla
💛 #4256 tree,remote: add support for WebDAV, by iksnagreb
💛 #4247 get/list/import/api: subrepo support, by skshetry
💛 #4229 Special dir warning #3436, by aerubanov
💛 #4114 version: redesign output format for the dvc version command #3499, by sahilbhosale63

MERGED PULL REQUEST

Last week, 15 pull requests were merged.
💜 #4275 dvc: properly handle relative symlinks, by efiop
💜 #4274 ignore: use use_dvcignore flag, by efiop
💜 #4272 dvc: add dvc/utils/build.py to gitignore, by efiop
💜 #4271 config: don't switch between trees, by efiop
💜 #4264 build: fix pyinstaller build, by efiop
💜 #4263 tests: check if docker is present, by efiop
💜 #4262 daemon: don't use Popen on linux/mac, by efiop
💜 #4258 add toml support for ParamsDependency, by dtrifiro
💜 #4246 erepo: --rev BRANCH: shallow clone, by pmrowla
💜 #4245 dvc: separate cache and remote classes, by efiop
💜 #4244 tree: use cache.tree to check if cache file exists, by efiop
💜 #4243 Consolidate trees, by efiop
💜 #4242 Optimize dvcignore, by karajan1001
💜 #4240 dvc: get rid of BaseTree in favor of BaseRemoteTree, by efiop
💜 #4224 S3: Use key_id and key_secret directly, by farizrahman4u

---

COMMITS

Last week there were 21 commits.
🛠️ [add toml support for ParamsDependency (#4258) * add toml support for ParamsDependency

• add toml support to dvc show

Co-authored-by: Daniele Trifirò daniele.trifiro@illimity.com](e2b1fb1) by dtrifiro
🛠️ dvc: properly handle relative symlinks (#4275) Fix #4160 by efiop
🛠️ ignore: use use_dvcignore flag (#4274) by efiop
🛠️ dvc: add dvc/utils/build.py to gitignore (#4272) Added by accident in https://github.com/iterative/dvc/pull/4271/files by efiop
🛠️ config: don't switch between trees (#4271) No longer needed, since we have use_dvcignore flag. by efiop
🛠️ dvc: bump to 1.2.0 by efiop
🛠️ build: fix pyinstaller build (#4264) https://github.com/pypa/setuptools/issues/1963 by efiop
🛠️ [daemon: don't use Popen on linux/mac (#4262) We used Popen just to provide a general way of launching our daemons
on both Windows and *nix, but it is causing us issues when dvc is
launched from some exotic places (like nix package) or through main()
helper from a script that is not dvc.

This patch makes us just use main() directly in our double-forked
process.

Windows implementation has to use the Popen mechanism, because this is
the only way to daemonize a process on Windows. This means that dvc on
Windows is still susceptible to this problem, but there is nothing we
can do about it right now :(

Fixes #4206
Fixes #4165](f799e1e) by efiop
🛠️ pr template: remove cc and ds bulletpoint by efiop
🛠️ tests: check if docker is present (#4263) https://travis-ci.com/github/iterative/dvc/jobs/364061489#L3623 by efiop
🛠️ Delete .deepsource.toml by efiop
🛠️ Delete .codeclimate.yml by efiop
🛠️ [Optimize dvcignore (#4242) * Update

1. unit test update
2. two might cause bugs

• dvc ignore

• Some refactoring

• clean

• Config tree use

• Solve sub dir repo problem. Add more tests

• typo error

• Change request

Co-authored-by: karajan1001 jah@mail.ustc.edu.cn](67896aa) by karajan1001
🛠️ [erepo: --rev BRANCH: shallow clone (#4246) * erepo: use shallow clones when rev is branch or tag name

• tests: test erepo shallow clone behavior

• erepo: fix detached head after shallow cloning a tag

• move unshallow logic into its own function

• erepo: default rev should be origin HEAD not local HEAD

• use functools.partial

• review fixes

• comment shallow clone behavior in erepo

• don't duplicate unnecessary fetch/pull call](a4b3c6d) by pmrowla
  🛠️ dvc: separate cache and remote classes (#4245) Finalizes code part of #4050 by efiop
  🛠️ tree: use cache.tree to check if cache file exists (#4244) Continuing #4050 This issue was found in #4242 by efiop
  🛠️ [Consolidate trees (Consolidate trees #4243) * dvc: get rid of is_walking_tree

No longer needed. Some applications of isinstance() will be refactored
in the future, as trees will just provide the needed functionality.

• dvc: move GitTree to dvc/tree/

• dvc: rename *RemoteTree to *Tree](a077135) by efiop
  🛠️ tests: hdfs: revert 488e0d8 by efiop
  🛠️ dvc: get rid of BaseTree in favor of BaseRemoteTree (#4240) Related to #4050 by efiop
  🛠️ tests: hdfs: don't pull hadoop if there is no docker-compose by efiop
  🛠️ [S3: Use key_id and key_secret directly (S3: Use key_id and key_secret directly #4224) * key api

• Restyled by black

• test

• fixes

• test

• Restyled by black

• Trigger CI

• default val

• remove redundant default

Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com

• Update tests/unit/remote/test_s3.py

• rename fields

• update test

• key_id->secret_key_id

Co-authored-by: Restyled.io commits@restyled.io
Co-authored-by: Ruslan Kuprieiev kupruser@gmail.com](5825e95) by farizrahman4u

---

CONTRIBUTORS

Last week there were 5 contributors.
👤 dtrifiro
👤 efiop
👤 karajan1001
👤 pmrowla
👤 farizrahman4u

---

STARGAZERS

Last week there were 69 stagazers.
⭐ melkiga
⭐ torazem
⭐ yclian
⭐ naveenthomasj86
⭐ PhilipSlisenko
⭐ saniellocutor
⭐ myrgy
⭐ stu73
⭐ brunotm
⭐ michael-hoffman
⭐ jeffkayne
⭐ BuZZ-dEE
⭐ matheusnervis
⭐ zhewuzhou
⭐ xyb
⭐ kexplo
⭐ PCP55
⭐ RaviHindocha
⭐ herdanc
⭐ SavchenkoValeriy
⭐ nmanovic
⭐ nicolecastillo
⭐ tomgorb
⭐ dmh43
⭐ urahua
⭐ tngzng
⭐ pcieslinski
⭐ tmshv
⭐ ratovarius
⭐ icexile
⭐ ivzhh
⭐ mariuszrzepka
⭐ acatlla
⭐ roland-ewald
⭐ 11rchitwood
⭐ ahhuisg
⭐ NullOsama
⭐ SurajDonthi
⭐ westurner
⭐ VaneeshK
⭐ fanglinchen
⭐ mrgnw
⭐ jinjunsun
⭐ Windfarer
⭐ rafguns
⭐ Mehanik
⭐ Micseb
⭐ eliocapelati
⭐ appanp
⭐ LTNMinh
⭐ a-alsaidi
⭐ jizg
⭐ aironbot
⭐ zealberth
⭐ bobertlo
⭐ tpeng
⭐ SlowHadoken
⭐ jacobdr
⭐ m-kashani
⭐ igufi
⭐ gsheni
⭐ ebirn
⭐ Sunakujira1
⭐ Mistobaan
⭐ karabijavad
⭐ hawake
⭐ entangledq
⭐ iworkist
⭐ brian-dawn
You all are the stars! 🌟

---

RELEASES

Last week there was 1 release.
🚀 1.2.0 1.2.0

---

That's all for last week, please 👀 Watch and ⭐ Star the repository iterative/dvc to receive next weekly updates. 😃

You can also view all Weekly Digests by clicking here.

Your Weekly Digest bot. 📆