-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow restriction dvc pull
to targets
#2706
Comments
Context: https://discordapp.com/channels/485586884165107732/563406153334128681/639582276388388870 Initial answer on Discord:
|
I think letting user interrupt the process is ok solution unless there is a significant delay before it's obvious that lots of things will be pulled now. |
It is quite dangerous to change a command behavior (syntax of the command in this case) by a config option. This should be done only in exceptional cases. For this particular case, managing multiple DVC projects inside a single mono-repo might be a better solution with additional benefit. See #2349. The implementation is coming soon #3257. I’m closing the issue in favor of #2349. Please provide more details if I missed something and multiple dvc repro won’t solve the issue. |
@Suor it is more general and it should not be heavy. Otherwise, we will end up with many ways of doing the same thing. |
We have a big mono repo where all the projects are eventually merged. We plan to put the dvc files related to a model in the same directory, and we will have many such directories. In that case, doing
dvc pull
will start pulling all the files cached in remote storage (potentially terabytes of data), right? If a user doesdvc pull <target>
she will only load the cached file needed by this target, which is what we really want the user to do.It would be nice to have a way to prevent the
dvc pull
without a target, like a config optionpull.disable_global
.The text was updated successfully, but these errors were encountered: