Built-in BIDS support for dandi upload

[TheChymera]

@yarikoptic @satra still as draft, some things might still be weird, and need to come up with tests.

Eventually it will look like this (contains both normal and validation ignore usage), and if the number of invalid files is not 18k, the output also does not need to contain 18k lines :)
https://ppb.chymera.eu/1c32cb

[codecov]

Codecov Report

Attention: Patch coverage is 88.39286% with 13 lines in your changes missing coverage. Please review.

Project coverage is 88.41%. Comparing base (14030cb) to head (8139966).
Report is 1117 commits behind head on master.

Files	Patch %	Lines
dandi/upload.py	84.21%	6 Missing ⚠️
dandi/bids_validator_xs.py	37.50%	5 Missing ⚠️
dandi/bids_utils.py	92.30%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #1011      +/-   ##
==========================================
+ Coverage   87.65%   88.41%   +0.75%     
==========================================
  Files          65       72       +7     
  Lines        8189     9233    +1044     
==========================================
+ Hits         7178     8163     +985     
- Misses       1011     1070      +59     

Flag	Coverage Δ
unittests	88.41% <88.39%> (+0.75%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[lgtm-com]

This pull request introduces 1 alert when merging 46bcdb1 into 14030cb - view on LGTM.com

new alerts:

• 1 for Use of the return value of a procedure

[lgtm-com]

This pull request introduces 1 alert when merging d508c7b into 0016e60 - view on LGTM.com

new alerts:

• 1 for Use of the return value of a procedure

[TheChymera]

@jwodder putting it on draft for now to not waste your time. Need to test some things re typing first.

[TheChymera]

@jwodder ok, figured out the typing issues :) Everything else you mentioned should already be in.

[TheChymera]

@yarikoptic @jwodder should be done, unless you notice some additional issues. Not sure what's going on with the documentation, but probably unrelated.

[TheChymera]

@jwodder @yarikoptic could I get another review on this, or otherwise could this be merged?

[yarikoptic]

I will check it out tomorrow morning. Thanks!

[yarikoptic]

I have reservations since testing is quite "limited" as for number of use cases code tries to cover with the discovery of bids datasets... also tried on some dummy ds210 from bids-examples, it still required explicit paths and --allow-any-path... will file separate issues for that. For now -- let's just proceed.

[github-actions]

🚀 PR was released in 0.45.0 🚀