Limit the combined directories and files per allocation

[avanaur]

Changes

Add new max_dirs_files config (default 1000) to limit the number of files and directories per allocation.

The check is applied on file actions that will create new file such as

• create directory
• file upload
• copy file
• new file (think same as file upload)

The check occurs first before any file ref changes. It is not too restrictive in a sense that it will not consider how many new refs a file action will make. As long as current total combined files and dirs are below limit, the whole file action will be allowed to go.

Fixes

Fixes #639

Tests

Tasks to complete before merging PR:

• Ensure system tests are passing. If not Run them manually to check for any regressions 📋
• Do any new system tests need added to test this change? do any existing system tests need updated? If so create a PR at 0chain/system_test
• Merge your system tests PR to master AFTER merging this PR

Associated PRs (Link as appropriate):

• 0chain:
• gosdk:
• system_test:
• zboxcli:
• zwalletcli:
• Other: ...

[peterlimg]

lgtm

[codecov-commenter]

Codecov Report

Merging #676 (d329463) into staging (d8e9a4f) will increase coverage by 1.88%.
The diff coverage is 44.11%.

@@             Coverage Diff             @@
##           staging     #676      +/-   ##
===========================================
+ Coverage    22.02%   23.91%   +1.88%     
===========================================
  Files           69       69              
  Lines         7933     7967      +34     
===========================================
+ Hits          1747     1905     +158     
+ Misses        5924     5779     -145     
- Partials       262      283      +21     

Flag	Coverage Δ
Unit-Tests	23.91% <44.11%> (+1.88%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
.../0chain.net/blobbercore/reference/referencepath.go	0.00% <0.00%> (ø)
...chain.net/blobbercore/allocation/copyfilechange.go	46.42% <62.50%> (+46.42%)	⬆️
....net/blobbercore/allocation/file_changer_upload.go	47.72% <62.50%> (+47.72%)	⬆️
...0chain.net/blobbercore/allocation/newfilechange.go	27.41% <62.50%> (+27.41%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d8e9a4f...d329463. Read the comment docs.

[service-0chain]

Manual system tests [cancelled] with the following config

config	value
tests skipped	FALSE
system-tests	master
gosdk	NOT OVERRIDDEN
zboxcli	staging
zwalletcli	staging
0chain	staging
blobber	staging
authorizer	staging
0box	staging
0block	staging
0dns	staging
explorer	master
0proxy	staging
0search	staging