Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Devops - build fails on tests due to disk limits #161

Closed
extua opened this issue Nov 22, 2024 · 2 comments
Closed

Devops - build fails on tests due to disk limits #161

extua opened this issue Nov 22, 2024 · 2 comments

Comments

@extua
Copy link

extua commented Nov 22, 2024

Following on from issue #160, I am now building with gradle 5.6.4, but the build fails the following tests:

org.webcurator.core.visualization.networkmap.NetworkMapUtilTest > testGetNextTitle FAILED
    com.sleepycat.je.DiskLimitException at NetworkMapUtilTest.java:43

org.webcurator.core.visualization.networkmap.NetworkMapUtilTest > testClassifyTreeViewByPathName2 FAILED
    com.sleepycat.je.DiskLimitException at NetworkMapUtilTest.java:43

org.webcurator.core.visualization.networkmap.NetworkMapUtilTest > testClassifyTreeViewByPathName FAILED
    com.sleepycat.je.DiskLimitException at NetworkMapUtilTest.java:43

org.webcurator.core.visualization.networkmap.NetworkMapClientLocalTest > test FAILED
    com.sleepycat.je.DiskLimitException

org.webcurator.core.visualization.networkmap.NetworkMapClientLocalTest > testInitialIndex FAILED
    com.sleepycat.je.DiskLimitException

org.webcurator.core.visualization.networkmap.IndexProcessorTest > testInitialIndex FAILED
    com.sleepycat.je.DiskLimitException at IndexProcessorTest.java:48

org.webcurator.core.visualization.networkmap.BDBNetworkMapTest > testBDB FAILED
    com.sleepycat.je.DiskLimitException at BDBNetworkMapTest.java:27

348 tests completed, 7 failed, 29 skipped

> Task :test FAILED

FAILURE: Build failed with an exception.

The specific exception in all these cases is

com.sleepycat.je.DiskLimitException: (JE 18.3.12) Disk usage is not within je.maxDisk or je.freeDisk limits and write operations are prohibited: maxDiskLimit=0 freeDiskLimit=5,368,709,120 adjustedMaxDiskLimit=0 maxDiskOverage=0 freeDiskShortage=1,511,313,408 diskFreeSpace=3,857,395,712 availableLogSize=-1,511,313,408 totalLogSize=1,427 activeLogSize=1,427 reservedLogSize=0 protectedLogSize=0 protectedLogSizeMap={}

I have about 80GB of free space on my laptop, so pretty sure that's not the issue. I can see this has come up in Heratrix before, with a solution to increase the FREE_DISK variable.

@extua
Copy link
Author

extua commented Nov 26, 2024

I was able to get past this by adding

environmentConfig.setConfigParam(EnvironmentConfig.FREE_DISK, "0");

to the BDBRepoHolder.java file as suggested in this comment.

I don't know a better way to raise the disk limit, anyway this works for now.

@extua extua closed this as completed Nov 26, 2024
@extua
Copy link
Author

extua commented Nov 26, 2024

Setting the disk limit to zero just removes the free space limit, in the meantime I've set my limit to 1073741824 (10GB), which also passes the test.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant