Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large Items we want to package for preservation storage #497

Open
2 tasks
pgwillia opened this issue Dec 12, 2024 · 0 comments
Open
2 tasks

Large Items we want to package for preservation storage #497

pgwillia opened this issue Dec 12, 2024 · 0 comments

Comments

@pgwillia
Copy link
Member

1b2e4301-26ff-4f57-8133-4b67e7a60857
1d3a3d22-8dbd-4e31-99e5-8bfc51d4c401
79709757-2d2d-484e-90fa-798928726b13
a28efd24-991d-4c19-bb9c-17113bf80b66
b470bdac-540b-4356-a796-eba1de754e6c
b79488fe-4aef-47cb-8851-c9dd7ddc16f0
cea6f55b-241f-4d8f-8e1c-2ca9096c7dc6
fae6573a-934c-4b60-93e6-38a7ea82651c
fd73a07d-8be1-493d-a09d-e93ccc5cc1ae

These can be enqueued one at a time using rails console on era-app-prd-4 like this:

item=Item.find('1b2e4301-26ff-4f57-8133-4b67e7a60857')
item.push_entity_for_preservation

Related to #496

Outcome

  • understand what the problem is
  • solutions for packaging for preservation storage

@henryzhang87 proposes

I had no luck with other items, always complaining about "the request entity is too large" error.

I have a quick code-intrusive workaround. The idea is to create aip without cleaning up, therefore,
the created packages can be uploaded using the swift command line (I tried
a file as big as 30GB a long time ago)

In the aip.rb file, comment out two lines and add two logging lines

    .....
    ensure
      #FileUtils.rm_rf(aip_filename)
      #FileUtils.rm_rf(aip_directory)
      print("HENRY: aip_filename=#{aip_filename}\n")
      print("HENRY: aip_directory=#{aip_directory}\n")
    end
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant