[Tracking] Proofs P2

[th7nder]

Proposed flow:

1. Storage Client: ./binary calculate-commp husky.jpg
   [...] Storage Client and Storage Provider talk in the meantime [...]
2. Storage Client: send file to the Storage Provider
3. Storage Provider: publish_storage_deals
4. Storage Provider: create a replica, calculate CommR
5. Storage Provider: pre-commit
6. Storage Provider Pallet: verify pre-commit
7. Storage Provider: prove replica PoRep
8. Storage Provider: prove-commit with PoRep
9. Storage Provider Pallet: verify proof by prove-commit

Overall research

• Research rust-fil-proofs #91
• Implement a Verifier Draft in Pallet Storage-Provider for Windowed-PoSt #244

General

• calculate CommP for a Storage Client #359
• mater: CARv2 archive not padded to the power of 2? #418
• allow to create sectors with multiple pieces #420
  • fix(polka-storage-proofs): add sector padding #434
• Hide PreparedVerifyingKey #430
• First run of PoRep generation fails #429
• Implement Randomness pallet #468
• Sector number should be generated by the Storage Provider. #472
• Derive a ProverId in the storage provider server #473
• Define a better ID for sector storage #474

Proof Generation

• Generate verifying key and parameters for Groth16
  • Implement verifying-key type definition #383
  • feat: implement proof and multiproof definition #395
  • Generate verifying key #400
  • Optimize Encode/Decode for VerifyingKey #408
  • Fix random number generation in tests #411
    • feat: improve random number gen in std #433
• Setup a lib
• Generate PoRep API #410
  • feat: generate porep #417
• Generate PoSt API #437

Proofs Pallet

• Set up pallet-proofs #358
• Verify PoRep #357
• Verify PoSt #439
  • Poseidon in PoSt Verification #444
  • feat(pallet-proofs): verify PoSt #461
• Generate a Prover Id in PoRep Verify #412

Storage Provider Node

• Create a replica & calculate commR #360
• Call pre-commit after sealing a sector #476
  • feat: integrate pre-commit/create replica with extrinsic call on pipeline #483
  • Separate out AddPiece pipeline step #489
• Create a Proof for Replica + CommR + CommD #394

Market Pallet

• Market Pallet: port compute_commd #92
  • feat(commd): calculate commd #423

Storage Provider Pallet

• Integrate Pallet Storage Provider with Pallet Proofs on Prove Commit #441
• SP Pallet: seal_rand_epoch research #119

Resources

Research

• Vector Commitments - https://www.youtube.com/watch?v=Zi3akuyDzMs
• Stacked DRG - https://youtu.be/8_9ONpyRZEI
• Merkle Proofs - https://github.com/protolambda/eth2.0-ssz/blob/master/specs/merkleization/merkle_proofs.md
• rust-fil-proofs terminology - https://hackmd.io/@jake/rym1Ggj2L#R1CS-and-Circuit-Notation-and-Types
• rust-fil-proofs spec - https://hackmd.io/@jake/Bko2WrFhL#Stacked-Depth-Robust-Graphs
• https://eprint.iacr.org/2018/678.pdf - PoRep paper
• https://spec.filecoin.io/#section-systems.filecoin_markets - Filecoin Markets
• https://medium.com/qed-it/diving-into-the-snarks-setup-phase-b7660242a0d7 -> snarks setup