Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ingester #2

Closed
juliangruber opened this issue May 16, 2023 · 0 comments · Fixed by #12
Closed

Ingester #2

juliangruber opened this issue May 16, 2023 · 0 comments · Fixed by #12
Assignees
@juliangruber

Comments

@juliangruber
Copy link
Member

juliangruber commented May 16, 2023 •
edited
Loading

  • Add a new HTTP route to our backend monolith app to receive reports about completed jobs. This will share the same DB with Orchestrator/Job Scheduler.
  • When Ingester receives a job report from a Station, it attaches the current timestamp to the record stored. This will help us troubleshoot and may be useful later for fraud detection.
    • The JobId in the report allows us to verify that Stations performed jobs that our Orchestrator scheduled, as the job report must provide a valid JobId.

Estimate: 2 days
@juliangruber juliangruber self-assigned this May 16, 2023
This was referenced May 16, 2023
Closed
Merged
juliangruber added a commit that referenced this issue May 23, 2023
@juliangruber
add ingestion. closes #2 (#12)
01146af 
* add `PUT /retrievals` implementation. #1

* PUT -> POST

* `lastCid` -> `firstCid`

* refactor test

* add `PATH /retrieval/:id`

* fix handle invalid json

* fix some error cases

* refactor using `http-assert`

* style

* docs

* add test for request body too large
juliangruber added a commit that referenced this issue Sep 1, 2023
@juliangruber
add ingestion. closes #2 (#12)
d572fd7 
* add `PUT /retrievals` implementation. #1

* PUT -> POST

* `lastCid` -> `firstCid`

* refactor test

* add `PATH /retrieval/:id`

* fix handle invalid json

* fix some error cases

* refactor using `http-assert`

* style

* docs

* add test for request body too large
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@juliangruber juliangruber

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

add ingestion. closes #2 filecoin-station/spark-api
1 participant
@juliangruber