Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pref/jobOutput: Write job output to disk. #25

Closed
dshearer opened this issue Feb 1, 2016 · 5 comments
Closed

pref/jobOutput: Write job output to disk. #25

dshearer opened this issue Feb 1, 2016 · 5 comments
Assignees
Milestone

Comments

@dshearer
Copy link
Owner

dshearer commented Feb 1, 2016

  • Should be possible to have jobber write each job's stdout and stderr to disk.
  • Only job owner can read logs for that job.
@dshearer
Copy link
Owner Author

dshearer commented Feb 1, 2016

This is tricky to do securely, especially if the user can specify where the logs are written.

@stephane-martin
Copy link

well, you could keep the job results in an internal database (eg boltdb) owned only by jobberd, and give users access to the results through a jobber command. each job execution could have an execution UUID, and then "jobber stdout UUID" would give the stdout output for that execution...

@nickmcdowall
Copy link

👍 For writing job runs and output to file please

@dshearer dshearer self-assigned this Aug 28, 2017
@dshearer dshearer added this to the 1.3 milestone Aug 28, 2017
@dshearer
Copy link
Owner Author

FYI I plan to get this done. It's taken a while b/c I had to rearchitect the damn thing.

@dshearer dshearer modified the milestone: 1.3 Jan 2, 2018
@dshearer dshearer modified the milestones: 1.3, 1.4 Jan 29, 2018
@dshearer
Copy link
Owner Author

dshearer commented Feb 12, 2018

This config:

[prefs]
jobOutput:
    stdout:
        where: /path/to/job/output
        maxAgeDays: 90
    stderr:
        where: /path/to/job/output
        maxAgeDays: 90

[jobs]
- name: ForgetStdout
   ...
   jobOutput:
       stdout: null

- name: ChangeStderrMaxAge
   ...
   jobOutput:
       stderr:
           maxAgeDays: 120

Produces:

- /path/to/job/output/
    - ForgetStdout/
        - 1519083883.stdout
        - 1519083943.stdout
        - 1519084003.stdout
    - ChangeStderrMaxAge/
        - 1519083883.stdout
        - 1519083883.stderr
        - 1519083943.stdout
        - 1519083943.stderr
        - 1519084003.stdout
        - 1519084003.stderr

@dshearer dshearer changed the title Write job output to disk. pref/jobOutput: Write job output to disk. Feb 26, 2018
dshearer added a commit that referenced this issue Feb 27, 2018
pref/jobOutput: (#25) Support writing job output to disk
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants