Skip to content

Consider using Qiskit Serverless for cron job notebook testing #1323

Closed as not planned
@Eric-Arellano

Description

@Eric-Arellano

In our cron job, we run every notebook that submits jobs:

run: tox -- --write --only-submit-jobs

But the jobs might take longer than GH Actions' 6 hour limit when there is a long queue. Notably, we cannot batch the different jobs because they are distinct notebooks so using with Batch is not viable. We now use concurrency with asyncio, but we still can exceed the time limit.

So, instead, @frankharkins had the great idea of using Qiskit Serverless. On day 1, we'd submit all the notebooks to Qiskit Serverless. On day 2, a new cron job would run that retrieves the results from Qiskit Serverless.

Question: what workflow do we want for local runs?

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions