Issue 69 | Nested programs interface

[IceKhan13]

Summary

Nested programs interface

Now we provide a way to execute async nested programs in a following manner

from quantum_serverless import QuantumServerless, Program

serverless = QuantumServerless(...)

my_program = Program(
    name="my_program",
    entrypoint=script.py,
    dependencies=["requests", "pyscf==2.0.3"],
    version="0.0.1"
)

serverless.set_provider("provider")
job = serverless.run_program(my_program) # this will run program on provider
job.status() # to get status
job.logs() # to get logs

serverless.set_provider("another_provider")
another_job = serverless.run_program(my_program) # this will run program on another_provider

where script.py has our program code of interest for example

# script.py
from quantum_serverless import QuantumServerless, run_qiskit_remote, get

@run_qiskit_remote()
def ultimate():
    return 42


with QuantumServerless():
    result = get([ultimate() for _ in range(10)])

print(result)

Moreover we provide interface for program storage backend that can be implemented for example for local storage

from quantum_serverless.core.program import ProgramStorageBackend


class LocalStorageBackend(ProgramStorageBackend):
     ...

program_storage = LocalStorageBackend()

# to save program
program_storage.save_program(my_program)

# to load program
recovered_program = program_storage.get_program("my_program")

Details and comments

Co-authored with @Tansito

Closes #69

[pacomf]

LGTM like first approach!

Some questions:

1. How to concatenate different programs in a workflow? Any use example?
2. How to invoke programs from cloud? I mean, the private/hide version of a program to allow users run a program without get the source code of it. Any thoughts or idea to implement it?
3. In the example, Job can be named like program, right? Because inside of a program we can run several runtime jobs, for example
4. In the section not implemented yet ProgramStorageBackend, what is the meaning of Backend? can we use another naming to avoid confusion?

[IceKhan13]

How to concatenate different programs in a workflow? Any use example?

I think workflows will be inside as tasks and program is just an entrypoint to execution

# program.py

@run_qiskit_remote()
def step_1():
    ...

@run_qiskit_remote()
def step_2():
    ...

@run_qiskit_remote()
def combine_results_step2(step_1_res, step_2_res):
    ...

with serverless:
    result = get(combine_results_step2(step_1(...), step_2(...)))

How to invoke programs from cloud? I mean, the private/hide version of a program to allow users run a program without get the source code of it. Any thoughts or idea to implement it?

later on Program class will local/remote flag. So, if program is remote then run_program will serialize payload and send it over to cloud.

You will still be able to call get_program on private programs to get Program instance, but this instance will only have name of the program to run, no actual data

In the example, Job can be named like program, right? Because inside of a program we can run several runtime jobs, for example

Yes, I'm planning to update docs a little bit in a following PR. Good suggestion on naming and examples!

In the section not implemented yet ProgramStorageBackend, what is the meaning of Backend? can we use another naming to avoid confusion?

Good suggestion, I will remote Backend from name