Update development dockerfiles to use prebuilt extensions

[akchinSTC]

Adds a new container-image-dev target to Makefile
Modifies existing dev dockerfiles to use pre built and packaged extensions.

Fixes #2546

What changes were proposed in this pull request?

How was this pull request tested?

New make target was run and container images and tags verified.
existing non dev targets should remain unaffected and should continue to function during release process.

Developer's Certificate of Origin 1.1

   By making a contribution to this project, I certify that:

   (a) The contribution was created in whole or in part by me and I
       have the right to submit it under the Apache License 2.0; or

   (b) The contribution is based upon previous work that, to the best
       of my knowledge, is covered under an appropriate open source
       license and I have the right under that license to submit that
       work with modifications, whether created in whole or in part
       by me, under the same open source license (unless I am
       permitted to submit under a different license), as indicated
       in the file; or

   (c) The contribution was provided directly to me by some other
       person who certified (a), (b) or (c) and I have not modified
       it.

   (d) I understand and agree that this project and the contribution
       are public and that a record of the contribution (including all
       personal information I submit with it, including my sign-off) is
       maintained indefinitely and may be redistributed consistent with
       this project or the open source license(s) involved.

[elyra-bot]

Thanks for making a pull request to Elyra!

To try out this branch on binder, follow this link:

[kevin-bates]

My goodness, this is some serious cleanup - very nice!

I just had one comment about capturing the version.

[kevin-bates]

(This probably isn't a big deal but thought I'd mention it.)
With these dev targets, if either of the -image-dev targets are invoked when the ELYRA_VERSION is not a .devN version (e.g., 3.8.0), then the image produced by these targets will overwrite the non-dev images. Not sure if its worth adding some kind of detection, like confirm ELYRA_VERSION contains ".dev", prior to proceeding. Since these targets are referenced by container-images-dev and not container-images it probably isn't something to be concerned about. I also haven't looked closely into the differences between the dev and non-dev dockerfiles used by these targets as it could be the case that, when using a released wheel file, the two are essentially equivalent images.

[kevin-bates]

(This probably isn't a big deal but thought I'd mention it.)
With these dev targets, if either of the -image-dev targets are invoked when the ELYRA_VERSION is not a .devN version (e.g., 3.8.0), then the image produced by these targets will overwrite the non-dev images. Not sure if its worth adding some kind of detection, like confirm ELYRA_VERSION contains ".dev", prior to proceeding. Since these targets are referenced by container-images-dev and not container-images it probably isn't something to be concerned about. I also haven't looked closely into the differences between the dev and non-dev dockerfiles used by these targets as it could be the case that, when using a released wheel file, the two are essentially equivalent images.

[lresende]

Is there a way to use this effort to try to clean up vs adding additional duplication? Now that we are supposedly building proper pre-built images that can be installed, can't we identify the tag name with something like this and remove the duplicated makefile tasks and dockerfile?

[akchinSTC]

Is there a way to use this effort to try to clean up vs adding additional duplication? Now that we are supposedly building proper pre-built images that can be installed, can't we identify the tag name with something like this and remove the duplicated makefile tasks and dockerfile?

@lresende - done

[lresende]

Thanks, @akchinSTC, this looks a lot cleaner. I can give it a try on the functionality over the weekend but otherwise looks good.