Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 2.7 #4734

Closed
25 tasks done
planetf1 opened this issue Feb 24, 2021 · 17 comments
Closed
25 tasks done

Release 2.7 #4734

planetf1 opened this issue Feb 24, 2021 · 17 comments
Assignees
Labels
release Work to create a new releae
Milestone

Comments

@planetf1
Copy link
Member

planetf1 commented Feb 24, 2021

Create 2.7 release

  • slack post
  • agree in team call (late Feb 2021)
  • Create branch for 2.7
  • Reassign any issues not being worked on to the next release
  • Update master to 2.8-SNAPSHOT
  • Update ref to presentation server image in chart(s)
  • Ensure any remaining fixes are merged
  • Update branch version from 2.7-SNAPSHOT to 2.7
  • Remove release notes from branch
  • update release notes & rename
  • Verify notebooks (see Release 2.7 -queryKnownServers undefined early in Understanding Platform Services lab #4842)
  • Check polymer UI
  • Check node (ps) UI (see Glossary Author UI fails in egeria-base helm chart #4843)
  • Run CTS
  • Run FVTs
  • Check samples
  • Check swagger doc
  • Verify docker image/charts/compose
  • create release candidate (manual github action)
  • Verify RC packaging on MC
  • Fix up maven artifacts as needed
  • Create final github releases (launches pipeline)
  • Verify artifacts all on maven central
  • Release on maven central
  • ensure any fixes ported to master
@planetf1 planetf1 self-assigned this Feb 24, 2021
@planetf1
Copy link
Member Author

Note - this is the first release that will aim to use the new release pipeline - #4733
There may be a few teething issues & it's very likely any errant maven artifacts failing validation will need to be

@planetf1
Copy link
Member Author

master will be branched for 2.7 on Sun 27 Feb

planetf1 added a commit to planetf1/egeria that referenced this issue Feb 28, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
planetf1 added a commit to planetf1/egeria that referenced this issue Feb 28, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
planetf1 added a commit that referenced this issue Feb 28, 2021
#4734 update version to 2.8-SNAPSHOT
@planetf1
Copy link
Member Author

planetf1 commented Mar 1, 2021

Testing new release pipeline prior to continuing with testing ...

@planetf1
Copy link
Member Author

planetf1 commented Mar 2, 2021

Graph CTS results:

Date of conformance test:          2021-03-02T12:09:48.143+00:00
Number of tests that were run:     4965
Number of tests that failed:       0
Number of tests that were skipped: 0


id | name | description | profilePriority | conformanceStatus
-- | -- | -- | -- | --
0 | Metadata sharing | The technology under test is able to share met... | MANDATORY_PROFILE | CONFORMANT_FULL_SUPPORT
1 | Reference copies | The technology under test is able to save, loc... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
2 | Metadata maintenance | The technology under test supports requests to... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
3 | Dynamic types | The technology under test supports changes to ... | OPTIONAL_PROFILE | UNKNOWN_STATUS
4 | Graph queries | The technology under test supports graph-like ... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
5 | Historical search | The technology under test supports search for ... | OPTIONAL_PROFILE | CONFORMANT_NO_SUPPORT
6 | Entity proxies | The technology under test is able to store stu... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
7 | Soft-delete and restore | The technology under test allows an instance t... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
8 | Undo an update | The technology under test is able to restore a... | OPTIONAL_PROFILE | CONFORMANT_NO_SUPPORT
9 | Reidentify instance | The technology under test supports the command... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
10 | Retype instance | The technology under test supports the command... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
11 | Rehome instance | The technology under test supports the command... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
12 | Entity search | The technology under test supports the ability... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
13 | Relationship search | The technology under test supports the ability... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
14 | Entity advanced search | The technology under test supports the use of ... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT

In-mem CTS results:

Date of conformance test:          2021-03-02T12:10:52.831+00:00
Number of tests that were run:     4965
Number of tests that failed:       0
Number of tests that were skipped: 0


id | name | description | profilePriority | conformanceStatus
-- | -- | -- | -- | --
0 | Metadata sharing | The technology under test is able to share met... | MANDATORY_PROFILE | CONFORMANT_FULL_SUPPORT
1 | Reference copies | The technology under test is able to save, loc... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
2 | Metadata maintenance | The technology under test supports requests to... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
3 | Dynamic types | The technology under test supports changes to ... | OPTIONAL_PROFILE | UNKNOWN_STATUS
4 | Graph queries | The technology under test supports graph-like ... | OPTIONAL_PROFILE | CONFORMANT_PARTIAL_SUPPORT
5 | Historical search | The technology under test supports search for ... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
6 | Entity proxies | The technology under test is able to store stu... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
7 | Soft-delete and restore | The technology under test allows an instance t... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
8 | Undo an update | The technology under test is able to restore a... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
9 | Reidentify instance | The technology under test supports the command... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
10 | Retype instance | The technology under test supports the command... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
11 | Rehome instance | The technology under test supports the command... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
12 | Entity search | The technology under test supports the ability... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
13 | Relationship search | The technology under test supports the ability... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT
14 | Entity advanced search | The technology under test supports the use of ... | OPTIONAL_PROFILE | CONFORMANT_FULL_SUPPORT


@planetf1
Copy link
Member Author

planetf1 commented Mar 2, 2021

Notebooks test ok, except for where they are marked as incomplete. JUst one minor issue in #4842

@planetf1
Copy link
Member Author

planetf1 commented Mar 2, 2021

Note: Polymer UI tested only in terms of basic UI comes up and login works

planetf1 added a commit to planetf1/egeria that referenced this issue Mar 3, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
planetf1 added a commit to planetf1/egeria that referenced this issue Mar 3, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
planetf1 added a commit to planetf1/egeria that referenced this issue Mar 3, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
planetf1 added a commit that referenced this issue Mar 3, 2021
Release 2.7 - #4734 strip release notes & point to master
@planetf1
Copy link
Member Author

planetf1 commented Mar 3, 2021

@mandy-chessell I notice we don't have an updated implementation status map. Are you planning to update for 2.7? ie open-metadata-publication/website/roadmap/functional-organization-showing-implementation-status-for-2.7.png

@mandy-chessell @davidradl @yevgenmar @lcpopa @cmgrote @bogdan-sava @alexandra-bucur @grahamwallis @popa-raluca @marius-patrascu - you have all contributed to this release cc: @mstrelchuk @lpalashevski .

Could you all consider if there is anything you wish to add to the release notes .

I expect to send the code today so this needs to be actioned soon (though the content is in master and we link users back to it, so they'll still see updates).

Please paste the content below, or create a new PR.

@cmgrote
Copy link
Member

cmgrote commented Mar 3, 2021

I would say most of what I've contributed is "groundwork" for more significant refactoring that is only fully available in the next release -- so I'd wait on mine... One exception: the removal of the overloaded properties like length, minimumLength, etc per #4665 -- suggested wording:

"We have removed overloaded properties that existed at multiple levels in a type definition: for example, length was defined both on SchemaAttribute and again on RelationalColumn (which is a subtype of SchemaAttribute). This change removes them from being defined again the lower level (RelationalColumn in this example); however, the property itself will still be available at the lower level due to inheriting it from the supertype."

One that I know I will depend on in 2.7 is @mandy-chessell 's changes to allow a plugin-repository repository to be configured through the admin services (a new back-end like Crux), as something distinct from a repository-proxy (a mapped existing metadata repository like IGC, Atlas, etc).

@planetf1
Copy link
Member Author

planetf1 commented Mar 3, 2021

Samples all ok within their current implementations.

@planetf1
Copy link
Member Author

planetf1 commented Mar 4, 2021

Known Issues:

@mandy-chessell I presume you are going to aggregate and update

@planetf1
Copy link
Member Author

planetf1 commented Mar 4, 2021

Release 2.7 has now been released to maven central.

workflow was

  1. Create a release in github (I usually copy the release notes for the text)
    ... actions kicks off automatically & As expected it took around 50 mins to build & push to maven central.
  2. Login to oss.sonatype.org and navigate to staging repositories
  3. Inspect the maven artifacts (I'd already tested before)
  4. Click 'Close' to completion validating testing
    ... takes about 1 minute to go to closed, another 2 or so to allow the next action
  5. Click 'Release' to release to the world
    .. takes about 6-7 minutes to copy all files across

That's it. Compared to many days previously :-)
More could be automated, but it's better than before

I will hold off from posting to slack until we have the release notes updated

Note I've also done a github release on the egeria-react-ui repository. This creates tar files, but the docker images are already built by merge -- currently we don't redo these as part of any release pipeline -- there isn't one. An area for further thought in future as we gain more repositories

@planetf1
Copy link
Member Author

planetf1 commented Mar 4, 2021

Also worth noting that the artifacts are on maven central, but they take a while (hours-day) to be available via the front-facing index. This is as expected.

@grahamwallis
Copy link
Contributor

Small release note on the graph repository performance improvements:

Release 2.7 includes performance improvements to the graph repository's search methods, which select an efficient query strategy based on the properties and type filters supplied to the search

Is that enough?

@planetf1
Copy link
Member Author

planetf1 commented Mar 5, 2021

@grahamwallis unless you want to add any clarification as to the impact - though that's always tricky with performance. So I think it's ok

planetf1 added a commit to planetf1/egeria that referenced this issue Mar 5, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
planetf1 added a commit to planetf1/egeria that referenced this issue Mar 5, 2021
Signed-off-by: Nigel Jones <nigel.l.jones+git@gmail.com>
@grahamwallis
Copy link
Contributor

@planetf1 - agreed - performance figures would need to be very specific and we'd need to qualify them with machine specs etc etc. I don't think they would be all that interesting and wouldn't stay current for very long; also we don't publish performance figures for other aspects of the project. Suffice it to say that the graph queries that could benefit from the query changes got "much faster" :-)

planetf1 added a commit that referenced this issue Mar 5, 2021
@planetf1
Copy link
Member Author

planetf1 commented Mar 5, 2021

I have incorporated the comments so far - thanks.

@planetf1
Copy link
Member Author

planetf1 commented Mar 8, 2021

Releases have shipped and release notes have all the content available at the time
Release notes are in master so if anyone has additional updates feel free to update.
Closing.

@planetf1 planetf1 closed this as completed Mar 8, 2021
@planetf1 planetf1 added the release Work to create a new releae label Nov 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release Work to create a new releae
Projects
None yet
Development

No branches or pull requests

3 participants