Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Github actions -automated test suite #4745

Closed
3 tasks done
Tracked by #4578
Mayons95 opened this issue Oct 21, 2022 · 7 comments · Fixed by #4747, #4763, #4770 or #4784
Closed
3 tasks done
Tracked by #4578

Github actions -automated test suite #4745

Mayons95 opened this issue Oct 21, 2022 · 7 comments · Fixed by #4747, #4763, #4770 or #4784
Assignees
@mauceballos @Mayons95
Labels
type/enhancement Enhancement issue

Comments

@Mayons95
Copy link
Contributor

Mayons95 commented Oct 21, 2022 •
edited
Loading

This issue is created to track the effort to perform the necessary changes to execute the complete test execution with GitHub action.
With this working, the goal is to use GitHub actions to execute regression testing for the different kibana versions.

  • Review the errors displayed
  • Generate a complete test report
  • Close issue with reports of both platforms
@Mayons95 Mayons95 added the type/enhancement Enhancement issue label Oct 21, 2022
@Mayons95 Mayons95 mentioned this issue Oct 21, 2022
Closed
11 tasks
@Mayons95 Mayons95 linked a pull request Oct 21, 2022 that will close this issue
Fix/GitHub action for multi env #4744
Closed
@mauceballos
Copy link
Contributor

Analyzing the test cases that failed in the execution of the Action


       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  features/agents/add-agent-from-depl      00:53        1        1        -        -        - │
  │    oy-new-agent.feature                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/filters/add-filter-from-ag      08:51        8        8        -        -        - │
  │    ent-events.feature                                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/filters/add-filter-from-ag      07:37        8        8        -        -        - │
  │    ent.feature                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/filters/add-new-filter-fro      05:43        8        7        1        -        - │
  │    m-events.feature                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/filters/add-new-filter.fea      05:01        8        8        -        -        - │
  │    ture                                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/filters/pin-filter-from-da      05:49        8        8        -        -        - │
  │    shboard-to-events.feature                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/filters/pin-filter-from-ev      07:11        8        8        -        -        - │
  │    ents-to-events.feature                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/filters/pin-filter.feature      05:07        8        6        2        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/filters/remove-filter-from      03:55        8        7        1        -        - │
  │    -module-dashboard.feature                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/filters/remove-filter-from      05:13        9        8        1        -        - │
  │    -module-events.feature                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/filters/Search-by-paramete      02:43       10        -       10        -        - │
  │    rs.feature                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/decoders/create      00:52        1        1        -        -        - │
  │    -new-decoder.feature                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/decoders/edit-d      00:36        1        -        1        -        - │
  │    ecoders-without-saving.feature                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/decoders/should      01:21        3        3        -        -        - │
  │    -list-decoders-and-show-the-pager.f                                                         │
  │    eature                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/groups/edit-gro      00:43        1        1        -        -        - │
  │    ups-without-saving.feature                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/reporting/add-r      04:42        8        4        4        -        - │
  │    eport-from-modules-agent.feature                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/reporting/add-r      04:33        8        4        4        -        - │
  │    eport-from-modules.feature                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/rules/create-a-      00:50        1        1        -        -        - │
  │    new-rule.feature                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/rules/edit-rule      00:49        1        1        -        -        - │
  │    s-without-saving.feature                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/rules/filter-ru      00:37        1        -        1        -        - │
  │    les-is-displayed-after-refresh.feat                                                         │
  │    ure                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/rules/refresh-r      00:48        1        1        -        -        - │
  │    ules-page.feature                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/rules/should-li      01:05        2        2        -        -        - │
  │    st-rules-and-show-the-pager.feature                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/rules/should-li      00:38        1        -        1        -        - │
  │    st-rules-by-level.feature                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/rules/validate-      02:35        5        5        -        -        - │
  │    paginator.feature                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/rules/validator      02:11        5        5        -        -        - │
  │    -rows-dropdow.feature                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/settings/about.      00:46        1        -        1        -        - │
  │    feature                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/settings/api-co      02:06        3        2        1        -        - │
  │    nfigurations.feature                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/settings/config      00:46        1        -        1        -        - │
  │    uration.feature                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/settings/disabl      04:35       11        -       11        -        - │
  │    e-modules.feature                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/settings/enable      04:31       11        -       11        -        - │
  │    -modules.feature                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/settings/logs.f      01:10        2        2        -        -        - │
  │    eature                                                                                      │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  features/management/settings/miscel      00:38        1        -        1        -        - │
  │    laneous.feature                                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  features/management/settings/sample      01:45        2        2        -        -        - │
  │    -data.feature                                                                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  16 of 33 failed (48%)                  1:36:54      155      103       52        -        -

@Mayons95
Copy link
Contributor Author

Report from github action execution

Wazuh -Kibana-Action-Report.pdf

@Mayons95 Mayons95 removed a link to a pull request Oct 21, 2022
Fix/GitHub action for multi env #4744
Closed
@Mayons95 Mayons95 linked a pull request Oct 21, 2022 that will close this issue
Fix problems in the integration of Cypress and GitHub Actions #4747
Merged
@Mayons95
Copy link
Contributor Author

Report from github action execution 24-10

Reporte 24-10.pdf

@Mayons95
Copy link
Contributor Author

We created another PR to solve problems with Wazuh Dashboard login, being executed from Github actions
PR: #4763

@Mayons95 Mayons95 linked a pull request Oct 25, 2022 that will close this issue
Adding a validation to check environment #4763
Merged
@mauceballos
Copy link
Contributor

mauceballos commented Oct 27, 2022 •
edited
Loading

We created another PR to solve problems with Wazuh Dashboard close sessions, being executed from Github actions
PR: #4770

@mauceballos mauceballos mentioned this issue Oct 27, 2022
Merged
3 tasks
@AlexRuiz7 AlexRuiz7 linked a pull request Oct 28, 2022 that will close this issue
Fix after login #4770
Merged
3 tasks
@Mayons95
Copy link
Contributor Author

Kibana Excecution Report
Kibana Execution -28-10.pdf

@Mayons95 Mayons95 linked a pull request Oct 31, 2022 that will close this issue
Fixing login method for WZD #4784
Merged
@Mayons95
Copy link
Contributor Author

Mayons95 commented Nov 1, 2022

Wazuh Dashboard Local Report Execution
Mochawesome Report.pdf

@Mayons95 Mayons95 closed this as completed Nov 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mauceballos mauceballos

@Mayons95 Mayons95

Labels
type/enhancement Enhancement issue
Projects
None yet
Milestone
No milestone
2 participants
@mauceballos @Mayons95