Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.8.0 - Alpha 2 - Wazuh UI regression testing #6307

Closed
1 task done
asteriscos opened this issue Jan 12, 2024 · 3 comments
Closed
1 task done

Release 4.8.0 - Alpha 2 - Wazuh UI regression testing #6307

asteriscos opened this issue Jan 12, 2024 · 3 comments
Assignees
Labels
level/task Task issue type/test Test issue

Comments

@asteriscos
Copy link
Member

asteriscos commented Jan 12, 2024

The following issue aims to run manual tests for the current release candidate, report the results, and open new issues for any encountered errors.

Wazuh UI tests information

Main release candidate issue wazuh/wazuh#21386
Version 4.8.0
Release candidate # Alpha 2
Tag v4.8.0-2.10.0-alpha2
Previous UI regression tests issue #6219

Test report procedure

TL;DR

  1. The specified tests will be executed in every platform and version mentioned in this issue.
  2. Include evidence of each test performed.
  3. Report any problem or bug. Open a new issue for each of them and link them here.
  4. Justify skipped tests.

All test results must have one the following statuses:

The test hasn't started yet.
🟢 All checks passed.
🔴 There is at least one failed check.
🟡 There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause.
It must be included in the Problems section of the current release candidate issue.

Any expected fail or skipped test must be justified with a reason.
All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip, txt or images.
This report can be used by the auditors to dig deeper into any possible failures and details.

Test template

Test Chrome Firefox Safari
-

Test plan

  1. Verify the app package installs and operates as expected.
  2. Integrate our menu into the platform global navigation drawer
  3. Update dashboards
  4. Added the ability to check if there are available updates from the UI
  5. Added remember server address check
  6. Added the ssl_agent_ca configuration to the SSL Settings form
  7. Added global vulnerabilities dashboards
  8. Added query results limit when the search exceed 10000 hits
  9. Added an agent selector to the IT Hygiene application
  10. Added a redirection button to Endpoint Summary from IT Hygiene application
  11. Change the display order of tabs in all modules
  12. Fixed a problem with the agent menu header when the side menu is docked
  13. Fixed how the query filters apply on the Security Alerts table
  14. Fixed pinned agent state in URL
  15. Fixed exception in IT-Hygiene when an agent doesn't have policies
  16. Fixed exception in Inventory when agents don't have OS information
  17. Fixed invalid date format in about and agent views
  18. Removed the disabled_roles setting
  19. Removed the customization.logo.sidebar setting
  20. Removed the ability to configure the visibility of modules and removed extensions.* settings
  21. Removed the application menu in the IT Hygiene application
  22. Removed the implicit filter of WQL language of the search bar UI

Conclusions

In general everything is fine, but some bugs have been found, and the corresponding issues have been created.

Test Chrome Firefox Safari
Verify the app package installs and operates as expected. 🟢 🟢
Global Menu 🟢 🟢
Update dashboards 🟢 🟢
Added the ability to check if there are available updates from the UI 🟢 🟢
Added remember server address check 🟢 🟢
Added the ssl_agent_ca configuration to the SSL Settings form 🟢 🟢
Added global vulnerabilities dashboards 🔴 🔴
Added query results limit when the search exceed 10000 hits 🔴 🔴
Added an agent selector to the IT Hygiene application 🟢 🟢
Added a redirection button to Endpoint Summary from IT Hygiene application 🟢 🟢
Change the display order of tabs in all modules 🟢 🟢
Fixed a problem with the agent menu header when the side menu is docked 🟢 🟢
Fixed how the query filters apply on the Security Alerts table 🟢 🟢
Fixed pinned agent state in URL 🟢 🟢
Fixed exception in IT-Hygiene when an agent doesn't have policies 🟢 🟢
Fixed exception in Inventory when agents don't have OS information 🟢 🟢
Fixed invalid date format in about and agent views 🟢 🟢
Removed the disabled_roles settings 🟢 🟢
Removed the customization.logo.sidebar settings 🟢 🟢
Removed the ability to configure the visibility of modules and removed extensions.* settings 🟢 🟢
Removed the application menu in the IT Hygiene application 🟢 🟢
Removed the implicit filter of WQL language of the search bar UI 🟢 🟢

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted to close this issue.

@asteriscos asteriscos added type/test Test issue level/task Task issue labels Jan 12, 2024
@wazuhci wazuhci moved this to Backlog in Release 4.8.0 Jan 12, 2024
@wazuhci wazuhci moved this from Backlog to In progress in Release 4.8.0 Jan 12, 2024
@yenienserrano yenienserrano self-assigned this Jan 15, 2024
@yenienserrano
Copy link
Member

yenienserrano commented Jan 15, 2024

Test

  1. Verify the app package installs and operates as expected.
  2. Integrate our menu into the platform global navigation drawer
  3. Update dashboards
  4. Added the ability to check if there are available updates from the UI
  5. Added remember server address check
  6. Added the ssl_agent_ca configuration to the SSL Settings form
  7. Added global vulnerabilities dashboards
  8. Added query results limit when the search exceed 10000 hits
  9. Added an agent selector to the IT Hygiene application
  10. Added a redirection button to Endpoint Summary from IT Hygiene application
  11. Change the display order of tabs in all modules
  12. Fixed a problem with the agent menu header when the side menu is docked
  13. Fixed how the query filters apply on the Security Alerts table
  14. Fixed pinned agent state in URL
  15. Fixed exception in IT-Hygiene when an agent doesn't have policies
  16. Fixed exception in Inventory when agents don't have OS information
  17. Fixed invalid date format in about and agent views
  18. Removed the disabled_roles setting
  19. Removed the customization.logo.sidebar setting
  20. Removed the ability to configure the visibility of modules and removed extensions.* settings
  21. Removed the application menu in the IT Hygiene application
  22. Removed the implicit filter of WQL language of the search bar UI
Test Chrome Firefox Safari
Verify the app package installs and operates as expected. 🟢 🟢
Global Menu 🟢 🟢
Update dashboards 🟢 🟢
Added the ability to check if there are available updates from the UI 🟢 🟢
Added remember server address check 🟢 🟢
Added the ssl_agent_ca configuration to the SSL Settings form 🟢 🟢
Added global vulnerabilities dashboards 🔴 🔴
Added query results limit when the search exceed 10000 hits 🔴 🔴
Added an agent selector to the IT Hygiene application 🟢 🟢
Added a redirection button to Endpoint Summary from IT Hygiene application 🟢 🟢
Change the display order of tabs in all modules 🟢 🟢
Fixed a problem with the agent menu header when the side menu is docked 🟢 🟢
Fixed how the query filters apply on the Security Alerts table 🟢 🟢
Fixed pinned agent state in URL 🟢 🟢
Fixed exception in IT-Hygiene when an agent doesn't have policies 🟢 🟢
Fixed exception in Inventory when agents don't have OS information 🟢 🟢
Fixed invalid date format in about and agent views 🟢 🟢
Removed the disabled_roles settings 🟢 🟢
Removed the customization.logo.sidebar settings 🟢 🟢
Removed the ability to configure the visibility of modules and removed extensions.* settings 🟢 🟢
Removed the application menu in the IT Hygiene application 🟢 🟢
Removed the implicit filter of WQL language of the search bar UI 🟢 🟢

Verify the app package installs and operates as expected.

🟢 Chrome

image

image

🟢 Firefox

image

image

Global Menu

🟢 Chrome

Overview 🟢

image

Discover 🟢

image

Visualize 🟢

image

Reports 🟢

image

Configuration Assessment 🟢

image

Malware detection 🟢

image

FIM 🟢

image

Threat hunting 🟢

image

Vulnerabilities 🟢

image

Mitre att&ck 🟢

image

Virus total 🟢

image

PCI DSS 🟢

image

GDPR 🟢

image

HIPAA 🟢

image

NIST 800-53 🟢

image

TSC 🟢

image

IT Hygiene 🟢

image

Docker 🟢

image

Amazon Web Services 🟢

image

Google Cloud 🟢

image

Github 🟢

image

Office365 🟢

image

Endpoints summary 🟢

image

Endpoints groups 🟢

image

Rules 🟢

image

Decoders 🟢

image

CDB Lists 🟢

image

Status 🟢

image

Cluster 🟢

image

Statistics 🟢

image

Logs 🟢

image

Settings 🟢

image

Devtools 🟢

image

Ruleset test 🟢

image

Security 🟢

image

Reporting 🟢

image

Server APIs 🟢

image

Sample data 🟢

image

App settings 🟢

image

App logs 🟢

image

About 🟢

image

🟢 Firefox

Overview 🟢

image

Discover 🟢

image

Visualize 🟢

image

Reports🟢

image

Configuration Assessment 🟢

image

Malware detection 🟢

image

FIM 🟢

image

Threat hunting🟢

image

Vulnerabilities 🟢

image

Mitre att&ck 🟢

image

Virus total 🟢

image

PCI DSS 🟢

image

GDPR 🟢

image

HIPAA🟢

image

NIST 800-53🟢

image

TSC 🟢

image

IT Hygiene 🟢

image

Docker 🟢

image

Amazon Web Services 🟢

image

Google Cloud🟢

image

Github 🟢

image

Office365 🟢

image

Endpoints summary 🟢

image

Endpoints groups 🟢

image

Rules🟢

image

Decoders 🟢

image

CDB Lists 🟢

image

Status 🟢

image

Cluster 🟢

image

Statistics 🟢

image

Logs 🟢

image

Settings 🟢

image

Devtools 🟢

image

Ruleset test 🟢

image

Security 🟢

image

Reporting 🟢

image

Server APIs 🟢

image

Sample data🟢

image

App settings 🟢

image

App logs 🟢

image

About 🟢

image

Update dashboards

🟢 Chrome

Configuration assessment

image

Malware detection

image

Vulnerability detection

Docker

image

🟢 Firefox

Configuration assessment

image

Malware detection

image

Vulnerability detection

Docker

image

Added the ability to check if there are available updates from the UI

🟢 Chrome

image

🟢 Firefox

image

Added remember server address check

🟢 Chrome

image

🟢 Firefox

image

Added the ssl_agent_ca configuration to the SSL Settings form

🟢Chrome

image

🟢Firefox

image

Added global vulnerabilities dashboards

🔴 Chrome

Check that the dashboard tab looks like the reference in the comment 🔴

when a panel is maximized, the whole panel cannot be seen or the information is overlapped

image
image
image
image

Check that the inventory tab looks like the reference in the comment 🟢

image

Use search bar input to filter any word and check if the dashboard shows the corresponding results 🟢

image

Select an option from one of the recommended filters and check that the corresponding filter is added and the dashboard changes according to the applied filter. 🟢

image

Add a filter through interaction with a visualization and check that the dashboard updates 🟢

image
image

Add a filter on search bar and the dashboard changes according to the applied filter 🟢

image
image

Use search bar input to filter any word and check if the table shows the corresponding results 🔴

when filtering by a field that has few results and then by one that has many results you have to scroll down the page to see the number of pages.

image
image
image

Use the input and type an incorrect word to check if the no results message is shown 🟢

image

Use the add filters button, select any filter and check if the table shows the corresponding results. 🟢

image
image

Use the page and rows per page selector, and check if is working as expected 🟢

image
image

Use the data grid toolbar controls functionality (columns selector, density, sort fields, full screen) and Use the header columns controls (column visibility, column sorting, column position).

Columns selector 🟢
image

Density 🟢
image

Sort fields 🟢
image

Exit full screen 🔴

part of the table is hidden behind the menu when it is fixed.

image
image

Export Formated 🟢

image

Click on the inspect document button and check the flyout functionality, the details must show the row clicked on the table 🟢

image
image

🔴 Firefox

Check that the dashboard tab looks like the reference in the comment 🔴

image

when a panel is maximized, the whole panel cannot be seen or the information is overlapped

image
image

Check that the inventory tab looks like the reference in the comment 🟢

image

Use search bar input to filter any word and check if the dashboard shows the corresponding results 🟢

image

Select an option from one of the recommended filters and check that the corresponding filter is added and the dashboard changes according to the applied filter. 🟢

image

Add a filter through interaction with a visualization and check that the dashboard updates 🟢

image

Add a filter on search bar and the dashboard changes according to the applied filter 🟢

image
image

Use search bar input to filter any word and check if the table shows the corresponding results 🔴

when filtering by a field that has few results and then by one that has many results you have to scroll down the page to see the number of pages.

image
image
image

Use the input and type an incorrect word to check if the no results message is shown 🟢

image

Use the add filters button, select any filter and check if the table shows the corresponding results. 🟢

image
image

Use the page and rows per page selector, and check if is working as expected 🟢

image
image

Use the data grid toolbar controls functionality (columns selector, density, sort fields, full screen) and Use the header columns controls (column visibility, column sorting, column position). 🟢

Columns selector🟢
image

Density🟢
image

Sort fields🟢
image

Exit full screen 🔴

part of the table is hidden behind the menu when it is fixed.

image
image

Export Formated 🟢

image

Click on the inspect document button and check the flyout functionality, the details must show the row clicked on the table 🟢

image
image

Added query results limit when the search exceed 10000 hits

🔴 Chrome

image

The refresh button does not update the information.

Wazuh.-.Wazuh.-.Google.Chrome.2024-01-16.17-02-31.mp4
🔴 Firefox

image

The refresh button does not update the information.

Wazuh.-.Wazuh.-.Google.Chrome.2024-01-16.17-02-31.mp4

Added an agent selector to the IT Hygiene application

🟢Chrome

image

🟢 Firefox

image

Added a redirection button to Endpoint Summary from IT Hygiene application

🟢Chrome

image

🟢Firefox

image

Change the display order of tabs in all modules

🟢 Chrome

Configuration Assessment
image

Malware Detection
image

FIM
image

Threat Hunting
image

Vulnerability
image

Mitre Attack
image

Virustotal
image

PCIDSS
image

GDPR
image

HIPAA
image

NIST
image

TSC
image

Docker
image

AWS
image

Google Cloud
image

GitHub
image

Office 365
image

🟢 Firefox

Configuration Assessment
image

Malware Detection
image

FIM
image

Threat Hunting
image

Vulnerability
image

Mitre Attack
image

Virustotal
image

PCIDSS
image

GDPR
image

HIPAA
image

NIST
image

TSC
image

Docker
image

AWS
image

Google Cloud
image

GitHub
image

Office 365
image

Fixed a problem with the agent menu header when the side menu is docked

🟢 Chrome

image

🟢 Firefox

image

Fixed how the query filters apply on the Security Alerts table

🟢 Chrome
Wazuh.-.Wazuh.-.Google.Chrome.2024-01-15.18-08-29.mp4
🟢 Firefox
Wazuh.-.Wazuh.Mozilla.Firefox.2024-01-15.18-09-21.mp4

Fixed pinned agent state in URL

🟢 Chrome

Peek 2024-01-16 12-56

🟢 Firefox

Peek 2024-01-16 12-59

Fixed exception in IT-Hygiene when an agent doesn't have policies

🟢 Chrome

Screenshot from 2024-01-16 16-59-27

🟢 Firefox

Screenshot from 2024-01-16 15-12-23

Fixed exception in Inventory when agents don't have OS information

🟢 Chrome

Screenshot from 2024-01-16 14-26-46

🟢 Firefox

image

Fixed invalid date format in about and agent views

🟢 Chrome

image

image

image

🟢 Firefox

image

image

image

Removed the disabled_roles settings

🟢 Chrome

image

🟢 Firefox

image

Removed the customization.logo.sidebar settings

🟢 Chrome

image

🟢 Firefox

image

Removed the ability to configure the visibility of modules and removed extensions.* settings

🟢 Chrome

This setting has been removed:

In previous versions:
image

In 4.8.0 is no longer available:
image

🟢 Firefox

In previous versions:
image

In 4.8.0 is no longer available:
image

Removed the application menu in the IT Hygiene application

🟢 Chrome

image

🟢 Firefox

image

Removed the implicit filter of WQL language of the search bar UI

🟢 Chrome

Screenshot from 2024-01-15 17-23-01

🟢 Firefox

image

@yenienserrano yenienserrano reopened this Jan 15, 2024
@wazuhci wazuhci moved this from In progress to Pending final review in Release 4.8.0 Jan 16, 2024
@wazuhci wazuhci moved this from Pending final review to In final review in Release 4.8.0 Jan 17, 2024
@juliamagan
Copy link
Member

juliamagan commented Jan 17, 2024

As the reported errors are new, they should be 🔴, not 🟡. Please update it.

@wazuhci wazuhci moved this from In final review to On hold in Release 4.8.0 Jan 17, 2024
@juliamagan
Copy link
Member

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
level/task Task issue type/test Test issue
Projects
No open projects
Status: Done
Development

No branches or pull requests

4 participants