Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.4.0 - Pre RC1 - Kibana UI regression testing #5180

Closed
5 tasks done
Tracked by #4886
Tostti opened this issue Jan 27, 2023 · 8 comments
Closed
5 tasks done
Tracked by #4886

Release 4.4.0 - Pre RC1 - Kibana UI regression testing #5180

Tostti opened this issue Jan 27, 2023 · 8 comments
Assignees

Comments

@Tostti
Copy link
Member

Tostti commented Jan 27, 2023

Description

This issue aims to track the effort to perform complete regression testing on Wazuh App 4.4.0 rev 01 for RC1

Test Chrome Safari Firefox Package
Example test 🟒/πŸ”΄ 🟒/πŸ”΄ 🟒/πŸ”΄ 🟒/πŸ”΄

Status legend

⚫ - None
πŸ”΄ - Rejected
🟒 - Approved

In the case of πŸ”΄, create and add the issue to the Bug Tracking section.

Testing plan

Testing notes

  1. All the mentioned versions will be tested
  2. It's necessary to include evidence of each test performed
  3. In case to identify a bug/problem, the new feature should be linked to this issue
  • 7.17.8
  • 7.17.7
  • 7.16.3
  • 7.10.2
  • WzD 4.4.0-01

Testing template: template_testing_4.4.0-RC1.md

Errors found

@Tostti Tostti added type/enhancement Enhancement issue and removed type/enhancement Enhancement issue labels Jan 27, 2023
@Tostti
Copy link
Member Author

Tostti commented Jan 27, 2023

7.17.7

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari Package
Office365 and Github Panel information tab 🟒 🟒 ⚫ 7.17.7
Disable sync information in agent table by default 🟒 🟒 ⚫ 7.17.7
Alerts Summary table results truncated 🟒 🟒 ⚫ 7.17.7
The "Deploy a new agent" section misleads users with an all-in-one deployment 🟒 🟒 ⚫ 7.17.7
Missing packages inventory on Solaris agents 🟒 🟒 ⚫ 7.17.7
Deploy new agent - repeated requests 🟒 🟒 ⚫ 7.17.7
Render button with different styles in events 🟒 🟒 ⚫ 7.17.7
Mapper parsing exception in demo dashboard 🟒 🟒 ⚫ 7.17.7

Details

🟒 Office365 and Github Panel information tab

Chrome - 🟒

Chrome.mp4

Firefox - 🟒

Firefox.1.mp4

Safari - ⚫

🟒 Disable sync information in agent table by default

Chrome - 🟒
imagen
imagen
imagen

Firefox - ⚫
imagen
imagen
imagen

Safari - 🟒

🟒 Alerts Summary table results truncated

Chrome - 🟒

No agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

With agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

Module With pinned agent Without agent Allowed agents with pinned agent Allowed agent without pinned agent
Security events 🟒 🟒 🟒 🟒
Integrity monitoring 🟒 🟒 🟒 🟒
Office 365 βšͺ 🟒 βšͺ 🟒
Amazon AWS 🟒 🟒 🟒 🟒
Google Cloud Platform 🟒 🟒 🟒 🟒
GitHub 🟒 🟒 🟒 🟒
Policy monitoring 🟒 🟒 🟒 🟒
Security configuration assessment βšͺ βšͺ βšͺ βšͺ
System auditing 🟒 🟒 🟒 🟒
OpenSCAP 🟒 🟒 🟒 🟒
CIS-CAT 🟒 🟒 🟒 🟒
Vulnerabilities βšͺ βšͺ βšͺ βšͺ
MITRE ATT&CK 🟒 🟒 🟒 🟒
VirusTotal 🟒 🟒 🟒 🟒
Osquery 🟒 🟒 🟒 🟒
Docker listener 🟒 🟒 🟒 🟒
PCI DSS 🟒 🟒 🟒 🟒
NIST 800-53 🟒 🟒 🟒 🟒
GDPR 🟒 🟒 🟒 🟒
HIPAA 🟒 🟒 🟒 🟒
TSC 🟒 🟒 🟒 🟒

Checked when the allowed agents should appear and it is working as expected. Verified the next cases:

case result
With pinned agent 🟒
Without pinned agent 🟒
With pinned agent and allowed agents 🟒
Without pinned agent and allowed agents 🟒

Firefox - 🟒

No agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

With agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

Module With pinned agent Without agent Allowed agents with pinned agent Allowed agent without pinned agent
Security events 🟒 🟒 🟒 🟒
Integrity monitoring 🟒 🟒 🟒 🟒
Office 365 βšͺ 🟒 βšͺ 🟒
Amazon AWS 🟒 🟒 🟒 🟒
Google Cloud Platform 🟒 🟒 🟒 🟒
GitHub 🟒 🟒 🟒 🟒
Policy monitoring 🟒 🟒 🟒 🟒
Security configuration assessment βšͺ βšͺ βšͺ βšͺ
System auditing 🟒 🟒 🟒 🟒
OpenSCAP 🟒 🟒 🟒 🟒
CIS-CAT 🟒 🟒 🟒 🟒
Vulnerabilities βšͺ βšͺ βšͺ βšͺ
MITRE ATT&CK 🟒 🟒 🟒 🟒
VirusTotal 🟒 🟒 🟒 🟒
Osquery 🟒 🟒 🟒 🟒
Docker listener 🟒 🟒 🟒 🟒
PCI DSS 🟒 🟒 🟒 🟒
NIST 800-53 🟒 🟒 🟒 🟒
GDPR 🟒 🟒 🟒 🟒
HIPAA 🟒 🟒 🟒 🟒
TSC 🟒 🟒 🟒 🟒

Checked when the allowed agents should appear and it is working as expected. Verified the next cases:

case result
With pinned agent 🟒
Without pinned agent 🟒
With pinned agent and allowed agents 🟒
Without pinned agent and allowed agents 🟒

Safari - ⚫

🟒 The "Deploy a new agent" section misleads users with an all-in-one deployment

Chrome - 🟒

TCP

imagen
imagen

UDP

imagen
imagen

Firefox - 🟒

TCP

imagen
imagen

UDP

imagen
imagen

Safari - ⚫

🟒 Missing packages inventory on Solaris agents

Chrome - 🟒

Solaris 10

imagen

Solaris 11

imagen

Firefox - 🟒

Solaris 10

imagen

Solaris 11

imagen

Safari - ⚫

🟒 Deploy new agent - repeated requests

Chrome - 🟒

Chrome.mp4

Firefox - 🟒

Firefox.mp4

Safari - ⚫

🟒 Render button with different styles in events

Chrome - 🟒

Discover

imagen
imagen

Wazuh

imagen
imagen

Firefox - 🟒

Discover

imagen
imagen

Wazuh

imagen
imagen

Safari - ⚫

🟒 Mapper parsing exception in demo dashboard

Chrome - 🟒
imagen
imagen

Firefox - 🟒
imagen
imagen

Safari - ⚫

@Machi3mfl Machi3mfl self-assigned this Jan 27, 2023
@Machi3mfl
Copy link
Member

Machi3mfl commented Jan 30, 2023

7.16.3

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari Package
Office365 and Github Panel information tab 🟒 🟒 ⚫ 7.16.3
Disable sync information in agent table by default 🟒 🟒 ⚫ 7.16.3
Alerts Summary table results truncated 🟒 🟒 ⚫ 7.16.3
The "Deploy a new agent" section misleads users with an all-in-one deployment 🟒 ⚫ ⚫ 7.16.3
Missing packages inventory on Solaris agents ⚫ ⚫ ⚫ 7.16.3
Deploy new agent - repeated requests 🟒 🟒 ⚫ 7.16.3
Render button with different styles in events πŸ”΄ πŸ”΄ ⚫ 7.16.3
Mapper parsing exception in demo dashboard 🟒 🟒 ⚫ 7.16.3

Details

🟒 Office365 and Github Panel information tab

Chrome - 🟒 :

Kazam_screencast_00013.mp4

Firefox - 🟒

Kazam_screencast_00000.mp4

Safari - ⚫

🟒 Disable sync information in agent table by default

Chrome - 🟒

image

image

Firefox - 🟒

image

image

Safari - ⚫

🟒 Alerts Summary table results truncated

Chrome - 🟒

image

image

Firefox - 🟒

image

image

Safari - ⚫

🟒 The "Deploy a new agent" section misleads users with an all-in-one deployment

Chrome - 🟒

Kazam_screencast_00001.mp4

Firefox - 🟒

Kazam_screencast_00002.mp4

Safari - ⚫

⚫ Missing packages inventory on Solaris agents

Chrome - ⚫

Firefox - ⚫

Safari - ⚫

🟒 Deploy new agent - repeated requests

Chrome - 🟒

Kazam_screencast_00003.mp4

Firefox - 🟒

Kazam_screencast_00004.mp4

Safari - ⚫

🟒 Render button with different styles in events

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

After the fix

Kazam_screencast_00007.mp4
🟒 Mapper parsing exception in demo dashboard

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

@chantal-kelm
Copy link
Member

chantal-kelm commented Jan 30, 2023

7.17.8

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari Package
Office365 and Github Panel information tab 🟒 🟒 🟒 7.17.8
Disable sync information in agent table by default 🟒 🟒 🟒 7.17.8
Alerts Summary table results truncated 🟒 🟒 🟒 7.17.8
The "Deploy a new agent" section misleads users with an all-in-one deployment 🟒 🟒 🟒 7.17.8
Missing packages inventory on Solaris agents 🟒 🟒 🟒 7.17.8
Deploy new agent - repeated requests 🟒 🟒 🟒 7.17.8
Render button with different styles in events πŸ”΄ πŸ”΄ πŸ”΄ 7.17.8
Mapper parsing exception in demo dashboard 🟒 🟒 🟒 7.17.8

Details

🟒 Office365 and Github Panel information tab

Chrome - 🟒

Grabacion.de.pantalla.2023-01-30.a.la.s.11.57.45.mov

Firefox - 🟒

Grabacion.de.pantalla.2023-01-30.a.la.s.12.00.04.mov

Safari - 🟒

Grabacion.de.pantalla.2023-01-30.a.la.s.12.01.15.mov
🟒 Disable sync information in agent table by default

Chrome - 🟒

image image image

Firefox - 🟒

image image image

Safari - 🟒

image image
🟒 Alerts Summary table results truncated

Chrome - 🟒

image image

Firefox - 🟒

image image

Safari - 🟒

image image
🟒 The "Deploy a new agent" section misleads users with an all-in-one deployment

Chrome - 🟒

image image

Firefox - 🟒

image image

Safari - 🟒

image image
🟒 Missing packages inventory on Solaris agents

Chrome - 🟒

image image image

Firefox - 🟒

image image image

Safari - 🟒

image image
🟒 Deploy new agent - repeated requests

Chrome - 🟒

Grabacion.de.pantalla.2023-01-30.a.la.s.12.19.18.mov

Firefox - 🟒

Grabacion.de.pantalla.2023-01-30.a.la.s.12.20.22.mov

Safari - 🟒

Grabacion.de.pantalla.2023-01-30.a.la.s.12.21.49.mov
πŸ”΄ Render button with different styles in events

Chrome - πŸ”΄

image image

Firefox - πŸ”΄

image image

Safari - πŸ”΄

image image
🟒 Mapper parsing exception in demo dashboard

🟒 Cluster mode OFF

image

Chrome - 🟒

image image image image

Firefox - 🟒

image image image

Safari - 🟒

image image image image

🟒 Cluster mode ON

image

Chrome - 🟒

image image image image

Firefox - 🟒

image image image image

Safari - 🟒

image image image image

@Machi3mfl
Copy link
Member

Wazuh Dashboard 2.4.1

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari Package
Office365 and Github Panel information tab 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1
Disable sync information in agent table by default 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1
Alerts Summary table results truncated 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1
The "Deploy a new agent" section misleads users with an all-in-one deployment 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1
Missing packages inventory on Solaris agents ⚫ ⚫ ⚫ Wazuh Dashboard 2.4.1
Deploy new agent - repeated requests 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1
Render button with different styles in events 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1
Mapper parsing exception in demo dashboard 🟒 🟒 ⚫ Wazuh Dashboard 2.4.1

Details

🟒 Office365 and Github Panel information tab

Chrome - 🟒 :

image

Firefox - 🟒

image

Safari - ⚫

🟒 Disable sync information in agent table by default

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

🟒 Alerts Summary table results truncated

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

🟒 The "Deploy a new agent" section misleads users with an all-in-one deployment

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

⚫ Missing packages inventory on Solaris agents

Chrome - ⚫

Firefox - ⚫

Safari - ⚫

🟒 Deploy new agent - repeated requests

Chrome - 🟒

image

Firefox - 🟒

Kazam_screencast_00005.mp4

Safari - ⚫

🟒 Render button with different styles in events

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

🟒 Mapper parsing exception in demo dashboard

Chrome - 🟒

image

Firefox - 🟒

image

Safari - ⚫

@Tostti
Copy link
Member Author

Tostti commented Jan 31, 2023

7.10.2 (ODFE)

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari Package
Office365 and Github Panel information tab 🟒 🟒 ⚫ 7.10.2
Disable sync information in agent table by default 🟒 🟒 ⚫ 7.10.2
Alerts Summary table results truncated 🟒 🟒 ⚫ 7.10.2
The "Deploy a new agent" section misleads users with an all-in-one deployment 🟒 🟒 ⚫ 7.10.2
Missing packages inventory on Solaris agents 🟒 🟒 ⚫ 7.10.2
Deploy new agent - repeated requests 🟒 🟒 ⚫ 7.10.2
Render button with different styles in events 🟒 🟒 ⚫ 7.10.2
Mapper parsing exception in demo dashboard 🟒 🟒 ⚫ 7.10.2

Details

🟒 Office365 and Github Panel information tab

Chrome - 🟒
imagen
imagen

Firefox - 🟒
imagen
imagen

Safari - ⚫

🟒 Disable sync information in agent table by default

Chrome - 🟒

imagen
imagen
imagen

Firefox - 🟒
imagen
imagen
imagen

Safari - ⚫

🟒 Alerts Summary table results truncated

Chrome - 🟒

No agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

With agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

Module With pinned agent Without agent Allowed agents with pinned agent Allowed agent without pinned agent
Security events 🟒 🟒 🟒 🟒
Integrity monitoring 🟒 :gree_circle: 🟒 🟒
Office 365 βšͺ 🟒 βšͺ 🟒
Amazon AWS 🟒 🟒 🟒 🟒
Google Cloud Platform 🟒 🟒 🟒 🟒
GitHub 🟒 🟒 🟒 🟒
Policy monitoring 🟒 🟒 🟒 🟒
Security configuration assessment βšͺ βšͺ βšͺ βšͺ
System auditing 🟒 🟒 🟒 🟒
OpenSCAP 🟒 🟒 🟒 🟒
CIS-CAT 🟒 🟒 🟒 🟒
Vulnerabilities βšͺ βšͺ βšͺ βšͺ
MITRE ATT&CK 🟒 🟒 🟒 🟒
VirusTotal 🟒 🟒 🟒 🟒
Osquery 🟒 🟒 🟒 🟒
Docker listener 🟒 🟒 🟒 🟒
PCI DSS 🟒 🟒 🟒 🟒
NIST 800-53 🟒 🟒 🟒 🟒
GDPR 🟒 🟒 🟒 🟒
HIPAA 🟒 🟒 🟒 🟒
TSC 🟒 🟒 🟒 🟒

Checked when the allowed agents should appear and it is working as expected. Verified the next cases:

case result
With pinned agent 🟒
Without pinned agent 🟒
With pinned agent and allowed agents 🟒
Without pinned agent and allowed agents 🟒

Firefox - 🟒

No agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

With agent read limitation

No pinned agent

imagen
imagen

Pinned agent

imagen
imagen

Module With pinned agent Without agent Allowed agents with pinned agent Allowed agent without pinned agent
Security events 🟒 🟒 🟒 🟒
Integrity monitoring 🟒 🟒 🟒 🟒
Office 365 βšͺ 🟒 βšͺ 🟒
Amazon AWS 🟒 🟒 🟒 🟒
Google Cloud Platform 🟒 🟒 🟒 🟒
GitHub 🟒 🟒 🟒 🟒
Policy monitoring 🟒 🟒 🟒 🟒
Security configuration assessment βšͺ βšͺ βšͺ βšͺ
System auditing 🟒 🟒 🟒 🟒
OpenSCAP 🟒 🟒 🟒 🟒
CIS-CAT 🟒 🟒 🟒 🟒
Vulnerabilities βšͺ βšͺ βšͺ βšͺ
MITRE ATT&CK 🟒 🟒 🟒 🟒
VirusTotal 🟒 🟒 🟒 🟒
Osquery 🟒 🟒 🟒 🟒
Docker listener 🟒 🟒 🟒 🟒
PCI DSS 🟒 🟒 🟒 🟒
NIST 800-53 🟒 🟒 🟒 🟒
GDPR 🟒 🟒 🟒 🟒
HIPAA 🟒 🟒 🟒 🟒
TSC 🟒 🟒 🟒 🟒

Checked when the allowed agents should appear and it is working as expected. Verified the next cases:

case result
With pinned agent 🟒
Without pinned agent 🟒
With pinned agent and allowed agents 🟒
Without pinned agent and allowed agents 🟒

Safari - ⚫

🟒 The "Deploy a new agent" section misleads users with an all-in-one deployment

Chrome - 🟒

TCP

imagen
imagen

UDP

imagen
imagen

Firefox - 🟒

TCP

imagen
imagen

UDP

imagen
imagen

Safari - ⚫

🟒 Missing packages inventory on Solaris agents

Chrome - 🟒

Solaris 10

imagen

Solaris 11

imagen

Firefox - 🟒

Solaris 10

imagen

Solaris 11

imagen

Safari - ⚫

🟒 Deploy new agent - repeated requests

Chrome - 🟒

Chrome.1.mp4

Firefox - 🟒

Firefox.1.mp4

Safari - ⚫

🟒 Render button with different styles in events Chrome - 🟒

Discover

imagen
imagen

Wazuh

imagen
imagen

Firefox - 🟒

Discover

imagen
imagen

Wazuh

imagen
imagen
Safari - ⚫

🟒 Mapper parsing exception in demo dashboard

Chrome - 🟒
imagen
imagen

Firefox - 🟒
imagen
imagen

Safari - ⚫

@Desvelao
Copy link
Member

Desvelao commented Feb 1, 2023

New packages were created for Kibana 7.16-7.17 with a change that was not included in the previous package.

Related to #5180 (comment)

7.17.8

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari
Render button with different styles in events 🟒 🟒 ⚫

Details

🟒 Render button with different styles in events

Chrome - 🟒
image
image

Firefox - 🟒
image
image

Safari - ⚫

@Desvelao
Copy link
Member

Desvelao commented Feb 1, 2023

New packages were created for Kibana 7.16-7.17 with a change that was not included in the previous package.

Related to #5180 (comment)

7.16.3

Legend:
⚫: none
🟒: passed
πŸ”΄: failed
🟑: warning
βšͺ: not applicable

Test Chrome Firefox Safari
Render button with different styles in events 🟒 🟒 ⚫

Details

🟒 Render button with different styles in events

Chrome - 🟒
image
image
image

Firefox - 🟒
image
image

Safari - ⚫

@Desvelao Desvelao self-assigned this Feb 1, 2023
@AlexRuiz7
Copy link
Member

No issues were found, however, the release was delayed, and we were required to include new changes, for which we will create a new RC regression test, testing these new changes.

Closed as done. We'll open a new issue for the new test iteration.

@github-project-automation github-project-automation bot moved this from In Progress to Done in Release 4.4.0 Feb 9, 2023
@davidjiglesias davidjiglesias changed the title Release 4.4.0 - RC1 - Kibana UI regression testing Release 4.4.0 - Pre RC1 - Kibana UI regression testing Feb 10, 2023
@AlexRuiz7 AlexRuiz7 mentioned this issue Mar 14, 2023
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: Done
Development

No branches or pull requests

5 participants