Wazuh QA v4.10.0 RC 2

Fixed

• Regex value comparison in test cluster sync (#5845) - (Tests)
• Changed wazuh-agent service start from install test to registration test (#5762) - (Tests)
• Fix E2E VD tests not working if the Python version is different to 3.9 (#5787) - (Framework)
• Fix failed to disable wazuh-manager.service (#5775) - (Tests)
• Fix reliability tests regex statements (#5782) - (Tests)

Wazuh QA v4.10.0 RC 1

Fixed

• Regex value comparison in test cluster sync (#5845) - (Tests)
• Changed wazuh-agent service start from install test to registration test (#5762) - (Tests)
• Fix E2E VD tests not working if the Python version is different to 3.9 (#5787) - (Framework)
• Fix failed to disable wazuh-manager.service (#5775) - (Tests)
• Fix reliability tests regex statements (#5782) - (Tests)

Wazuh QA v4.10.0 Beta 1

Fixed

• Changed wazuh-agent service start from install test to registration test (#5762) - (Tests)
• Fix E2E VD tests not working if the Python version is different to 3.9 (#5787) - (Framework)
• Fix failed to disable wazuh-manager.service (#5775) - (Tests)
• Fix reliability tests regex statements (#5782) - (Tests)

Wazuh QA v4.10.0 Alpha 3

Fixed

• Changed wazuh-agent service start from install test to registration test (#5762) - (Tests)
• Fix E2E VD tests not working if the Python version is different to 3.9 (#5787) - (Framework)
• Fix failed to disable wazuh-manager.service (#5775) - (Tests)
• Fix reliability tests regex statements (#5782) - (Tests)

Wazuh QA v4.9.2

Fixed

• Update macOS ventura sign Vagrant box (#5834) - (Framework)
• Updated Windows server AMis. (#5831) - (Framework)

Wazuh QA v4.9.1

Added

• Add support for macOS 15 (Sequoia) to the DTT tests (#5777) - (Tests)
• Added support for macOS 15 (Vagrant) to the Allocation module (#5743) - (Framework)
• Add Ubuntu 24.04 support to Deployability testing tier 1 ([#5689])(#5689) - (Tests)
• Added support for macOS 14.6 to the Allocation module (Vagrant) (#5671) - (Framework)

Changed

• Update team labels and add 'agent' option (#5725) - (Framework)
• Change in VD E2E tests to use package feed instead of CTI feed (#5739) - (Tests)
• Improve VD plots title (#5740) - (Framework)
• Remove meaningless clean.yaml in DTT1 tests ([#5732])(#5732) - (Framework)
• Updated Debian 12 AMIs and Box to 12.7 version (#5735) - (Framework)

Fixed

• Fix test_cluster_master_logs_order.py test ([#5776])(#5776) - (Tests)
• Fix unexpected warnings in E2E vulnerability detection tests (#5711) - (Framework + Tests)
• Grafana package used for upgrade_package_nonvulnerable_to_vulnerable case is vulnerable (#5719) - (Tests)
• Increase results windows in E2E Vulnerability detection (#5712) - (Framework + Tests)

Deleted

• Reverted an xfail behaviour change in the API performance test (#5734) - (Tests)

Wazuh QA v4.9.0

Added

• Adding jobflow templates (#5680) - (Framework)
• Add RockyLinux 8.10 to Allocator module (#5524) - (Framework)
• Add Deployability testing tier 1 (#5190) - (Framework + Documentation + Tests)
• Add Workflow module to Wazuh-qa repository (#4990) - (Tests)
• Add an IT to check that the agent erases its wazuh-agent.state file (#4716) - (Tests)
• Add integration tests for Update field to CPE_Helper (#4574) - (Framework + Tests)

Changed

• Increase Feed update timeout in waiters.py (#5668) - (Framework)
• Set /active-response as xfail (#5660) - (Tests)
• Modify the directory name for machines deployed in AWS (#5635) - (Framework)
• Add task information in the allocation logs when create or delete an instance (#5623) - (Framework)
• Changed _run_tests in testing.py (#5621) - (Framework)
• Deleted custom field from PUT /active-response performance test. (#5612) - (Tests)
• Update CentOS 7 Vagrant box (#5546) - (Framework)
• Update CentOS 7 AMIs (#5545) - (Framework)
• Update OpenSUSE 15 AMI (#5536) - (Framework)
• Update Debian 12 AMIs (#5529) - (Framework)
• Update AL2023 AMIs (#5530) - (Framework)
• Update Oracle Linux 9 AMI (#5525) - (Framework)
• Update the API script file name (#5351) - (Framework + Tests)
• Enhance the PR template (#4881) - (Framework)
• Update integration tests README (#4742) - (Documentation)

Fixed

• Fix playbook cleanup.yaml (#5672) - (Tests)
• Fixed unnecessary reference to debian file in dashboard provisioning task (#5643) - (Framework)
• Changed 'Ensure that the manager version is' expected warning to an agnostic version of regex (#5630) - (Tests)
• Adding fixed and dynamic waits to port status checks (#5627) (Framework)
• Fixed custom storage for AMIs (#5625) - (Framework)
• Vulnerability regex changed to match with 4.9.0 solved vulnerability alerts (#5624) - (Tests)
• Fix cluster reliability test internal error (#5620) - (Tests)
• Fix CentOS 9 AMI in Allocator module (#5523) - (Framework)
• Fix stability in cluster reliability tests (#5477) - (Tests)
• Fix agent_simulator response for active-response configuration commands (#4895) - (Framework + Tests)
• Fix manager_agent system tests environment (#4808) - (Framework)

Wazuh QA v4.8.2

Changed

• Bump version to 4.8.2

Wazuh QA v4.8.1

Added

• Added the capability to plot indexed alerts and vulnerabilities. (#5518) - (Framework)
• Add functionality to unify data of the binary processes with their subprocesses to plot (#5500) - (Framework)

Changed

• Remove hardcoded references in provision playbook for E2E tests (#5517) - (Framework)
• Fix test_consistency_initial_scans by adding a 30-minute wait before collecting vulnerabilities. (#5507) - (Tests)

Fixed

• Fix indexer data visualizaiton class generation (#5520) - (Framework)

Wazuh QA v4.8.0

Added

• Add functionality to obtain metrics from the dashboard (#5432) - (Framework)
• Add Timestamp field to the indexer statistics (#5357) - (Framework)
• Add GeneratorVulnerabilityEvents in agent simulator (#5265) - (Framework)
• Add functionality to obtain statistics and metrics from the indexer (#5090) - (Framework)
• Add support for the installation/uninstallation of npm packages (#5092) - (Tests)
• Add alert.json file to Vulnerability Detector E2E test report (#5147) - (Framework)
• Add documentation about markers for system tests (#5080) - (Documentation)
• Add AWS Custom Buckets Integration tests (#4675) - (Framework + Tests)
• Add Vulnerability Detector end to end tests (#4878) - (Framework + Tests)
• Agent Simulator: Syscollector message generation refactoring (#4868) - (Framework)
• Migrate Wazuh Ansibles Roles. (#4642) - (Framework)
• Add scans environment setup documentation. (#4444) - (Tests)
• Add system test for global group hash (#4015) - (Tests)
• Add tests for new FIM audit buffer option. (#4485) - (Framework + tests)
• Add tests for merged.mg file generation. (#4129) - (Tests)
• Added tests for checking agent status upon ungraceful closure.(#4146) - (Tests)
• Agent syncronization testing after group deleting (#4143) - (Tests)
• Add test for AWS Custom Logs. (#4675) - (Tests)

Changed

• Fix workload benchmark plots (#5364) - (Framework)
• Increase feed update time in Vulnerability Detection E2E tests to 10h (#5424) - (Tests)
• Migrate E2E Vulnerability Detector test packages to S3 repository (#5376) - (Framework)
• Include "Agent key already in use" in the E2E Vulnerability Detection expected error list. (#5409) - (Tests)
• Update vulnerability state index name (#5402) - (Framework)
• Include new package information from wdb (#5350) - (Tests)
• Disable debug evidences for Vulnerability Detector E2E tests by default (#5331) - (Tests)
• Include CVE-2023-4822 vulnerability to grafana packages (#5332) - (Framework)
• Remove sslverify from host manager install package method (#5339) - (Framework)
• Include additional Vulnerability Detector E2E tests (#5287) - (Framework + Tests)
• Change Vulnerability Detection feed updated waiter (#5227) - (Tests)
• Replace timestamp filter with vulnerabilities detected_at field.(#5266) - (Framework + Tests)
• Changes macOS packages with new ones that generate vulnerabilities (#5174) - (Tests)
• Refactor initial scan Vulnerability E2E tests (#5081) - (Framework + Tests)
• Update Packages in TestScanSyscollectorCases (#4997) - (Framework + Tests)
• Reduced test_shutdown_message runtime (#4986) - (Tests)
• Change e2e vd configuration keystore (#4952) - (Framework)
• Updating tests after removing references to the legacy vulnerability detector module (#4872) - (Tests)
• Fix test cluster performance (#4780) - (Tests)
• Fixed IT control_service Windows loop (#4765) - (Framework)
• Fix wazuhdb API statistics parsing (#5007) - (Framework)
• Enhance StatisticMonitor with API support (#4970) - (Framework)
• Deactivate tests and update vulnerability-detector configuration (#4784) - (Framework + Tests)
• Fix body format for get_api_token (#4797) - (Framework)
• Fix one_manager_agent_env pytest marker for System Tests (#4782) - (Tests)
• Updated Filebeat module to 0.4 (#4775) - (Framework)
• Include APT repository update before the installation of Ubuntu E2E agent installation (#4761) - (Framework)
• Enhance macOS deployment ansible taks (#4685) - (Framework)
• Updated Filebeat module to 0.3 (#4700) - (Framework)
• Change database v13 to v12. (#4677) - (Tests)
• Enable Windows Vulnerability Detector E2E. (#4251) - (Tests)
• Update certifi library due to a vulnerability. (#4486) - (Tests)
• Enable Ubuntu Vulnerability Detector E2E. (#4252) - (Tests)
• Update wazuh_db schema database version (#4353) - (Tests)
• Update the JSON schema with the required fields for the output content of the migration tool (#4375) - (Tests)
• Update framework known flaws file (#4443) - (Tests)
• Align migration tool system tests to the tool's new output directory structure (#4561) - (Tests)
• Update file descriptors threshold values used in cluster performance tests (#5073) - (Tests)

Fixed

• Set a stable requets version (#5476) - (Framework)
• Include logic to retry package installation if the lock file is currently in use (#5421) - (Framework)
• Increase E2E Vulnerability detection change manager test timeout (#5414) - (Tests)
• Fix filter vulnerabilities function in case of multiple packages are used (#5419) - (Framework)
• Remove false positive from E2E Vulnerability Detection tests (#5369) - (Framework)
• Fix multigroups guess system test (#5396) - (Tests)
• Fix hotfixes syscollector agent simulator messages (#5379) - (Framework)
• Fix restart agent in change manager Vulnerability Detector E2E test case (#5355) - (Tests)
• Fix E2E Vulnerability Detection Windows package installation error (#5363) - (Framework)
• Fix shutdown messages system test (#5298) - (Framework + Tests)
• Fix upgrade macOS package cases for vulnerability scanner E2E (#5334) - (Tests)
• Fix test cases in Vulnerability Detection E2E test by adding new packages (#5349) - (Tests)
• Fix macOS alert collection for E2E Vulnerability Detection tests (#5337) - (Framework)
• Fix packages in Windows and macOS upgrade cases (#5223) - (Framework + Tests)
• Fix vulnerabilities and add new packages to Vulnerability Detector E2E tests (#5234) - (Tests)
• Fix provision macOS endpoints with npm (#5128) - (Tests)
• Fix timestamps alerts and logs filter (#5157) - (Framework + Tests)
• Fix macOS and Windows agents timezone (#5178) - (Framework)
• Fix Vulnerability Detector E2E tests by adding description to all tests (#5151) - (Tests)
• Fix parser for non package vulnerabilities (#5146) - (Framework)
• Fix remote_operations_handler functions to Vulnerability Detector E2E tests (#5155) - (Framework)
• Fix enrollment cluster system tests (#5134) - (Tests)
• Fix test_synchronization system test (#5089) - (Framework + Tests)
• Fix number of ...