Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

qa-ctl: Launch tests without specifying a configuration file. Self-contained information in the tests #1892

Merged
merged 142 commits into from
Sep 15, 2021
Merged

qa-ctl: Launch tests without specifying a configuration file. Self-contained information in the tests #1892

merged 142 commits into from
Sep 15, 2021

Conversation

jmv74211
Copy link
Contributor

@jmv74211 jmv74211 commented Sep 14, 2021 •
edited
Loading

Related issue
close #1803

Description

This PR adds the qa-ctl tool to the wazuh-qa repository, in addition to the set of libraries used for its development in the qa framework.

Important note: For now, qa-ctl tool is only available for Linux systems.

  • Here you can find the related qa-ctl documentation and use guide.
  • Here you can find the qa-ctl installation guide

Checks

Check installation process

  • Installing the qa-ctl tool on Ubuntu and CentOS systems.
  • Installing all required libraries from requirements.txt.
    ​

Check automated qactl executions

  • Run test_general_settings_enabled.
  • Run test_execd_restart.
  • Run test_cors.
  • Run test_cache.
  • Run test_execd_firewall_drop.
    ​

Check automated qactl entry parameters

  • Run --dry-run execution for test_cors.
  • Run with invalid -v,--version parameter.
  • Run with modified documentation (unsupported os_platform).
  • Run with modified documentation: not suported Linux lowercase error.
  • Run with deployment in centos for test_general_settings_enabled.
  • Run with deployment in linux for test_general_settings_enabled.
  • Run with --persistent argument.
    ​

Check qactl with yaml file

  • Provisioning module with local_package parameter.
  • Provisioning module with s3_url_package parameter.
  • Check validation process by entering invalid parameter in different fields.

palaciosjeremias and others added 30 commits July 16, 2021 12:10
Add Config to DocGenerator
ff2cee3
@palaciosjeremias
Merge pull request #1619 from wazuh/dev-1608-docgenerator-config
4312be3 
Add Config to DocGenerator
@MiguelazoDS
Generate docs tree
af49e07
Integrate Config and CodeParser with DocGenerator
0d1f6bc
Improve file dump
589d76c
@palaciosjeremias
Merge pull request #1623 from wazuh/dev-1606-doc_tree_generator
62a7a48 
Implement the DocGenerator main module and test search
@MiguelazoDS
Testing a sanity check
3b997fe
Add Sanity module to DocGenerator
cad07f8
Code review fixes
5359659
@palaciosjeremias
Merge pull request #1649 from wazuh/dev-1628-sanity-check
8a2eaf9 
Implement a sanity check module for DocGenerator
Add TestCaseParser module to DocGenerator
fc20b17
Add Mandatory and Optional fields functionality
fc88e84
Implement Mandatory and Optional fields as tree structures
eca8835
Add output path to gitignore
e4f14c5
Config fix
20c86ba
Clean the output folder before each run
bb2ecbd
Avoid dumping documentation file for empty content
dfac0a4
Simplify the include paths config format
7ff65c3
Reduce verbosity of a normal flow
e5e134a
Add logging functionality
6edb79d
Make Test Cases field configurable
6906da7
Add documentation comments
e7e641e
Add arguments to DocGenerator execution
2d6278e
Migrate documentation keys to snake_case
7bcc283
@palaciosjeremias
Merge pull request #1665 from wazuh/dev-1664-configurable-fields
1a98f8d 
Implement Mandatory and Optional fields functionality
Code review fixes
7577479
@palaciosjeremias
Merge pull request #1680 from wazuh/dev-1641-exploratory-testing-fixes
a4c780e 
Exploratory testing fixes
Fix uninitilized variable
8facb73
Move library modules to lib folder
5aa6b90
Add component to Mandatory fields
7620fda
jmv74211 and others added 20 commits September 10, 2021 10:47
@jmv74211
fix: Fix test path calculation in doc_generator module #1803
2c158d8
@jmv74211
refac: Update ansible_output parameter in QAFramework class #1803
5ad4844
@jmv74211
add: Add qa-ctl tests validation #1803
d5d7624
@jmv74211
add: Integrate qa-docs test info in qa-ctl #1803
5ef6cc3
@jmv74211
add: Add new python dependencies for qa-docs #1803
74024b2
@jmv74211
add: Add new python dependencies for qa-ctl #1803
bf20dca
@jmv74211
fix: Install QAFramework as root user in qa-ctl. #1803
582475d 
Needed to launch the integration tests, as they are launched as root.
@jmv74211
add: Add vagrant box downloading logging #1803
3d928e5
@jmv74211
refac: Improve pytest report files names #1803
07849ea
@jmv74211
refac: Update box selection logic in qactl config generator #1803
9778d2e
@jmv74211
doc: Add qa-ctl code documentation #1803
5251e24
@mdengra
doc: Update test documentation in QA Docs style
0cfe98a 
The following tests have been updated:
  * test_execd_firewall_drop.py
  * test_execd_restart.py
  * test_cors.py
  * test_general_settings_enabled.py
The current scheme of the issue #1694 has been used.
PEP-8 fixes.
@mdengra
doc: Update test documentation in QA Docs style
4249449 
The following tests have been updated:
  * test_cache.py
The current scheme of the issue #1694 has been used.
PEP-8 fixes.
refac: Update qa-docs tool to use the current qa-docs schema.
ae95698
fix: rename test_path as path.
10dc5d7
@mdengra
doc: Rearrange os_version list by adding the newest versions first
9f17111
@mdengra
Merge branch '1803-development' of github.com:wazuh/wazuh-qa into 180…
e4c320e 
…3-development
@jmv74211
add: Update qa-ctl parsing according to the new qa-docs schema #1803
d0d600a
@jmv74211
refac: Remove input values from qa-ctl parameters validation #1803
dc814ae
@jmv74211
style: Apply PEP-8 style to qa-ctl tool #1803
271a944
@jmv74211 jmv74211 requested a review from snaow September 14, 2021 14:55
@jmv74211 jmv74211 self-assigned this Sep 14, 2021
@jmv74211 jmv74211 changed the title Add qa-ctl tool v0.0.1 Add qa-ctl tool v0.1 Sep 14, 2021
@jmv74211 jmv74211 requested review from fernandolojano and removed request for snaow September 15, 2021 09:41
@jmv74211 jmv74211 changed the base branch from master to 1533-qa-ctl September 15, 2021 09:42
@jmv74211 jmv74211 changed the title Add qa-ctl tool v0.1 qa-ctl: Launch tests without specifying a configuration file. Self-contained information in the tests Sep 15, 2021
@jmv74211 jmv74211 merged commit 00f787e into 1533-qa-ctl Sep 15, 2021
@jmv74211 jmv74211 deleted the 1803-development branch September 15, 2021 09:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@fernandolojano fernandolojano fernandolojano approved these changes

Assignees

@jmv74211 jmv74211

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

QACTL launch tests without specifying a configuration file. Self-contained information in the tests
9 participants
@jmv74211 @fernandolojano @palaciosjeremias @MiguelazoDS @mdengra @snaow @Rebits @AdriiiPRodri @mcarmona99