Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tests/mclag] Submit mclag testcases according to mclagtest plan #1237

Closed
wants to merge 5 commits into from

Conversation

freeman386
Copy link

Description of PR

Summary:
Submit MCLAG testcases according to mclag test plan [Azure/SONiC/pull/422].

It works together with below PRs:

Type of change

  • [] Bug fix
  • [] Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Approach

How did you do it?

  1. mclag test on test_scenario L2
root@sonic-mgmt:/var/root/sonic-mgmt-main/tests# pytest -vvv --disable_loganalyzer --inventory veos --host-pattern all --user admin --testbed vms-t0-mclag-16 --testbed_file testbed.csv   --show-capture=stdout  test_mclag.py                                   
========================================================================================================= test session starts =========================================================================================================
platform linux2 -- Python 2.7.12, pytest-4.6.3, py-1.8.0, pluggy-0.12.0 -- /usr/bin/python
cachedir: .pytest_cache
ansible: 2.0.0.2
rootdir: /var/root/sonic-mgmt-main/tests, inifile: pytest.ini
plugins: repeat-0.8.0, ansible-2.0.2
collected 56 items                                                                                                                                                                                                                    

test_mclag.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_check_teamd_system_id PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_traffic_between_servers PASSED
test_mclag.py::TestCase1_VerifyMclagStatus::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_down PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_up PASSED
test_mclag.py::TestCase2_MclagMemberPortStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_peer_link_interface_down PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_syncheck_on_mclag_interface[syncheck0] PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_peer_link_interface_up PASSED
test_mclag.py::TestCase3_PeerLinkStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_keepalive_link_down PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_keepalive_link_up PASSED
test_mclag.py::TestCase4_KeepaliveLinkStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_peer_keepalive_link_down PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_peer_keepalive_link_up PASSED
test_mclag.py::TestCase5_PeerKeepaliveBothStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_active_down PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_active_up PASSED
test_mclag.py::TestCase6_ActiveDevStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_traffic_between_servers PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_standby_down PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_standby_up PASSED
test_mclag.py::TestCase7_StandbyDevStatusChange::test_syncheck[syncheck0] PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_traffic_between_servers PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag.py::TestCase8_ActiveDevWarmreboot::test_syncheck_after_warmreboot[syncheck0] PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_traffic_between_servers PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag.py::TestCase9_StandbyDevWarmreboot::test_syncheck_after_warmreboot[syncheck0] PASSED
test_mclag.py::TestCase10_MacFlapping::test_traffic_before_mac_flapping PASSED
test_mclag.py::TestCase10_MacFlapping::test_syncheck_before_mac_flapping[syncheck0] PASSED
test_mclag.py::TestCase10_MacFlapping::test_mac_flapping PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_traffic_between_servers PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_mclag_member_port_down PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_mclag_member_port_up PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_traffic_between_servers_after_mclag_member_port_up PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_traffic_between_servers PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_before_age PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mac_aging_on_peer PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_aging PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_relearn_after_mac_age PASSED
test_mclag.py::TestCase11_MacSyncAndAge::test_mclag_age_flag_after_relearn PASSED
test_mclag.py::TestCase12_ICCP_CSM::test_active_restart PASSED
test_mclag.py::TestCase12_ICCP_CSM::test_standby_restart PASSED
test_mclag.py::TestCase13_Scaling::test_traffic_between_servers PASSED
test_mclag.py::TestCase13_Scaling::test_mac_arp_sync PASSED
test_mclag.py::TestCase14_CornerTest::test_stop_teamd_on_active PASSED
test_mclag.py::TestCase14_CornerTest::test_start_teamd_on_active PASSED
test_mclag.py::TestCase14_CornerTest::test_stop_teamd_on_standby PASSED
test_mclag.py::TestCase14_CornerTest::test_start_teamd_on_standby PASSED
============================================================================================== 56 passed, 1 warnings in 5459.90 seconds ===============================================================================================
  1. mclag test on test_scenario L3
root@sonic-mgmt:/var/root/sonic-mgmt-main/tests# pytest -vvv --disable_loganalyzer --inventory veos --host-pattern all --user admin --testbed vms-t0-mclag-16 --testbed_file testbed.csv --show-capture=stdout test_mclag_l3.py
========================================================================================================= test session starts =========================================================================================================
platform linux2 -- Python 2.7.12, pytest-4.6.3, py-1.8.0, pluggy-0.12.0 -- /usr/bin/python
cachedir: .pytest_cache
ansible: 2.0.0.2
rootdir: /var/root/sonic-mgmt-main/tests, inifile: pytest.ini
plugins: repeat-0.8.0, ansible-2.0.2
collected 24 items                                                                                                                                                                                                                    

test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_teamd_system_id PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_syncheck PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_down PASSED
test_mclag_l3.py::TestCase2_MclagMemberPortStatusChange::test_mclag_member_port_up PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_keepalive_link_down PASSED
test_mclag_l3.py::TestCase3_KeepaliveLinkStatusChange::test_keepalive_link_up PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_active_down PASSED
test_mclag_l3.py::TestCase4_ActiveDevStatusChange::test_active_up PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_standby_down PASSED
test_mclag_l3.py::TestCase5_StandbyDevStatusChange::test_standby_up PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag_l3.py::TestCase6_ActiveDevWarmreboot::test_syncheck PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_traffic_during_warmreboot PASSED
test_mclag_l3.py::TestCase7_StandbyDevWarmreboot::test_syncheck PASSED
test_mclag_l3.py::TestCase8_Scaling::test_traffic_between_servers PASSED
test_mclag_l3.py::TestCase8_Scaling::test_syncheck PASSED

========================================================================================================== warnings summary ===========================================================================================================
test_mclag_l3.py::TestCase1_VerifyMclagStatus::test_check_keepalive_link
  /usr/local/lib/python2.7/dist-packages/pytest_ansible/module_dispatcher/v2.py:70: UserWarning: provided hosts list is empty, only localhost is available
    warnings.warn("provided hosts list is empty, only localhost is available")

-- Docs: https://docs.pytest.org/en/latest/warnings.html
============================================================================================== 24 passed, 1 warnings in 2198.84 seconds ===============================================================================================

Supported testbed topology if it's a new test case?

According test plan, we build mclag topo based on topo-t0, supported for topo_t0-mclag(which has 32 dut ports) and topo_t0-mclag-16(which has 16 dut ports).

Documentation

https://github.com/shine4chen/SONiC/blob/mclag-test-case/doc/mclag_hld/MCLAG-ansible-test-plan.md

@msftclas
Copy link

msftclas commented Nov 26, 2019

CLA assistant check
All CLA requirements met.

@freeman386
Copy link
Author

We will add deploy mclag topo PR to required PRs later

@freeman386 freeman386 closed this Nov 26, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants