Performance Testing: Katalon and Octoperf

Katalon and Octoperf play a critical role in the continuous performance testing process, where Octoperf can help in building the performance activity, and Katalon can trigger build activity and push performance reports into the Katalon platform. By integrating Katalon into Octoperf, you can ensure that you have comprehensive end-to-end test coverage in a fully automated way. The integration between these two solutions will help you automate the build, test, and deployment of your applications.

To integrate these two applications, first we need to prepare an Octoperf workspace with all the necessary performance activity and then we have to call the Octoperf apis within Katalon Studio which can generate a performance test report. Finally, the results of test execution will be presented in the Katalon TestOps solution.

Performance Testing

Performance Testing is a software testing process used for testing the speed, response time, stability, reliability, scalability, and resource usage of a software application under a particular workload. The main purpose of performance testing is to identify and eliminate the performance bottlenecks in the software application.

Key parameter of Performance Testing

• Speed – Determines whether the application responds quickly
• Scalability – Determines the maximum user load the software application can handle.
• Stability – Determines if the application is stable under varying loads

Types of Performance Testing

• Load testing – checks the application’s ability to perform under anticipated user loads. The objective is to identify performance bottlenecks before the software application goes live.
• Stress testing – involves testing an application under extreme workloads to see how it handles high traffic or data processing. The objective is to identify the breaking point of an application.
• Volume testing – Under Volume Testing large no. of. Data is populated in a database, and the overall software system’s behavior is monitored. The objective is to check software application’s performance under varying database volumes.

What is Octoperf

OctoPerf is a commercial Saas and on Premise platform. It's a full-stack cloud load testing platform. It allows simulating thousands of concurrent users on any HTTP-based website or mobile application. On premise means you can install your own OctoPerf platform anywhere you want. It has the following key features: Record and design realistic Virtual User, Monitor your servers, Run scenarios from multiple locations (Europe, USA and more), Analyze bench reports to find performance bottlenecks.

What is Katalon Platform

Katalon is a modern, comprehensive quality management platform that helps teams of any size deliver the highest quality digital experiences. Katalon Studio is a comprehensive toolset for web, API, mobile, and desktop app automation testing.

Katalon Platfrom with Octoperf

This project demonstrates how Katalon Studio helps users to perform the performance testing by using Octoperf. I have built a test suite which is triggering a Load test from Octoperf.

Prerequisite

• Katalon Studio
• Octoperf Account.

Account Setup in Octoperf

• Login into the Octoperf account

• Create a Workspace and copy the Workspace Id from URL.

• Create a project and copy Project Id from the URL.

• Create Virtual Users: A Virtual User represents a user journey through your application. It lets you simulate a real user behavior. You are then prompted with several options:

  • Website or REST API
  • Browser Record(HAR)
  • Jmeter Project
  • Postman collection
  • Fragments

  We are using Browser Record(HAR) for the Virtual user so we generate a .har file on browser(Chrome/firefox) by recording all the action for test application.

  

• Go with the Virtual User Validation check.

• Click on Execute Load Test

• Click on Scenario and copy Scenario Id from the URL.

• Enter the Time of occurrence and number of concurrent users

• Click on Templates, Extract Template and copy Template Id from the URL.

Project Setup in Katalon

• Create a project.

• Add all the store values for octoperf into katalon Profile.

  • Template Id.
  • Scenario Id
  • Worksapce Id
  • Project Id
  • OCtoperf API Key
  • Add download-report.sh at project root directory.

• Create APIs within Object repository.

  • API EndPoint - POST https://api.octoperf.com/runtime/scenarios/run/?templateId=
  • Http Header - Authorization - Bearer ${apikey}

• API EndPoint - https://api.octoperf.com/runtime/bench-results/progress/${benchResultId}
• Http Header - Authorization - Bearer ${apikey}

• Create Test Cases and Extract the values from APIs

• Test Case No 1: TC001_Executes the scenario with the given ID

• Test Case No 2: TC002_Track Run Progress

• Test Case No 3: TC003_Download PDF Report

• Create a Test Suite and Add all the above test cases.

• Run Katalon Test suite and verify the report downloaded on the project root directory.