Adding: latency test, more control, more stats, etc..

squash removing hosts
minio · Jul 15, 2024 · 544dc86 · 544dc86
1 parent 5271587
commit 544dc86
Show file tree

Hide file tree

Showing 10 changed files with 747 additions and 126 deletions.
diff --git a/.github/workflows/vulncheck.yml b/.github/workflows/vulncheck.yml
@@ -14,7 +14,7 @@ jobs:
     runs-on: ubuntu-latest
     strategy:
       matrix:
-        go-version: [ 1.21.9, 1.22.2 ]
+        go-version: [ 1.22.5 ]
     steps:
     - name: Check out code into the Go module directory
       uses: actions/checkout@v3

diff --git a/.gitignore b/.gitignore
@@ -1,4 +1,6 @@
 dist/
 mperf
+./nperf
 hperf
-nperf
+./hperf
+deploy.sh
diff --git a/Dockerfile b/Dockerfile
@@ -2,7 +2,6 @@ FROM scratch
 MAINTAINER MinIO Development "dev@min.io"
 
 EXPOSE 9999
-EXPOSE 10000
 
 COPY ./hperf /hperf
 

diff --git a/README.md b/README.md
@@ -9,24 +9,43 @@ hperf is a tool for active measurements of the maximum achievable bandwidth betw
 ## Usecases
 - Calculate baseline RX/TX
 - Debug TOR Switch bottlenecks
+- Calculate roundtrip MS for http requests
 
 ## Usage
+Various configurations have been added for controling everything from payload size to http read/write buffers. All flags
+can be seen via `-help`.
+
+Hperf can be used without any configuration, just run hperf on all the servers IP1 IP2 IP3 ... respectively.
 ```
-./hperf IP1 IP2 IP3 ...
-...
-Bandwidth: 1.2 GB/s RX | 1.0 GB/s TX
-Bandwidth: 1.2 GB/s RX | 1.1 GB/s TX
-Bandwidth: 1.2 GB/s RX | 990 MB/s TX
-Bandwidth: 1.2 GB/s RX | 944 MB/s TX
+./hperf -stream=false -hosts 10.10.1.{1...10}
+┌────────────┬────────────┬───────┬──────────┬───────┬──────────┬─────────────────┬───────────────────┬──────┐
+│ Local      │ Remote     │ #RX   │ RX       │ #TX   │ TX       │ TX(ms) high/low │ TTFB(ms) high/low │ #Err │
+├────────────┼────────────┼───────┼──────────┼───────┼──────────┼─────────────────┼───────────────────┼──────┤
+│ 10.10.10.1 │ 10.10.10.6 │ 14927 │ 1.3 GB/s │ 10681 │ 1.2 GB/s │         312 / 2 │            13 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.2 │ 10880 │ 1.3 GB/s │ 18187 │ 1.2 GB/s │         260 / 2 │            13 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.3 │ 16804 │ 1.3 GB/s │ 17141 │ 1.2 GB/s │         299 / 2 │            13 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.4 │ 18670 │ 1.4 GB/s │ 18920 │ 1.3 GB/s │         321 / 2 │            10 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.5 │ 30070 │ 1.2 GB/s │ 29626 │ 1.3 GB/s │         636 / 2 │            10 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.7 │ 24031 │ 1.3 GB/s │ 27004 │ 1.3 GB/s │         600 / 2 │            16 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.8 │ 20844 │ 1.2 GB/s │ 21870 │ 1.2 GB/s │         297 / 1 │            13 / 0 │    0 │
+└────────────┴────────────┴───────┴──────────┴───────┴──────────┴─────────────────┴───────────────────┴──────┘
 ```
 
-on all the servers IP1 IP2 IP3 ... respectively.
-
-Default ports are `9999` and `10000` make sure your firewalls allow these ports. You may optionally configure `./hperf` to use custom ports as well, for example setting port `5001` would require opening up port `5002` as well.
-
+Default ports are `9999` make sure your firewalls allow this port. You may optionally configure `./hperf` to use a custom port as well `-port MYPORT`
 
 ```
-NPERF_PORT=5001 ./hperf IP1 IP2 IP3 ...
+./hperf -port MYPORT -stream=false -hosts 10.10.1.{1...10}
+┌────────────┬────────────┬───────┬──────────┬───────┬──────────┬─────────────────┬───────────────────┬──────┐
+│ Local      │ Remote     │ #RX   │ RX       │ #TX   │ TX       │ TX(ms) high/low │ TTFB(ms) high/low │ #Err │
+├────────────┼────────────┼───────┼──────────┼───────┼──────────┼─────────────────┼───────────────────┼──────┤
+│ 10.10.10.1 │ 10.10.10.6 │ 14927 │ 1.3 GB/s │ 10681 │ 1.2 GB/s │         312 / 2 │            13 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.2 │ 10880 │ 1.3 GB/s │ 18187 │ 1.2 GB/s │         260 / 2 │            13 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.3 │ 16804 │ 1.3 GB/s │ 17141 │ 1.2 GB/s │         299 / 2 │            13 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.4 │ 18670 │ 1.4 GB/s │ 18920 │ 1.3 GB/s │         321 / 2 │            10 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.5 │ 30070 │ 1.2 GB/s │ 29626 │ 1.3 GB/s │         636 / 2 │            10 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.7 │ 24031 │ 1.3 GB/s │ 27004 │ 1.3 GB/s │         600 / 2 │            16 / 0 │    0 │
+│ 10.10.10.1 │ 10.10.10.8 │ 20844 │ 1.2 GB/s │ 21870 │ 1.2 GB/s │         297 / 1 │            13 / 0 │    0 │
+└────────────┴────────────┴───────┴──────────┴───────┴──────────┴─────────────────┴───────────────────┴──────┘
 ```
 
 ## On k8s

diff --git a/go.mod b/go.mod
@@ -1,9 +1,20 @@
 module github.com/minio/hperf
 
-go 1.19
+go 1.22.4
 
 require (
+	github.com/charmbracelet/lipgloss v0.11.1
 	github.com/dustin/go-humanize v1.0.1
-	github.com/google/uuid v1.4.0
-	golang.org/x/sys v0.19.0
+	github.com/minio/pkg/v3 v3.0.7
+	golang.org/x/sys v0.22.0
+)
+
+require (
+	github.com/aymanbagabas/go-osc52/v2 v2.0.1 // indirect
+	github.com/charmbracelet/x/ansi v0.1.3 // indirect
+	github.com/lucasb-eyer/go-colorful v1.2.0 // indirect
+	github.com/mattn/go-isatty v0.0.20 // indirect
+	github.com/mattn/go-runewidth v0.0.15 // indirect
+	github.com/muesli/termenv v0.15.2 // indirect
+	github.com/rivo/uniseg v0.4.7 // indirect
 )
diff --git a/go.sum b/go.sum
@@ -1,6 +1,24 @@
+github.com/aymanbagabas/go-osc52/v2 v2.0.1 h1:HwpRHbFMcZLEVr42D4p7XBqjyuxQH5SMiErDT4WkJ2k=
+github.com/aymanbagabas/go-osc52/v2 v2.0.1/go.mod h1:uYgXzlJ7ZpABp8OJ+exZzJJhRNQ2ASbcXHWsFqH8hp8=
+github.com/charmbracelet/lipgloss v0.11.1 h1:a8KgVPHa7kOoP95vm2tQQrjD2AKhbWmfr4uJ2RW6kNk=
+github.com/charmbracelet/lipgloss v0.11.1/go.mod h1:beLlcmkF7MWA+5UrKKIRo/VJ21xGXr7YJ9miWfdMRIU=
+github.com/charmbracelet/x/ansi v0.1.3 h1:RBh/eleNWML5R524mjUF0yVRePTwqN9tPtV+DPgO5Lw=
+github.com/charmbracelet/x/ansi v0.1.3/go.mod h1:dk73KoMTT5AX5BsX0KrqhsTqAnhZZoCBjs7dGWp4Ktw=
 github.com/dustin/go-humanize v1.0.1 h1:GzkhY7T5VNhEkwH0PVJgjz+fX1rhBrR7pRT3mDkpeCY=
 github.com/dustin/go-humanize v1.0.1/go.mod h1:Mu1zIs6XwVuF/gI1OepvI0qD18qycQx+mFykh5fBlto=
-github.com/google/uuid v1.4.0 h1:MtMxsa51/r9yyhkyLsVeVt0B+BGQZzpQiTQ4eHZ8bc4=
-github.com/google/uuid v1.4.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo=
-golang.org/x/sys v0.19.0 h1:q5f1RH2jigJ1MoAWp2KTp3gm5zAGFUTarQZ5U386+4o=
-golang.org/x/sys v0.19.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
+github.com/lucasb-eyer/go-colorful v1.2.0 h1:1nnpGOrhyZZuNyfu1QjKiUICQ74+3FNCN69Aj6K7nkY=
+github.com/lucasb-eyer/go-colorful v1.2.0/go.mod h1:R4dSotOR9KMtayYi1e77YzuveK+i7ruzyGqttikkLy0=
+github.com/mattn/go-isatty v0.0.20 h1:xfD0iDuEKnDkl03q4limB+vH+GxLEtL/jb4xVJSWWEY=
+github.com/mattn/go-isatty v0.0.20/go.mod h1:W+V8PltTTMOvKvAeJH7IuucS94S2C6jfK/D7dTCTo3Y=
+github.com/mattn/go-runewidth v0.0.15 h1:UNAjwbU9l54TA3KzvqLGxwWjHmMgBUVhBiTjelZgg3U=
+github.com/mattn/go-runewidth v0.0.15/go.mod h1:Jdepj2loyihRzMpdS35Xk/zdY8IAYHsh153qUoGf23w=
+github.com/minio/pkg/v3 v3.0.7 h1:1I2CbFKO+brioB6Pbnw0jLlFxo+YPy6hCTTXTSitgI8=
+github.com/minio/pkg/v3 v3.0.7/go.mod h1:njlf539caYrgXqn/CXewqvkqBIMDTQo9oBBEL34LzY0=
+github.com/muesli/termenv v0.15.2 h1:GohcuySI0QmI3wN8Ok9PtKGkgkFIk7y6Vpb5PvrY+Wo=
+github.com/muesli/termenv v0.15.2/go.mod h1:Epx+iuz8sNs7mNKhxzH4fWXGNpZwUaJKRS1noLXviQ8=
+github.com/rivo/uniseg v0.2.0/go.mod h1:J6wj4VEh+S6ZtnVlnTBMWIodfgj8LQOQFoIToxlJtxc=
+github.com/rivo/uniseg v0.4.7 h1:WUdvkW8uEhrYfLC4ZzdpI2ztxP1I582+49Oc5Mq64VQ=
+github.com/rivo/uniseg v0.4.7/go.mod h1:FN3SvrM+Zdj16jyLfmOkMNblXMcoc8DfTHruCPUcx88=
+golang.org/x/sys v0.6.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg=
+golang.org/x/sys v0.22.0 h1:RI27ohtqKCnwULzJLqkv897zojh5/DwS/ENaMzUOaWI=
+golang.org/x/sys v0.22.0/go.mod h1:/VUhepiaJMQUp4+oa/7Zr1D23ma6VTLIYjOOTFZPUcA=
diff --git a/helm/hperf/templates/service.yaml b/helm/hperf/templates/service.yaml
@@ -10,7 +10,5 @@ spec:
   ports:
     - port: 9999
       name: http1
-    - port: 10000
-      name: http2
   selector:
     app: hperf
diff --git a/helm/hperf/templates/statefulset.yaml b/helm/hperf/templates/statefulset.yaml
@@ -38,8 +38,6 @@ spec:
           ports:
             - name: http1
               containerPort: 9999
-            - name: http2
-              containerPort: 10000
       {{- with .Values.nodeSelector }}
       nodeSelector:
         {{- toYaml . | nindent 8 }}

diff --git a/hperf.yaml b/hperf.yaml
@@ -11,8 +11,6 @@ spec:
   ports:
     - port: 9999
       name: http1
-    - port: 10000
-      name: http2
   selector:
     app: hperf
 ---
@@ -59,5 +57,3 @@ spec:
           ports:
             - name: http1
               containerPort: 9999
-            - name: http2
-              containerPort: 10000