Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

jolokia2 - connection leak #4130

Closed
nablaone opened this issue May 9, 2018 · 3 comments · Fixed by #4137
Closed

jolokia2 - connection leak #4130

nablaone opened this issue May 9, 2018 · 3 comments · Fixed by #4137
Labels
bug unexpected problem or unintended behavior
Milestone
1.6.3

Comments

@nablaone
Copy link

nablaone commented May 9, 2018

Relevant telegraf.conf:

[[inputs.jolokia2_agent]]

    urls = ["http://localhost:1510/jolokia"]
    username = "Foo"
    password = "Bar"

    [[inputs.jolokia2_agent.metric]]
     name  = "java_runtime"
     mbean = "java.lang:type=Runtime"
     paths = ["Uptime"]

System info:

HEAD, v1.6.1

Telegraf gathers data from WildFly9 server.

Steps to reproduce:

  1. Setup jolokia2 plugin
  2. Run telegraf
  3. Wait at least hour.

Expected behavior:

Telegraf should gather data eternally.

Actual behavior:

Telegraf eats all available inodes and stops sending data to the infuxdb

2018-05-09T11:06:30Z E! Error in plugin [inputs.system]: open /proc/loadavg: too many open files
2018-05-09T11:06:30Z E! Error in plugin [inputs.diskio]: took longer to collect than collection interval (10s)
2018-05-09T11:06:30Z E! Error in plugin [inputs.disk]: error getting disk usage info: open /proc/self/mounts: too many open files
2018-05-09T11:06:30Z E! Error in plugin [inputs.kernel]: open /proc/stat: too many open files

Additional info:

I think is this similiar issue to #1933

Quick fix:

diff --git a/plugins/inputs/jolokia2/client.go b/plugins/inputs/jolokia2/client.go
index 9f5de15..276380f 100644
--- a/plugins/inputs/jolokia2/client.go
+++ b/plugins/inputs/jolokia2/client.go
@@ -104,6 +104,7 @@ func NewClient(url string, config *ClientConfig) (*Client, error) {
        transport := &http.Transport{
                ResponseHeaderTimeout: config.ResponseTimeout,
                TLSClientConfig:       tlsConfig,
+               DisableKeepAlives:     true,
        }
 
        client := &http.Client{
@danielnelson
Copy link
Contributor

Can you run this:

lsof -p $(pgrep telegraf)

How many jolokia inputs do you have running?

@nablaone
Copy link
Author

Here is telegraf.conf.

[global_tags]

[agent]
  interval = "10s"
  round_interval = true
  metric_batch_size = 1000
  metric_buffer_limit = 10000
  collection_jitter = "0s"
  flush_interval = "10s"
  flush_jitter = "0s"
  precision = ""
  debug = false
  quiet = false
  logfile = ""
  hostname = ""

[[outputs.influxdb]]
  urls = ["http://influxdb:8086"]
  database = "db"
  username = "developer"
  password = "pass"

[[inputs.jolokia2_agent]]

    urls = ["http://localhost:1510/jolokia"]
    username = "FOO"
    password = "BAR"

    [[inputs.jolokia2_agent.metric]]
     name  = "java_runtime"
     mbean = "java.lang:type=Runtime"
     paths = ["Uptime"]

$ /usr/bin/telegraf -config telegraf.conf 
2018-05-10T06:59:52Z W! [outputs.influxdb] when writing to [http://influxdb:8086]: database "rstrzalinski" creation failed: 403 Forbidden
2018-05-10T06:59:52Z I! Starting Telegraf v1.6.1
2018-05-10T06:59:52Z I! Loaded outputs: influxdb
2018-05-10T06:59:52Z I! Loaded inputs: inputs.jolokia2_agent
2018-05-10T06:59:52Z I! Tags enabled: host=rstrzalinski
2018-05-10T06:59:52Z I! Agent Config: Interval:10s, Quiet:false, Hostname:"rstrzalinski", Flush Interval:10s

Here is a list of opened files. New socket is opened every 10s.

$  lsof -p $(pgrep telegraf)
COMMAND    PID         USER   FD      TYPE   DEVICE SIZE/OFF    NODE NAME
telegraf 20203 rstrzalinski  cwd       DIR      8,1     4096 7063810 /home/rstrzalinski/go/src/github.com/influxdata/telegraf
telegraf 20203 rstrzalinski  rtd       DIR      8,1     4096       2 /
telegraf 20203 rstrzalinski  txt       REG      8,1 29069440 3148164 /usr/bin/telegraf
telegraf 20203 rstrzalinski  mem       REG      8,1  1868984 2104737 /lib/x86_64-linux-gnu/libc-2.23.so
telegraf 20203 rstrzalinski  mem       REG      8,1   138696 2104736 /lib/x86_64-linux-gnu/libpthread-2.23.so
telegraf 20203 rstrzalinski  mem       REG      8,1   162632 2104735 /lib/x86_64-linux-gnu/ld-2.23.so
telegraf 20203 rstrzalinski    0u      CHR   136,15      0t0      18 /dev/pts/15
telegraf 20203 rstrzalinski    1u      CHR   136,15      0t0      18 /dev/pts/15
telegraf 20203 rstrzalinski    2u      CHR   136,15      0t0      18 /dev/pts/15
telegraf 20203 rstrzalinski    3u     IPv4 19172674      0t0     TCP localhost:34308->10.15.40.61:8086 (ESTABLISHED)
telegraf 20203 rstrzalinski    4u  a_inode     0,11        0    8076 [eventpoll]
telegraf 20203 rstrzalinski    5u     IPv4 19172875      0t0     TCP localhost:34424->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski    6u     IPv4 19185455      0t0     TCP localhost:34426->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski    7u     IPv4 19186396      0t0     TCP localhost:34428->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski    8u     IPv4 19180223      0t0     TCP localhost:34430->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski    9u     IPv4 19179303      0t0     TCP localhost:34432->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   10u     IPv4 19188084      0t0     TCP localhost:34434->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   11u     IPv4 19188098      0t0     TCP localhost:34436->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   12u     IPv4 19189014      0t0     TCP localhost:34442->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   13u     IPv4 19192871      0t0     TCP localhost:34444->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   14u     IPv4 19190721      0t0     TCP localhost:34446->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   15u     IPv4 19188398      0t0     TCP localhost:34450->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   16u     IPv4 19189446      0t0     TCP localhost:34458->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   17u     IPv4 19178275      0t0     TCP localhost:34466->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   18u     IPv4 19189491      0t0     TCP localhost:34468->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   19u     IPv4 19196366      0t0     TCP localhost:34474->localhost:1510 (ESTABLISHED)
telegraf 20203 rstrzalinski   20u     IPv4 19197816      0t0     TCP localhost:34478->localhost:1510 (ESTABLISHED)

Here is goroutines dump.

^\SIGQUIT: quit
PC=0x4605e1 m=0 sigcode=128

goroutine 0 [idle]:
runtime.futex(0x1fbfc98, 0x0, 0x0, 0x0, 0x0, 0xc4206d7000, 0x0, 0x0, 0x7fff637aa658, 0x411a1b, ...)
	/usr/local/go/src/runtime/sys_linux_amd64.s:479 +0x21
runtime.futexsleep(0x1fbfc98, 0xc400000000, 0xffffffffffffffff)
	/usr/local/go/src/runtime/os_linux.go:45 +0x62
runtime.notesleep(0x1fbfc98)
	/usr/local/go/src/runtime/lock_futex.go:151 +0x9b
runtime.stopm()
	/usr/local/go/src/runtime/proc.go:1680 +0xe5
runtime.findrunnable(0xc420027300, 0x0)
	/usr/local/go/src/runtime/proc.go:2135 +0x4d2
runtime.schedule()
	/usr/local/go/src/runtime/proc.go:2255 +0x12c
runtime.park_m(0xc4204c4000)
	/usr/local/go/src/runtime/proc.go:2318 +0xb6
runtime.mcall(0x7fff637aa7f0)
	/usr/local/go/src/runtime/asm_amd64.s:286 +0x5b

goroutine 1 [semacquire, 6 minutes]:
sync.runtime_Semacquire(0xc4203c644c)
	/usr/local/go/src/runtime/sema.go:56 +0x39
sync.(*WaitGroup).Wait(0xc4203c6440)
	/usr/local/go/src/sync/waitgroup.go:131 +0x72
github.com/influxdata/telegraf/agent.(*Agent).Run(0xc420134030, 0xc42013a0c0, 0x0, 0x0)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:428 +0x844
main.reloadLoop(0xc42001c2a0, 0x1fe4c88, 0x0, 0x0, 0x1fe4c88, 0x0, 0x0, 0x1fe4c88, 0x0, 0x0, ...)
	/go/src/github.com/influxdata/telegraf/cmd/telegraf/telegraf.go:232 +0x8d
main.main()
	/go/src/github.com/influxdata/telegraf/cmd/telegraf/telegraf.go:403 +0x600

goroutine 18 [syscall, 6 minutes]:
os/signal.signal_recv(0x0)
	/usr/local/go/src/runtime/sigqueue.go:131 +0xa6
os/signal.loop()
	/usr/local/go/src/os/signal/signal_unix.go:22 +0x22
created by os/signal.init.0
	/usr/local/go/src/os/signal/signal_unix.go:28 +0x41

goroutine 35 [select]:
github.com/influxdata/telegraf/agent.(*Agent).flusher.func1(0xc4202c0350, 0xc42013a0c0, 0xc4202d0120, 0xc420134030)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:263 +0x123
created by github.com/influxdata/telegraf/agent.(*Agent).flusher
	/go/src/github.com/influxdata/telegraf/agent/agent.go:260 +0xe5

goroutine 29 [select]:
github.com/influxdata/telegraf/agent.(*Agent).gatherer(0xc420134030, 0xc42013a0c0, 0xc420066440, 0x2540be400, 0xc42006a720)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:129 +0x3a3
github.com/influxdata/telegraf/agent.(*Agent).Run.func3(0xc4203c6440, 0xc420134030, 0xc42013a0c0, 0xc42006a720, 0xc420066440, 0x2540be400)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:424 +0x7d
created by github.com/influxdata/telegraf/agent.(*Agent).Run
	/go/src/github.com/influxdata/telegraf/agent/agent.go:422 +0x7d6

goroutine 28 [select]:
github.com/influxdata/telegraf/agent.(*Agent).flusher(0xc420134030, 0xc42013a0c0, 0xc42006a720, 0xc42006a780, 0x3e81a8000, 0x61a52000)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:324 +0x371
github.com/influxdata/telegraf/agent.(*Agent).Run.func1(0xc4203c6440, 0xc420134030, 0xc42013a0c0, 0xc42006a720, 0xc42006a780)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:398 +0x7a
created by github.com/influxdata/telegraf/agent.(*Agent).Run
	/go/src/github.com/influxdata/telegraf/agent/agent.go:396 +0x691

goroutine 55 [IO wait]:
internal/poll.runtime_pollWait(0x7fc9289ecf70, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126618, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126618, 0xc420470000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126600, 0xc420470000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126600, 0xc420470000, 0x1000, 0x1000, 0x0, 0x0, 0xc42001a540)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4201340a8, 0xc420470000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4203e8fc0, 0xc420470000, 0x1000, 0x1000, 0x2, 0xc420047e58, 0x2)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4203006c0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4203006c0, 0x1, 0x0, 0x0, 0x0, 0xc42001cae0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4203e8fc0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 66 [select, 6 minutes, locked to thread]:
runtime.gopark(0x1626a50, 0x0, 0x1593652, 0x6, 0x18, 0x1)
	/usr/local/go/src/runtime/proc.go:287 +0x12c
runtime.selectgo(0xc4204cdf50, 0xc42013a1e0)
	/usr/local/go/src/runtime/select.go:395 +0x1149
runtime.ensureSigM.func1()
	/usr/local/go/src/runtime/signal_unix.go:511 +0x220
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:2337 +0x1

goroutine 56 [select]:
net/http.(*persistConn).writeLoop(0xc4203e8fc0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 67 [select, 6 minutes]:
main.reloadLoop.func1(0xc42013a120, 0xc42013a0c0, 0xc42030a000, 0xc42001c2a0)
	/go/src/github.com/influxdata/telegraf/cmd/telegraf/telegraf.go:193 +0xe4
created by main.reloadLoop
	/go/src/github.com/influxdata/telegraf/cmd/telegraf/telegraf.go:192 +0x609

goroutine 36 [select, 6 minutes]:
github.com/influxdata/telegraf/agent.(*Agent).flusher.func2(0xc4202c0350, 0xc42013a0c0, 0xc42006a780, 0xc420134030)
	/go/src/github.com/influxdata/telegraf/agent/agent.go:296 +0x137
created by github.com/influxdata/telegraf/agent.(*Agent).flusher
	/go/src/github.com/influxdata/telegraf/agent/agent.go:293 +0x14b

goroutine 57 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ecdf0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126a18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126a18, 0xc42035c000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126a00, 0xc42035c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126a00, 0xc42035c000, 0x1000, 0x1000, 0x42fa5b, 0xc42036aa40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4201340c0, 0xc42035c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420482360, 0xc42035c000, 0x1000, 0x1000, 0xc420148200, 0xc42012c298, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc420300840)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc420300840, 0x1, 0x0, 0x0, 0x0, 0xc42001c9c0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420482360)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 58 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc420482360)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 642 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0de8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126718, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126718, 0xc4207a2000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126700, 0xc4207a2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126700, 0xc4207a2000, 0x1000, 0x1000, 0x42fa5b, 0xc4202b2a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a050, 0xc4207a2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4203e99e0, 0xc4207a2000, 0x1000, 0x1000, 0xc420016a20, 0xc4202d67d8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bc8a0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bc8a0, 0x1, 0x0, 0x0, 0x0, 0xc42013a840, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4203e99e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 339 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc4203e9320)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 396 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b10e8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420781418, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420781418, 0xc420732000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420781400, 0xc420732000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420781400, 0xc420732000, 0x1000, 0x1000, 0x42fa5b, 0xc42078ca40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306250, 0xc420732000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204e85a0, 0xc420732000, 0x1000, 0x1000, 0xc420740ea0, 0xc42001d318, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202d0540)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202d0540, 0x1, 0x0, 0x0, 0x0, 0xc42012d3e0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204e85a0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 37 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ecd30, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420350318, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420350318, 0xc4201aa000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420350300, 0xc4201aa000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420350300, 0xc4201aa000, 0x1000, 0x1000, 0x42fa5b, 0xc420364a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e068, 0xc4201aa000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033e240, 0xc4201aa000, 0x1000, 0x1000, 0xc4200176a0, 0xc42013a658, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202d02a0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202d02a0, 0x1, 0x0, 0x0, 0x0, 0xc4202d60c0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033e240)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 38 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc42033e240)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 201 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec4f0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420780398, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420780398, 0xc42008e000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420780380, 0xc42008e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420780380, 0xc42008e000, 0x1000, 0x1000, 0x42fa5b, 0xc42004ba40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306008, 0xc42008e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4201565a0, 0xc42008e000, 0x1000, 0x1000, 0xc4200168e0, 0xc42013a6b8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42012a3c0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42012a3c0, 0x1, 0x0, 0x0, 0x0, 0xc42012c060, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4201565a0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 437 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc4203e9c20)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 397 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc4204e85a0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 387 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec070, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420113198, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420113198, 0xc4207de000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420113180, 0xc4207de000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420113180, 0xc4207de000, 0x1000, 0x1000, 0x42fa5b, 0xc420787a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4203061d8, 0xc4207de000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420157200, 0xc4207de000, 0x1000, 0x1000, 0xc4202c4760, 0xc42012d018, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42012bc80)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42012bc80, 0x1, 0x0, 0x0, 0x0, 0xc42012cf00, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420157200)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 386 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc420482fc0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 100 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289eceb0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420112918, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420112918, 0xc4204f2000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420112900, 0xc4204f2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420112900, 0xc4204f2000, 0x1000, 0x1000, 0x42fa5b, 0xc4201a2a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a0b0, 0xc4204f2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204826c0, 0xc4204f2000, 0x1000, 0x1000, 0xc4201485a0, 0xc42012c6b8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42006af60)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42006af60, 0x1, 0x0, 0x0, 0x0, 0xc42013a6c0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204826c0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 101 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc4204826c0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 338 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec430, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420462618, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420462618, 0xc4201a8000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420462600, 0xc4201a8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420462600, 0xc4201a8000, 0x1000, 0x1000, 0x42fa5b, 0xc4207c7a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e108, 0xc4201a8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4203e9320, 0xc4201a8000, 0x1000, 0x1000, 0xc4207402e0, 0xc42013a778, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207a0ae0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207a0ae0, 0x1, 0x0, 0x0, 0x0, 0xc42001ca20, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4203e9320)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 137 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ecbb0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420112e18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420112e18, 0xc420284000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420112e00, 0xc420284000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420112e00, 0xc420284000, 0x1000, 0x1000, 0x42fa5b, 0xc4203a9a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a170, 0xc420284000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033f0e0, 0xc420284000, 0x1000, 0x1000, 0xc4204465a0, 0xc42012c778, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42006b500)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42006b500, 0x1, 0x0, 0x0, 0x0, 0xc42013ab40, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033f0e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 138 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc42033f0e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 436 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec130, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420462a18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420462a18, 0xc420274000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420462a00, 0xc420274000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420462a00, 0xc420274000, 0x1000, 0x1000, 0x42fa5b, 0xc4207c0a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e1a8, 0xc420274000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4203e9c20, 0xc420274000, 0x1000, 0x1000, 0xc420740980, 0xc4202d6718, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207a0fc0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207a0fc0, 0x1, 0x0, 0x0, 0x0, 0xc42001cd20, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4203e9c20)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 389 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b1328, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420781118, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420781118, 0xc4202ba000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420781100, 0xc4202ba000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420781100, 0xc4202ba000, 0x1000, 0x1000, 0x42fa5b, 0xc420369a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306208, 0xc4202ba000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033fe60, 0xc4202ba000, 0x1000, 0x1000, 0xc420447e40, 0xc42001cef8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202d0300)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202d0300, 0x1, 0x0, 0x0, 0x0, 0xc42012d260, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033fe60)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 59 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ecc70, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126f18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126f18, 0xc42029c000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126f00, 0xc42029c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126f00, 0xc42029c000, 0x1000, 0x1000, 0x42fa5b, 0xc4201a1a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4201340e8, 0xc42029c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033f9e0, 0xc42029c000, 0x1000, 0x1000, 0xc420447080, 0xc42013b018, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc420300ba0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc420300ba0, 0x1, 0x0, 0x0, 0x0, 0xc42001cc00, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033f9e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 60 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc42033f9e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 61 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ecaf0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420127218, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420127218, 0xc420708000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420127200, 0xc420708000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420127200, 0xc420708000, 0x1000, 0x1000, 0x42fa5b, 0xc4203aaa40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420134108, 0xc420708000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033fd40, 0xc420708000, 0x1000, 0x1000, 0xc420447620, 0xc42012c838, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc420300d80)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc420300d80, 0x1, 0x0, 0x0, 0x0, 0xc42001cd20, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033fd40)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 62 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc42033fd40)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 177 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec970, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420113998, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420113998, 0xc420724000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420113980, 0xc420724000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420113980, 0xc420724000, 0x1000, 0x1000, 0x42fa5b, 0xc4202a5a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a2f8, 0xc420724000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420482a20, 0xc420724000, 0x1000, 0x1000, 0xc420148a40, 0xc42012cc58, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bc6c0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bc6c0, 0x1, 0x0, 0x0, 0x0, 0xc42013b4a0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420482a20)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 194 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc420482a20)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 388 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc420157200)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 385 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec2b0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420780d98, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420780d98, 0xc4204fe000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420780d80, 0xc4204fe000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420780d80, 0xc4204fe000, 0x1000, 0x1000, 0x42fa5b, 0xc4202a2a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4203061b0, 0xc4204fe000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420482fc0, 0xc4204fe000, 0x1000, 0x1000, 0xc420148340, 0xc4202d6298, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42012b920)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42012b920, 0x1, 0x0, 0x0, 0x0, 0xc42012ccc0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420482fc0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 195 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec8b0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420113c98, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420113c98, 0xc420742000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420113c80, 0xc420742000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420113c80, 0xc420742000, 0x1000, 0x1000, 0x42fa5b, 0xc4202a6a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a310, 0xc420742000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420482d80, 0xc420742000, 0x1000, 0x1000, 0xc420148cc0, 0xc4202d6358, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bc840)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bc840, 0x1, 0x0, 0x0, 0x0, 0xc42013b620, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420482d80)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 196 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc420482d80)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 714 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0ae8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420462d18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420462d18, 0xc42073c000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420462d00, 0xc42073c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420462d00, 0xc42073c000, 0x1000, 0x1000, 0x42fa5b, 0xc4204fca40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306130, 0xc42073c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420734240, 0xc42073c000, 0x1000, 0x1000, 0xc4202c5940, 0xc4202d7078, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42006bb00)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42006bb00, 0x1, 0x0, 0x0, 0x0, 0xc42012cc60, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420734240)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 309 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec7f0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126518, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126518, 0xc4202d4000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126500, 0xc4202d4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126500, 0xc4202d4000, 0x1000, 0x1000, 0x42fa5b, 0xc420786a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420134070, 0xc4202d4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204827e0, 0xc4202d4000, 0x1000, 0x1000, 0xc4202bf560, 0xc42013a7d8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bc600)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bc600, 0x1, 0x0, 0x0, 0x0, 0xc4202d6120, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204827e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 514 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc42033f680)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 237 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289eca30, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420350998, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420350998, 0xc42075e000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420350980, 0xc42075e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420350980, 0xc42075e000, 0x1000, 0x1000, 0x42fa5b, 0xc420046a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e158, 0xc42075e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4201577a0, 0xc42075e000, 0x1000, 0x1000, 0xc420314ac0, 0xc4202d6838, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202d0b40)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202d0b40, 0x1, 0x0, 0x0, 0x0, 0xc4202d6720, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4201577a0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 238 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc4201577a0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 715 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc420734240)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 310 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc4204827e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 202 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc4201565a0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 497 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b1268, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420350018, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420350018, 0xc4204e6000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420350000, 0xc4204e6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420350000, 0xc4204e6000, 0x1000, 0x1000, 0x42fa5b, 0xc420768a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a3a8, 0xc4204e6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033f680, 0xc4204e6000, 0x1000, 0x1000, 0xc420447a20, 0xc4202d6f58, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc420301e00)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc420301e00, 0x1, 0x0, 0x0, 0x0, 0xc42013bb60, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033f680)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 197 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec730, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420780218, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420780218, 0xc420782000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420780200, 0xc420782000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420780200, 0xc420782000, 0x1000, 0x1000, 0x42fa5b, 0xc4201a7a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a340, 0xc420782000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420157b00, 0xc420782000, 0x1000, 0x1000, 0xc420314f80, 0xc42013b918, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bcae0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bcae0, 0x1, 0x0, 0x0, 0x0, 0xc42013b800, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420157b00)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 421 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec1f0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420112c98, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420112c98, 0xc4202d8000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420112c80, 0xc4202d8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420112c80, 0xc4202d8000, 0x1000, 0x1000, 0x42fa5b, 0xc42076ba40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a158, 0xc4202d8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420156ea0, 0xc4202d8000, 0x1000, 0x1000, 0xc420017800, 0xc4202d6418, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42006b980)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42006b980, 0x1, 0x0, 0x0, 0x0, 0xc42013acc0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420156ea0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 198 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc420157b00)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 199 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec670, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420780598, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420780598, 0xc4207a6000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420780580, 0xc4207a6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420780580, 0xc4207a6000, 0x1000, 0x1000, 0x42fa5b, 0xc4202a3a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a358, 0xc4207a6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420483680, 0xc4207a6000, 0x1000, 0x1000, 0xc420149240, 0xc42012d318, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bccc0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bccc0, 0x1, 0x0, 0x0, 0x0, 0xc42013b9e0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420483680)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 200 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc420483680)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 643 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc4203e99e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 390 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc42033fe60)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 515 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b1028, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420462398, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420462398, 0xc420152000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420462380, 0xc420152000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420462380, 0xc420152000, 0x1000, 0x1000, 0x42fa5b, 0xc4207c5a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306010, 0xc420152000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033e480, 0xc420152000, 0x1000, 0x1000, 0xc4204462a0, 0xc42012c238, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42006ad20)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42006ad20, 0x1, 0x0, 0x0, 0x0, 0xc42012c060, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033e480)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 288 [IO wait, 6 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec5b0, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420463718, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420463718, 0xc4207cc000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420463700, 0xc4207cc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420463700, 0xc4207cc000, 0x1000, 0x1000, 0x42fa5b, 0xc420789a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306440, 0xc4207cc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204839e0, 0xc4207cc000, 0x1000, 0x1000, 0xc4201495a0, 0xc42001ce38, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207a0a80)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207a0a80, 0x1, 0x0, 0x0, 0x0, 0xc42012d740, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204839e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 289 [select, 6 minutes]:
net/http.(*persistConn).writeLoop(0xc4204839e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 422 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc420156ea0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 474 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289ec370, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420113698, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420113698, 0xc42028a000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420113680, 0xc42028a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420113680, 0xc42028a000, 0x1000, 0x1000, 0x42fa5b, 0xc4203aca40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a2a8, 0xc42028a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420286000, 0xc42028a000, 0x1000, 0x1000, 0xc4202c5800, 0xc42012d078, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc420301140)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc420301140, 0x1, 0x0, 0x0, 0x0, 0xc42013b560, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420286000)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 475 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc420286000)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 495 [IO wait, 4 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b13e8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420113c18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420113c18, 0xc42074e000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420113c00, 0xc42074e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420113c00, 0xc42074e000, 0x1000, 0x1000, 0x42fa5b, 0xc4207c2a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a388, 0xc42074e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420286360, 0xc42074e000, 0x1000, 0x1000, 0xc4202c5c60, 0xc4202d6a78, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc420301bc0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc420301bc0, 0x1, 0x0, 0x0, 0x0, 0xc42013ba40, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420286360)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 496 [select, 4 minutes]:
net/http.(*persistConn).writeLoop(0xc420286360)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 516 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc42033e480)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 716 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0a28, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420463098, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420463098, 0xc420694000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420463080, 0xc420694000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420463080, 0xc420694000, 0x1000, 0x1000, 0x42fa5b, 0xc42070fa40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306140, 0xc420694000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42068e240, 0xc420694000, 0x1000, 0x1000, 0xc420740800, 0xc4202d7558, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4203008a0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4203008a0, 0x1, 0x0, 0x0, 0x0, 0xc42012ce40, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42068e240)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 757 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0968, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420127618, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420127618, 0xc4202fe000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420127600, 0xc4202fe000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420127600, 0xc4202fe000, 0x1000, 0x1000, 0x42fa5b, 0xc4202b3a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a140, 0xc4202fe000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420286ea0, 0xc4202fe000, 0x1000, 0x1000, 0xc420314980, 0xc42013b3d8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bd500)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bd500, 0x1, 0x0, 0x0, 0x0, 0xc42013b200, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420286ea0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 517 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0f68, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420462718, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420462718, 0xc420460000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420462700, 0xc420460000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420462700, 0xc420460000, 0x1000, 0x1000, 0x42fa5b, 0xc420767a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420306030, 0xc420460000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc42033ed80, 0xc420460000, 0x1000, 0x1000, 0xc420446820, 0xc4202d60b8, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42006afc0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42006afc0, 0x1, 0x0, 0x0, 0x0, 0xc42012c360, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc42033ed80)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 518 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc42033ed80)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 601 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0ea8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420112a98, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420112a98, 0xc42072c000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420112a80, 0xc42072c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420112a80, 0xc42072c000, 0x1000, 0x1000, 0x42fa5b, 0xc42076aa40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e1c0, 0xc42072c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204830e0, 0xc42072c000, 0x1000, 0x1000, 0xc4202be960, 0xc42001d018, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207a09c0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207a09c0, 0x1, 0x0, 0x0, 0x0, 0xc42001cf00, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204830e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 602 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc4204830e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 717 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc42068e240)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 646 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0c68, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126e98, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126e98, 0xc42035a000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126e80, 0xc42035a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126e80, 0xc42035a000, 0x1000, 0x1000, 0x42fa5b, 0xc4202b9a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a070, 0xc42035a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420157c20, 0xc42035a000, 0x1000, 0x1000, 0xc420447860, 0xc42001d798, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bcc00)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bcc00, 0x1, 0x0, 0x0, 0x0, 0xc42013ab40, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420157c20)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 644 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b11a8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126b18, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126b18, 0xc420172000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126b00, 0xc420172000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126b00, 0xc420172000, 0x1000, 0x1000, 0x42fa5b, 0xc420764a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42044a060, 0xc420172000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc420483440, 0xc420172000, 0x1000, 0x1000, 0xc4202bfda0, 0xc4202d6d78, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4202bca20)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4202bca20, 0x1, 0x0, 0x0, 0x0, 0xc42013a960, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc420483440)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 645 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc420483440)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 647 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc420157c20)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 758 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc420286ea0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 704 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0ba8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420113618, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420113618, 0xc4202ae000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420113600, 0xc4202ae000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420113600, 0xc4202ae000, 0x1000, 0x1000, 0x42fa5b, 0xc4204fba40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e3d8, 0xc4202ae000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204e8120, 0xc4202ae000, 0x1000, 0x1000, 0xc420447be0, 0xc4202d7018, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207a1b00)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207a1b00, 0x1, 0x0, 0x0, 0x0, 0xc42001db60, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204e8120)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 705 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc4204e8120)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 733 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b08a8, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420781718, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420781718, 0xc4206a6000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420781700, 0xc4206a6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420781700, 0xc4206a6000, 0x1000, 0x1000, 0x42fa5b, 0xc420711a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc4201342e8, 0xc4206a6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204e8c60, 0xc4206a6000, 0x1000, 0x1000, 0xc420148560, 0xc4202d7798, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207f60c0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207f60c0, 0x1, 0x0, 0x0, 0x0, 0xc4202d7680, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204e8c60)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 734 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc4204e8c60)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 798 [IO wait, 2 minutes]:
internal/poll.runtime_pollWait(0x7fc9289b0d28, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420350298, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420350298, 0xc4206be000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420350280, 0xc4206be000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420350280, 0xc4206be000, 0x1000, 0x1000, 0x42fa5b, 0xc4204f7a40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc42000e988, 0xc4206be000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4204e8fc0, 0xc4206be000, 0x1000, 0x1000, 0xc420148980, 0xc4207f4658, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc4207f2de0)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc4207f2de0, 0x1, 0x0, 0x0, 0x0, 0xc4207f4540, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4204e8fc0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 799 [select, 2 minutes]:
net/http.(*persistConn).writeLoop(0xc4204e8fc0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

goroutine 718 [IO wait]:
internal/poll.runtime_pollWait(0x7fc9289b0728, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:173 +0x57
internal/poll.(*pollDesc).wait(0xc420126598, 0x72, 0xffffffffffffff00, 0x1ebc480, 0x1eb28d0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:85 +0xae
internal/poll.(*pollDesc).waitRead(0xc420126598, 0xc420370000, 0x1000, 0x1000)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:90 +0x3d
internal/poll.(*FD).Read(0xc420126580, 0xc420370000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:126 +0x18a
net.(*netFD).Read(0xc420126580, 0xc420370000, 0x1000, 0x1000, 0x42fa5b, 0xc42070da40, 0x45b1a0)
	/usr/local/go/src/net/fd_unix.go:202 +0x52
net.(*conn).Read(0xc420134040, 0xc420370000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:176 +0x6d
net/http.(*persistConn).Read(0xc4201567e0, 0xc420370000, 0x1000, 0x1000, 0xc420016920, 0xc4202d6118, 0x459200)
	/usr/local/go/src/net/http/transport.go:1391 +0x140
bufio.(*Reader).fill(0xc42012a120)
	/usr/local/go/src/bufio/bufio.go:97 +0x11a
bufio.(*Reader).Peek(0xc42012a120, 0x1, 0x0, 0x0, 0x0, 0xc42013a2a0, 0x0)
	/usr/local/go/src/bufio/bufio.go:129 +0x3a
net/http.(*persistConn).readLoop(0xc4201567e0)
	/usr/local/go/src/net/http/transport.go:1539 +0x185
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1186 +0xa2e

goroutine 719 [select]:
net/http.(*persistConn).writeLoop(0xc4201567e0)
	/usr/local/go/src/net/http/transport.go:1759 +0x165
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1187 +0xa53

rax    0xca
rbx    0x1fbfb60
rcx    0x4605e3
rdx    0x0
rdi    0x1fbfc98
rsi    0x0
rbp    0x7fff637aa620
rsp    0x7fff637aa5d8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x0
r13    0x0
r14    0x45de00
r15    0x0
rip    0x4605e1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0

@danielnelson danielnelson added the bug unexpected problem or unintended behavior label May 11, 2018
@danielnelson danielnelson added this to the 1.6.3 milestone May 11, 2018
@danielnelson danielnelson mentioned this issue May 11, 2018
Merged
3 tasks
@nablaone
Copy link
Author

It's working now. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug unexpected problem or unintended behavior
Projects
None yet
Milestone
1.6.3
Development

Successfully merging a pull request may close this issue.

Reuse transport on next interval in jolokia agent influxdata/telegraf
2 participants
@nablaone @danielnelson