use maxsize

[dogancanbakir]

Proposed changes

Closes #4722

$ go run . -duc  -nh -retries 0 -rl 100 -bs 200 -target http://0.0.0.0:2379/debug_mode_nuclei_dump -t test.yaml -v

                     __     _
   ____  __  _______/ /__  (_)
  / __ \/ / / / ___/ / _ \/ /
 / / / / /_/ / /__/ /  __/ /
/_/ /_/\__,_/\___/_/\___/_/   v3.2.0-dev

                projectdiscovery.io

[VER] Started metrics server at localhost:9092
[WRN] Found 1 templates loaded with deprecated protocol syntax, update before v3 for continued support.
[INF] Current nuclei version: v3.2.0-dev (development)
[INF] Current nuclei-templates version: v9.7.6 (latest)
[WRN] Scan results upload to cloud is disabled.
[INF] New templates added in latest release: 49
[INF] Templates loaded for current scan: 1
[WRN] Executing 1 unsigned templates. Use with caution.
[INF] Targets loaded for current scan: 1
[VER] [200-code] Sent HTTP request to http://0.0.0.0:2379/debug_mode_nuclei_dump
[200-code] [http] [info] http://0.0.0.0:2379/debug_mode_nuclei_dump

$ python3 test.py
Server started http://0.0.0.0:2379
GET request, Path: 1e20baa1-dbc5-4d97-aa47-8e29bffc1b36 /debug_mode_nuclei_dump
127.0.0.1 - - [28/Feb/2024 00:12:23] "GET /debug_mode_nuclei_dump HTTP/1.1" 200 -
GET request, number: Path: 1e20baa1-dbc5-4d97-aa47-8e29bffc1b36 /debug_mode_nuclei_dump finished

Checklist

• Pull request is created against the dev branch
• All checks passed (lint, unit/integration/regression tests etc.) with my changes
• I have added tests that prove my fix is effective or that my feature works
• I have added necessary documentation (if appropriate)

[tarunKoyalwar]

we also have a max read size option from cli input . so we can use this code which exists on line 810-815 and move it before this logic

	// define max body read limit
	maxBodylimit := -1 // stick to default 4MB
	if request.MaxSize > 0 {
		maxBodylimit = request.MaxSize
	} else if request.options.Options.ResponseReadSize != 0 {
		maxBodylimit = request.options.Options.ResponseReadSize
	}

[tarunKoyalwar]

lgtm !

minor update - just recalled that we added this implementation in utils/http which also accepts maxBodyRead size . updated it and removed residual code