missing mhe check in http payloads

[tarunKoyalwar]

Proposed Changes

• go mod tidy
• fix spm missing hosterrorcheck + improvements

$  ./nuclei -u http://34.116.203.241:8080 -id zip-backup-files  -stats -v -mhe 5

                     __     _
   ____  __  _______/ /__  (_)
  / __ \/ / / / ___/ / _ \/ /
 / / / / /_/ / /__/ /  __/ /
/_/ /_/\__,_/\___/_/\___/_/   v3.2.4

		projectdiscovery.io

[VER] Started metrics server at localhost:9092
[WRN] Excluded 115 template[s] with known weak matchers / tags excluded from default run using .nuclei-ignore
[INF] Current nuclei version: v3.2.4 (latest)
[INF] Current nuclei-templates version: v9.8.5 (latest)
[WRN] Scan results upload to cloud is disabled.
[INF] New templates added in latest release: 142
[INF] Templates loaded for current scan: 1
[INF] Executing 1 signed templates from projectdiscovery/nuclei-templates
[INF] Targets loaded for current scan: 1
[0:00:05] | Templates: 1 | Hosts: 1 | RPS: 4 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:10] | Templates: 1 | Hosts: 1 | RPS: 2 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:15] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:20] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[INF] Skipped 34.116.203.241:8080 from target list as found unresponsive 5 times
[0:00:25] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 5 | Requests: 31/1305 (2%)
[0:00:30] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 5 | Requests: 31/1305 (2%)
[0:00:35] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 17 | Requests: 31/1305 (2%)
[0:00:40] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 17 | Requests: 31/1305 (2%)
[0:00:45] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 26 | Requests: 31/1305 (2%)
[0:00:50] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 26 | Requests: 31/1305 (2%)
[0:00:55] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 26 | Requests: 31/1305 (2%)
[0:01:00] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 26 | Requests: 31/1305 (2%)
[WRN] [zip-backup-files] Could not execute request for http://34.116.203.241:8080: GET http://34.116.203.241:8080/htdocs.tar giving up after 2 attempts: Get "http://34.116.203.241:8080/htdocs.tar": could not connect to any address found for host; GET http://34.116.203.241:8080/public.tar giving up after 2 attempts: Get "http://34.116.203.241:8080/public.tar": could not connect to any address found for host; GET http://34.116.203.241:8080/html.tar giving up after 2 attempts: Get "http://34.116.203.241:8080/html.tar": could not connect to any address found for host
[INF] No results found. Better luck next time!
[0:01:02] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 29 | Requests: 31/1305 (2%)

Note

Since context is not propogated from spm handler to http requests level , there is a noticable delay between context being cancelled and the inflight exec's return

[ehsandeep]

./nuclei -u http://34.116.203.241:8080 -id zip-backup-files -stats -v

                     __     _
   ____  __  _______/ /__  (_)
  / __ \/ / / / ___/ / _ \/ /
 / / / / /_/ / /__/ /  __/ /
/_/ /_/\__,_/\___/_/\___/_/   v3.2.4

		projectdiscovery.io

[VER] Started metrics server at localhost:9092
[WRN] Excluded 111 template[s] with known weak matchers / tags excluded from default run using .nuclei-ignore
[INF] Current nuclei version: v3.2.4 (latest)
[INF] Current nuclei-templates version: v9.8.5 (latest)
[WRN] Scan results upload to cloud is disabled.
[INF] New templates added in latest release: 85
[INF] Templates loaded for current scan: 1
[INF] Executing 1 signed templates from projectdiscovery/nuclei-templates
[INF] Targets loaded for current scan: 1
[0:00:05] | Templates: 1 | Hosts: 1 | RPS: 4 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:10] | Templates: 1 | Hosts: 1 | RPS: 2 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:15] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:20] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 0 | Requests: 25/1305 (1%)
[0:00:25] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 6 | Requests: 31/1305 (2%)
[0:00:30] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 6 | Requests: 31/1305 (2%)
[0:00:35] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 19 | Requests: 44/1305 (3%)
[0:00:40] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 19 | Requests: 44/1305 (3%)
[0:00:45] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 27 | Requests: 52/1305 (3%)
[0:00:50] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 27 | Requests: 52/1305 (3%)
[INF] Skipped 34.116.203.241:8080 from target list as found unresponsive 30 times
[0:00:55] | Templates: 1 | Hosts: 1 | RPS: 1 | Matched: 0 | Errors: 31 | Requests: 56/1305 (4%)
[0:01:00] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 31 | Requests: 56/1305 (4%)
[0:01:05] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 43 | Requests: 56/1305 (4%)
[0:01:10] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 43 | Requests: 56/1305 (4%)
[0:01:15] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 51 | Requests: 56/1305 (4%)
[0:01:20] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 51 | Requests: 56/1305 (4%)
[0:01:25] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 54 | Requests: 56/1305 (4%)
[0:01:30] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 54 | Requests: 56/1305 (4%)
[WRN] [zip-backup-files] Could not execute request for http://34.116.203.241:8080: GET http://34.116.203.241:8080/34.116.203.241.Z giving up after 2 attempts: Get "http://34.116.203.241:8080/34.116.203.241.Z": could not connect to any address found for host; GET http://34.116.203.241:8080/34.116.203.241.sql.gz giving up after 2 attempts: Get "http://34.116.203.241:8080/34.116.203.241.sql.gz": could not connect to any address found for host; GET http://34.116.203.241:8080/34.116.203.241.tar.z giving up after 2 attempts: Get "http://34.116.203.241:8080/34.116.203.241.tar.z": could not connect to any address found for host
[INF] No results found. Better luck next time!
[0:01:33] | Templates: 1 | Hosts: 1 | RPS: 0 | Matched: 0 | Errors: 55 | Requests: 56/1305 (4%)

we need to pull all the fixes related to tests to ensure all the integration tests are passing with this change before we can merge this.