80, 443 - HTTP

PRIMARY CATEGORY → PROTOCOLS AND SERVICES

MANDATORY READ

Go here to see all the information related to Pentesting Web

Enumeration

Banner Grabbing

Netcat

nc -nv <TARGET> <PORT> <<< ""

HTTP Headers Analysis

Curl

curl --silent --request GET --location --head "<URL>"

Known Web Files

Robots.txt

curl --silent --request GET --location "http[s]://<TARGET>[:<PORT>]/robots.txt"

Web Technologies

Whatweb

whatweb <URL>
whatweb --verbose <URL> # Verbose Mode

WAF Check

Wafw00f

Reference

wafw00f --verbose --findall <URL>

Crawlers

ReconSpider (HTB)

Reference

curl --silent --request GET --location "https://github.com/HowdoComputer/ReconSpider-HTB/raw/refs/heads/main/ReconSpider.py" --remote-name

python3 -m venv .venv
. !$/bin/activate && pip3 install scrapy

python3 ReconSpyder.py <URL>