Technical Information
| HTTP Status Code | 200 |
| HTTP Version | HTTP/1.1 |
| HTTPS | ✔ Available |
| IP Address | 93.93.131.3 |
| Server Software | Apache/2.4.68 (Debian) |
| Compression | gzip |
|
🔒 🟡 Mixed Content (1 HTTP resources) | The page is served over HTTPS but loads 1 resource(s) over HTTP. This may be blocked in modern browsers. |
|
ℹ 🔵 Missing HSTS | HTTP Strict Transport Security is not configured. Recommended for HTTPS sites. |
|
ℹ 🔵 Missing Content Security Policy | CSP is not configured. It helps prevent XSS attacks and content injection. |
|
ℹ 🔵 Missing X-Frame-Options | The site can be embedded in iframes by third parties (clickjacking risk). |
HTTP Status Code 200
HTTP Version HTTP/1.1
HTTPS ✔ Available
IP Address 93.93.131.3
Server Software Apache/2.4.68 (Debian)
Compression gzip
🔒 🟡 Mixed Content (1 HTTP resources) The page is served over HTTPS but loads 1 resource(s) over HTTP. This may be blocked in modern browsers.
ℹ 🔵 Missing HSTS HTTP Strict Transport Security is not configured. Recommended for HTTPS sites.
ℹ 🔵 Missing Content Security Policy CSP is not configured. It helps prevent XSS attacks and content injection.
ℹ 🔵 Missing X-Frame-Options The site can be embedded in iframes by third parties (clickjacking risk).
Redirect Chain
| # | URL | HTTP Status Code | Status |
| 1 | https://robotstxt.org:443 | 301 | HTTP/1.1 301 Moved Permanently |
| 2 | http://www.robotstxt.org/ | 200 | HTTP/1.1 200 OK |
#1 URL https://robotstxt.org:443
HTTP Status Code 301
Status HTTP/1.1 301 Moved Permanently
#2 URL http://www.robotstxt.org/
HTTP Status Code 200
Status HTTP/1.1 200 OK
Performance
| DNS Lookup | 152.9 ms |
| TCP Connect | 166.1 ms |
| TLS Handshake | ~80 ms |
| Time To First Byte (TTFB) | 191.4 ms |
| Content Download | 0.1 ms |
| Total Response Time | 191.5 ms |
DNS Lookup 152.9 ms
TCP Connect 166.1 ms
TLS Handshake ~80 ms
Time To First Byte (TTFB) 191.4 ms
Content Download 0.1 ms
Total Response Time 191.5 ms
Security
| HTTPS | ✔ Enabled |
| HSTS | ✘ Not configured |
| CSP | ⚠ Not configured |
| X-Frame-Options | ⚠ Not configured |
| X-Content-Type-Options | ⚠ Not configured |
| HTTP/2 | ⚠ HTTP/1.1 |
HTTPS ✔ Enabled
HSTS ✘ Not configured
CSP ⚠ Not configured
X-Frame-Options ⚠ Not configured
X-Content-Type-Options ⚠ Not configured
HTTP/2 ⚠ HTTP/1.1
SEO Quick Check
| Title | The Web Robots Pages |
Title The Web Robots Pages
Detected Technologies
Technology Apache
HTTP Headers
| Date
| Tue, 28 Jul 2026 17:53:22 GMT |
| Server
| Apache/2.4.68 (Debian) |
| Vary
| User-Agent,Accept-Encoding |
| Last-Modified
| Sun, 03 May 2020 13:29:25 GMT |
| ETag
| "110b-5a4be6736ce42-gzip" |
| Accept-Ranges
| bytes |
| Content-Encoding
| gzip |
| Content-Length
| 1486 |
| Content-Type
| text/html |
Date Tue, 28 Jul 2026 17:53:22 GMT
Server Apache/2.4.68 (Debian)
Vary User-Agent,Accept-Encoding
Last-Modified Sun, 03 May 2020 13:29:25 GMT
ETag "110b-5a4be6736ce42-gzip"
Accept-Ranges bytes
Content-Encoding gzip
Content-Length 1486
Content-Type text/html
