HTTP Status Tester

Start over

rasanika.com 1

Blocked by robots.txt
filibot and googlebot are not allowed to be crawled due to a blocking robots.txt rule. Are you sure the URLs are correct?
robots.txt
https://rasanika.com/robots.txt
Status code
200
Response size
527 Bytes
Reason
OK
Valid robots.txt file
Yes
URL Pattern checked
/
With user-agent
filibot (follows the same rules as Googlebot)
response headers
Connection Learn how the Connection HTTP header works.
keep-alive
Content-Type Learn how the Content-Type HTTP header works.
text/plain
X-R-Nx-Cache
MISS
MISS
X-Content-Type-Options Learn how the X-Content-Type-Options HTTP header works.
nosniff
nosniff
Content-Encoding Learn how the Content-Encoding HTTP header works.
gzip
Cache-Control Learn how the Cache-Control HTTP header works.
max-age=2592000
Transfer-Encoding Learn how the Transfer-Encoding HTTP header works.
chunked
Date Learn how the Date HTTP header works.
Sat, 18 Jan 2025 13:04:36 GMT
Expires Learn how the Expires HTTP header works.
Mon, 17 Feb 2025 13:04:36 GMT
Access-Control-Allow-Credentials Learn how the Access-Control-Allow-Credentials HTTP header works.
true
true
Server Learn how the Server HTTP header works.
nginx
Access-Control-Allow-Origin Learn how the Access-Control-Allow-Origin HTTP header works.
*
*
X-Xss-Protection Learn how the X-Xss-Protection HTTP header works.
1; mode=block
1; mode=block
request headers
User-Agent Learn how the User-Agent HTTP header works.
Mozilla/5.0 (compatible; filibot/1.0; +https://filibot.com/)
Accept-Encoding Learn how the Accept-Encoding HTTP header works.
gzip, deflate, br
Host Learn how the Host HTTP header works.
rasanika.com
X-Request-Id Learn how the X-Request-Id HTTP header works.
httpdev.2c6d32ab-5030-46e7-b8ea-17ab41777a7c
Accept Learn how the Accept HTTP header works.
*/*
Referer Learn how the Referer HTTP header works.
https://http.app/
robots.txt content
User-agent: *
Allow: /
Disallow: /i/1*/
Disallow: /i/2*/
Disallow: /v/1*/
Disallow: /v/2*/
Disallow: /a/1*/
Disallow: /a/2*/
Disallow: /d/1*/
Disallow: /d/2*/
Allow: /*/*/$
Allow: /*/*/*/*
Disallow: /i/1*/*/*.*
Disallow: /i/2*/*/*.*
Disallow: /v/1*/*/*.*
Disallow: /v/2*/*/*.*
Disallow: /a/1*/*/*.*
Disallow: /a/2*/*/*.*
Disallow: /d/1*/*/*.*
Disallow: /d/2*/*/*.*

Sitemap: https://rasanika.com/sitemaps/static.xml
Sitemap: https://rasanika.com/sitemaps/dynamic/index.xml
Sitemap: https://rasanika.com/sitemaps/google-news.xml

If you think the results above are wrong, contact Fili with the report URL and a description of what is wrong.

Start over