Robotstxt.org Web Analysis and Statistics

Website Summary

  • When was the website Robotstxt.org released?

    Robotstxt.org was registered on September 4, 2000 (23 years 8 months 6 days ago).

  • What is the traffic rank for Robotstxt.org?

    Website Robotstxt.org ranked 156,021 globally and 34,986 in India.

  • How many people visit Robotstxt.org each day?

    Robotstxt.org has about 7,300 visits and 26,000 pageviews per day.

  • Which countries does Robotstxt.org receive most of its visitors from?

    Robotstxt.org is mostly visited by people located in India, United States and Pakistan.

  • How much does Robotstxt.org earn a month?

    Each month Robotstxt.org can earn $1,650 from advertising revenue.

  • How much is Robotstxt.org worth?

    Estimated value of Robotstxt.org is $33,000

  • What IP addresses does Robotstxt.org resolve to?

    Robotstxt.org resolves to the IP addresses 93.93.131.3

  • Where is Robotstxt.org server located?

    Robotstxt.org's server is located in England, Cambridge, United Kingdom Of Great Britain And Northern , Cb5.

  • Who is registrar of Robotstxt.org domain?

    The robotstxt.org domain is registered and managed by Tucows Domains Inc.

Robotstxt.org's metrics:

Global traffic rank:
156,021
Traffic rank in India:
34,986
Domain authority:
77 / 100
Referring Domains:
1,414
Daily income:
$55.00
Estimated Worth:
$33,000
Google Adsense Publisher ID:
pub-9311532361854131
Owner info:
Martijn Koster
Website category:
Software/Hardware
Safety status:
Safe

HTML Analysis

HTML Meta tags:

Title: The Web Robots Pages

Logo: robotstxt.org

HTML elements:

H1 Headings:
0
H2 Headings:
1
H3 Headings:
0
H4 Headings:
0
H5 Headings:
0
H6 Headings:
0
Total Images:
1
Total IFRAMEs:
0

Links analysis:

Total links:
24
Internal links:
21
Internal links (nofollow):
0
External links:
1
External links (nofollow):
0

HTML resources breakdown:

The homepage of robotstxt.org contains 63 resources, the total size is 681.41 KB. They are distributed as follows:

Resource type Resource count Size Percent
Document 14 104.44 KB 15.3 %
Image 7 85.66 KB 12.6 %
Font 0 0 0 %
Script 28 470.47 KB 69 %
Stylesheet 1 2.67 KB 0.4 %
Media 0 0 0 %
Other 13 18.19 KB 2.7 %

In addition, the robotstxt.org homepage also uses 59 third-party resources, the total size is 673.03 KB.

HTTP Header:

Http-Version: 1.1
Status-Code: 200
Status: 200 OK
Date: Fri, 27 Jan 2023 00:12:40 GMT
Server: Apache/2.4.38 (Debian)
Vary: User-Agent,Referer,Accept-Encoding
Last-Modified: Sun, 03 May 2020 13:29:25 GMT
ETag: "110b-5a4be6736ce42-gzip"
Accept-Ranges: bytes
Content-Encoding: gzip
Content-Length: 1486
Content-Type: text/html

Robotstxt.org Traffic Analysis

Daily unique visitors:
7,300
Daily pageviews:
26,000
Daily pageviews per visitor:
3.6
Daily time on site:
1:48 minutes
Traffic from search engine:
24.0 %
Bounce rate:
67.0 %
Monthly visits:
219,000
Annual visits:
2,664,500

Traffic by country:

# Country Traffic Percent Country Rank
1 🇮🇳 India 30.6% 34,211
2 🇺🇸 United States 17.1% 57,667
3 🇵🇰 Pakistan 3.9% 40,522

Top keywords by traffic:

Keyword Search traffic
robots.txt 10.12%
robots txt 7.21%
robots.txt disallow all 6.36%
robots.txt disallow 4.19%
robots.txt file 1.98%

Google Lighthouse Audit

Google Lighthouse is an open-source, automated tool for measuring the quality of web pages. Google Lighthouse audits websites on two separate mobile and desktop environments. Audit results are based on scores from 1-100 and are divided into 5 parts:

  • Performance: This is the most important part, it evaluates the performance of your website. Performance based on Core Web Vitals and key parameters such as First Contentful Paint (FCP), First Input Delay (FID), Largest Contentful Paint (LCP) and Cumulative Layout Shift (CLS).
  • Accessibility: Test user accessibility to your web application.
  • Best Practices: Website Trust and Safety testing, extensions, XSS, HTTPS...
  • SEO (on page): These checks ensure that your page is following basic search engine optimization advice.
  • Progressive Web App (PWA): Check out the modern technologies used on your web app.

Here are the results of the Google Lighthouse audit for the website robotstxt.org:

On Mobile

57
Performance
78
Accessibility
67
Best Practices
69
SEO
0-49 50-89 90-100

On Desktop

88
Performance
78
Accessibility
75
Best Practices
82
SEO (on page)

Robotstxt.org Domain Name Information

Domain TLD:
org
Domain Registrar:
Tucows Domains Inc.
Registration Date:
September 4, 2000
Expiration Date:
September 4, 2023
Domain Age:
23 years 8 months 6 days
Domain Status:
ok

Domain Nameserver Information:

Host IP Address Country
ns1.mythic-beasts.com 45.33.127.156 🇺🇸 United States
ns2.mythic-beasts.com 93.93.128.67 🇬🇧 United Kingdom

Full WHOIS Lookup:

Domain Name: robotstxt.org
Registry Domain ID: 98e51d0f2bc743b8baf0a9b9b892c5de-LROR
Registrar WHOIS Server: whois.tucows.com
Registrar URL: http://www.tucows.com
Updated Date: 2023-01-18T08:29:08Z
Creation Date: 2000-09-04T14:43:31Z
Registry Expiry Date: 2023-09-04T14:43:31Z
Registrar: Tucows Domains Inc.
Registrar IANA ID: 69
Registrar Abuse Contact Email: [email protected]
Registrar Abuse Contact Phone: +1.4165350123
Domain Status: ok https://icann.org/epp#ok
Registry Registrant ID: REDACTED FOR PRIVACY
Registrant Name: REDACTED FOR PRIVACY
Registrant Organization: none
Registrant Street: REDACTED FOR PRIVACY
Registrant City: REDACTED FOR PRIVACY
Registrant State/Province: Norfolk
Registrant Postal Code: REDACTED FOR PRIVACY
Registrant Country: GB
Registrant Phone: REDACTED FOR PRIVACY
Registrant Phone Ext: REDACTED FOR PRIVACY
Registrant Fax: REDACTED FOR PRIVACY
Registrant Fax Ext: REDACTED FOR PRIVACY
Registrant Email: Please query the RDDS service of the Registrar of Record identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name.
Registry Admin ID: REDACTED FOR PRIVACY
Admin Name: REDACTED FOR PRIVACY
Admin Organization: REDACTED FOR PRIVACY
Admin Street: REDACTED FOR PRIVACY
Admin City: REDACTED FOR PRIVACY
Admin State/Province: REDACTED FOR PRIVACY
Admin Postal Code: REDACTED FOR PRIVACY
Admin Country: REDACTED FOR PRIVACY
Admin Phone: REDACTED FOR PRIVACY
Admin Phone Ext: REDACTED FOR PRIVACY
Admin Fax: REDACTED FOR PRIVACY
Admin Fax Ext: REDACTED FOR PRIVACY
Admin Email: Please query the RDDS service of the Registrar of Record identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name.
Registry Tech ID: REDACTED FOR PRIVACY
Tech Name: REDACTED FOR PRIVACY
Tech Organization: REDACTED FOR PRIVACY
Tech Street: REDACTED FOR PRIVACY
Tech City: REDACTED FOR PRIVACY
Tech State/Province: REDACTED FOR PRIVACY
Tech Postal Code: REDACTED FOR PRIVACY
Tech Country: REDACTED FOR PRIVACY
Tech Phone: REDACTED FOR PRIVACY
Tech Phone Ext: REDACTED FOR PRIVACY
Tech Fax: REDACTED FOR PRIVACY
Tech Fax Ext: REDACTED FOR PRIVACY
Tech Email: Please query the RDDS service of the Registrar of Record identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name.
Name Server: ns1.mythic-beasts.com
Name Server: ns2.mythic-beasts.com
DNSSEC: signedDelegation
URL of the ICANN Whois Inaccuracy Complaint Form: https://www.icann.org/wicf/
>>> Last update of WHOIS database: 2023-01-27T00:12:37Z

Robotstxt.org Server Information

Server IP Address:
93.93.131.3
Hosted Country:
🇬🇧 United Kingdom
Latitude, longitude:
51.7333 , -2.36667
Location:
England, Cambridge, United Kingdom Of Great Britain And Northern , Cb5

DNS Record Analysis:

Host Type TTL Extra
robotstxt.org A 3600 IP: 93.93.131.3
robotstxt.org NS 86400 Target: ns2.mythic-beasts.com
robotstxt.org NS 86400 Target: ns1.mythic-beasts.com
robotstxt.org SOA 86400 MNAME: ns2.mythic-beasts.com
RNAME: hostmaster.mythic-beasts.com
Serial: 2010010905
Refresh: 21600
Retry: 7200
Expire: 604800
Minimum TTL: 3600
robotstxt.org MX 3600 Priority: 10
Target: mx.mythic-beasts.com
robotstxt.org TXT 300 TXT: v=spf1 include:_spf.mythic-beasts.com ~all
robotstxt.org TXT 300 TXT: google-site-verification=FuTkdKut4zpT5f61O29qfjnWKg3u5iA292tOglYwZuo
robotstxt.org AAAA 3600 IPV6: 2a00:1098::86:1000:0:0:33

3 websites similar to Robotstxt.org

1.Deepcrawl.com(13% similarity)

deepcrawl.com Rank:51,491 Worth:$120,000 DA:51

Lumar is the website intelligence platform of choice for enterprise brands around the world. Discover your website's full commercial potential with Lumar.

2.Launchdigitalmarketing.com(11% similarity)

launchdigitalmarketing.com Rank:868,552 Worth:$820

Award-winning Chicago digital marketing agency built to make big things happen for brands online with website design, video production, creative campaigns, PPC, SEO, e-mail, and social media.

3.Searchfacts.com(8% similarity)

searchfacts.com Rank:289,458 Worth:$13,000

Learn to get lots of search traffic by building great websites with high-quality content. The main topics here are SEO and web development.

Typos of Robotstxt.org

Sometimes, misspellings make a good domain name. And spelling errors are also a great way to create keywords for SEO. And the following are all possible typos of Robotstxt.org. You can use them for competitive domain name search or for SEO strategies for Robotstxt.org:

  1. eobotstxt.org
  2. dobotstxt.org
  3. fobotstxt.org
  4. tobotstxt.org
  5. 5obotstxt.org
  6. 4obotstxt.org
  7. ribotstxt.org
  8. rkbotstxt.org
  9. rlbotstxt.org
  10. rpbotstxt.org
  11. r0botstxt.org
  12. r9botstxt.org
  13. rovotstxt.org
  14. ronotstxt.org
  15. rohotstxt.org
  16. rogotstxt.org
  17. robitstxt.org
  18. robktstxt.org
  19. robltstxt.org
  20. robptstxt.org
  21. rob0tstxt.org
  22. rob9tstxt.org
  23. roborstxt.org
  24. robofstxt.org
  25. robogstxt.org
  26. roboystxt.org
  27. robo6stxt.org
  28. robo5stxt.org
  29. robotatxt.org
  30. robotztxt.org
  31. robotxtxt.org
  32. robotdtxt.org
  33. robotetxt.org
  34. robotwtxt.org
  35. robotsrxt.org
  36. robotsfxt.org
  37. robotsgxt.org
  38. robotsyxt.org
  39. robots6xt.org
  40. robots5xt.org
  41. robotstzt.org
  42. robotstct.org
  43. robotstdt.org
  44. robotstst.org
  45. robotstxr.org
  46. robotstxf.org
  47. robotstxg.org
  48. robotstxy.org
  49. robotstx6.org
  50. robotstx5.org
  51. obotstxt.org
  52. rbotstxt.org
  53. rootstxt.org
  54. robtstxt.org
  55. robostxt.org
  56. robottxt.org
  57. robotsxt.org
  58. robotstt.org
  59. robotstx.org
  60. orbotstxt.org
  61. rbootstxt.org
  62. roobtstxt.org
  63. robtostxt.org
  64. robosttxt.org
  65. robottsxt.org
  66. robotsxtt.org
  67. robotsttx.org
  68. rrobotstxt.org
  69. roobotstxt.org
  70. robbotstxt.org
  71. robootstxt.org
  72. robottstxt.org
  73. robotsstxt.org
  74. robotsttxt.org
  75. robotstxxt.org
  76. robotstxtt.org

Thank you for reading our analysis & statistics about Robotstxt.org website. If you find it interesting, please share it with your friends. If you have any suggestions, please comment below or contact us.

Let's share 💋💋💋