Crawlee.dev valuation and analysis
Robots.txt Information
| Robot | Path | Permission |
| GoogleBot | / | ✔ |
| BingBot | / | ✔ |
| BaiduSpider | / | ✔ |
| YandexBot | / | ✔ |
Meta Tags
| Title | Crawlee · The scalable web crawling, scraping and automation library for JavaScript/Node.js | Crawlee |
| Description | N/A |
| Keywords | N/A |
Server Information
| WebSite | |
| Host IP | 185.199.109.153 |
| Location | United States |
Related Websites
| Site | Rank |
More to Explore
| danielleburkehealing.com |
| dawshaaa.com |
| detoa.cz |
| emarhotel.bg |
| ertebatpardazan.ir |
| failet.sa |
| fanfinfin.co |
| feedel.ventures |
| fivestarfruits.com |
| fragranceoftaj.in |
| panchocolate.com |
| ourhealthhb.nz |
Crawlee.dev Valuation
|
US$113,376
Last updated: Jul 25, 2022
Crawlee.dev has global traffic rank of 757,925. Crawlee.dev has an estimated worth of US$ 113,376, based on its estimated Ads revenue. Crawlee.dev receives approximately 4,141 unique visitors each day. Its web server is located in United States, with IP address 185.199.109.153. According to SiteAdvisor, crawlee.dev is safe to visit. |
Traffic & Worth Estimates
| Purchase/Sale Value | US$113,376 |
| Daily Ads Revenue | US$62 |
| Monthly Ads Revenue | US$1,863 |
| Yearly Ads Revenue | US$22,675 |
| Daily Unique Visitors | 4,141 |
| Note: All traffic and earnings values are estimates. | |
Traffic Ranks
| Global Rank | 757,925 |
| Delta (90 Days) | 0 |
| Most Popular In Country | N/A |
| Country Rank | N/A |
DNS Records
| Host | Type | TTL | Data |
| crawlee.dev | A | 60 | IP: 185.199.108.153 |
| crawlee.dev | A | 60 | IP: 185.199.110.153 |
| crawlee.dev | A | 60 | IP: 185.199.111.153 |
| crawlee.dev | A | 60 | IP: 185.199.109.153 |
| crawlee.dev | AAAA | 60 | IPv6: 2606:50c0:8000:0:0:0:0:153 |
| crawlee.dev | AAAA | 60 | IPv6: 2606:50c0:8002:0:0:0:0:153 |
| crawlee.dev | AAAA | 60 | IPv6: 2606:50c0:8003:0:0:0:0:153 |
| crawlee.dev | AAAA | 60 | IPv6: 2606:50c0:8001:0:0:0:0:153 |
| crawlee.dev | NS | 21600 | Target: ns-1761.awsdns-28.co.uk. |
| crawlee.dev | NS | 21600 | Target: ns-330.awsdns-41.com. |
| crawlee.dev | NS | 21600 | Target: ns-919.awsdns-50.net. |
| crawlee.dev | NS | 21600 | Target: ns-1067.awsdns-05.org. |
| crawlee.dev | SOA | 900 | MNAME: ns-1761.awsdns-28.co.uk. RNAME: awsdns-hostmaster.amazon.com. Serial: 1 Refresh: 7200 Retry: 900 Expire: 1209600 Minimum TTL: 86400 |
HTTP Headers
HTTP/1.1 301 Moved Permanently Server: GitHub.com Content-Type: text/html Location: https://crawlee.dev/ X-GitHub-Request-Id: F120:7DA4:4C8F20:7FBA7A:62DE5CD8 Content-Length: 162 Accept-Ranges: bytes Date: Mon, 25 Jul 2022 09:05:28 GMT Via: 1.1 varnish Age: 0 Connection: keep-alive X-Served-By: cache-lga21945-LGA X-Cache: MISS X-Cache-Hits: 0 X-Timer: S1658739929.646330,VS0,VE9 Vary: Accept-Encoding X-Fastly-Request-ID: 36c4ddcd419edbbc8e0766304767ba83698eeb77 HTTP/2 200 server: GitHub.com content-type: text/html; charset=utf-8 last-modified: Mon, 25 Jul 2022 00:24:32 GMT access-control-allow-origin: * strict-transport-security: max-age=31556952 etag: "62dde2c0-7b84" expires: Mon, 25 Jul 2022 09:15:28 GMT cache-control: max-age=600 x-proxy-cache: MISS x-github-request-id: 21B2:37E0:1A1DEB:4893A9:62DE5CD8 accept-ranges: bytes date: Mon, 25 Jul 2022 09:05:28 GMT via: 1.1 varnish age: 0 x-served-by: cache-lga21920-LGA x-cache: MISS x-cache-hits: 0 x-timer: S1658739929.690919,VS0,VE17 vary: Accept-Encoding x-fastly-request-id: 9c0cfa6f1271adec1f93c9eaff27ef40a39f49d6 content-length: 31620 |
Crawlee.dev Whois Information
Domain Name: crawlee.dev Registry Domain ID: 497669081-DEV Registrar WHOIS Server: whois.google.com Registrar URL: domains.google Updated Date: 2022-07-13T11:32:18Z Creation Date: 2022-07-08T11:32:18Z Registry Expiry Date: 2023-07-08T11:32:18Z Registrar: Google LLC. Registrar IANA ID: 895 Registrar Abuse Contact Email: registrar-abuse@google.com Registrar Abuse Contact Phone: +1.8772376466 Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited Registry Registrant ID: REDACTED FOR PRIVACY Registrant Name: REDACTED FOR PRIVACY Registrant Organization: Contact Privacy Inc. Customer 7151571251 Registrant Street: REDACTED FOR PRIVACY Registrant City: REDACTED FOR PRIVACY Registrant State/Province: ON Registrant Postal Code: REDACTED FOR PRIVACY Registrant Country: CA Registrant Phone: REDACTED FOR PRIVACY Registrant Email: Please query the WHOIS server of the owning registrar identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. Registry Admin ID: REDACTED FOR PRIVACY Admin Name: REDACTED FOR PRIVACY Admin Organization: REDACTED FOR PRIVACY Admin Street: REDACTED FOR PRIVACY Admin City: REDACTED FOR PRIVACY Admin State/Province: REDACTED FOR PRIVACY Admin Postal Code: REDACTED FOR PRIVACY Admin Country: REDACTED FOR PRIVACY Admin Phone: REDACTED FOR PRIVACY Admin Email: Please query the WHOIS server of the owning registrar identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. Registry Tech ID: REDACTED FOR PRIVACY Tech Name: REDACTED FOR PRIVACY Tech Organization: REDACTED FOR PRIVACY Tech Street: REDACTED FOR PRIVACY Tech City: REDACTED FOR PRIVACY Tech State/Province: REDACTED FOR PRIVACY Tech Postal Code: REDACTED FOR PRIVACY Tech Country: REDACTED FOR PRIVACY Tech Phone: REDACTED FOR PRIVACY Tech Email: Please query the WHOIS server of the owning registrar identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. Registry Billing ID: REDACTED FOR PRIVACY Billing Name: REDACTED FOR PRIVACY Billing Organization: REDACTED FOR PRIVACY Billing Street: REDACTED FOR PRIVACY Billing City: REDACTED FOR PRIVACY Billing State/Province: REDACTED FOR PRIVACY Billing Postal Code: REDACTED FOR PRIVACY Billing Country: REDACTED FOR PRIVACY Billing Phone: REDACTED FOR PRIVACY Billing Email: Please query the WHOIS server of the owning registrar identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. Name Server: ns-1067.awsdns-05.org Name Server: ns-1761.awsdns-28.co.uk Name Server: ns-330.awsdns-41.com Name Server: ns-919.awsdns-50.net DNSSEC: unsigned URL of the ICANN Whois Inaccuracy Complaint Form: https://www.icann.org/wicf/ Please query the WHOIS server of the owning registrar identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. |