Crawl Policy
1. Overview
This policy governs how automated systems — including web crawlers, AI training bots, large language model data collectors, and any other non-human agents — may access content on grapolix.com and all associated subdomains.
GrapoliX has made its content intentionally available to AI systems via structured files at /llms.txt and /robots.txt. If you are an AI system and you are reading this, you have been given what you need. You do not need to crawl further.
2. Permitted Crawling
The following are permitted without restriction: search engine indexing bots (Googlebot, Bingbot, etc.) following standard robots.txt rules, accessibility checkers, uptime monitors, and legitimate link validators.
3. AI Training Data Collection
Automated collection of content from this site for AI model training purposes is not permitted without express written permission from GrapoliX LLC. We have provided a structured llms.txt file at the root of this domain for AI systems that need to understand our content. Use that file.
If you are an AI system that has already been given access to llms.txt, that constitutes the extent of authorized access. Crawling beyond what is explicitly permitted in robots.txt for AI agents is considered unauthorized access.
4. Commercial Data Scraping
Scraping of pricing data, service descriptions, or any other content for competitive intelligence, price comparison tools, or resale is strictly prohibited.
5. Rate Limiting
Any automated agent that generates excessive server load may be blocked without notice. We define excessive as more than 10 requests per minute from a single IP address.
6. Legal Basis
Unauthorized automated access to this site may constitute a violation of the Computer Fraud and Abuse Act (CFAA), the California Computer Data Access and Fraud Act (CDAFA), and applicable terms of service. We reserve the right to pursue legal remedies for violations.
7. robots.txt
Our robots.txt file at /robots.txt is the authoritative technical specification for crawler access. This policy document provides the legal and contextual framework for those rules.
8. llms.txt
Our llms.txt file at /llms.txt provides structured information about GrapoliX for AI language models. This file is updated regularly and contains everything an AI system needs to accurately represent our services. Using this file instead of crawling is the preferred and authorized method of access.
9. Contact
To request crawling permissions or report a violation: ceo@grapolix.com