--- title: "llms.txt: does your website need one? | Vuelance" description: "What the file does, who actually reads it, what Google has said, and the cheaper fixes that do more for how AI tools see your business." canonical_url: "https://vuelance.com/blog/llms-txt-does-your-website-need-one" last_updated: 2025-09-09 meta: "og:description": "What the file does, who actually reads it, what Google has said, and the cheaper fixes that do more for how AI tools see your business." "og:image": "https://vuelance.com/_og/s/o_c1dfea91b778249c.png" "og:image:alt": "llms.txt: does your website need one?" "og:image:height": "630" "og:image:type": image/png "og:image:width": "1200" "og:title": "llms.txt: does your website need one? | Vuelance" "twitter:image": "https://vuelance.com/_og/s/o_c1dfea91b778249c.png" "twitter:image:alt": "llms.txt: does your website need one?" --- > Index of every page on this site: [llms.txt](https://vuelance.com/llms.txt) # **llms.txt: does your website need one?** What the file does, who actually reads it, what Google has said, and the cheaper fixes that do more for how AI tools see your business. Reviewed by **Ali Hassan** · Founder 4 min read · 9 Sep 2025 [Share on X](https://x.com/intent/post?text=llms.txt%3A%20does%20your%20website%20need%20one%3F&url=https%3A%2F%2Fvuelance.com%2Fblog%2Fllms-txt-does-your-website-need-one) [Share on LinkedIn](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fvuelance.com%2Fblog%2Fllms-txt-does-your-website-need-one) [Share on WhatsApp](https://wa.me/?text=llms.txt%3A%20does%20your%20website%20need%20one%3F%20https%3A%2F%2Fvuelance.com%2Fblog%2Fllms-txt-does-your-website-need-one) If someone has told you your website needs an llms.txt file, they are not wrong that something is changing. More people now ask ChatGPT, Perplexity or Google's AI answers about a business before they visit its site. It is natural to want a file that speaks to those tools directly. The file exists, it is easy to make, and some well-known companies publish one. The evidence that it changes anything for [**a typical business website**](https://vuelance.com/services/website-development) is thin, though. Here is what it is, who reads it, and what we would do first. ## **What the file is** [**Jeremy Howard of Answer.AI proposed llms.txt**](https://www.answer.ai/posts/2024-09-03-llmstxt.html) almost exactly a year ago, in September 2024. The idea is simple. Web pages are full of menus, scripts, cookie banners and layout that a language model has to wade through to find the useful part. So you put a plain Markdown file at yourdomain.com/llms.txt that gives the short version: the name of the business or product, a one-paragraph summary, then lists of your most useful pages, each with a line saying what it covers. The proposal also suggests offering clean Markdown copies of important pages, so a model can read the text without the clutter. Some documentation platforms go a step further and generate an llms-full.txt, which is the entire documentation in one file. Think of it as a table of contents written for software rather than people. ## **Who uses it today** Developer tools adopted it first, and for good reason. Companies like Anthropic and Cloudflare publish llms.txt files for their documentation, and the docs platform Mintlify generates one automatically for every site it hosts. When a programmer asks a coding assistant how to use an API, the assistant can fetch that one file and get to the right page without crawling the whole site. That is the use case where it clearly works: an AI tool that has been sent to your site, on behalf of a user, looking for something specific. ## **Who does not read it** The crawlers that build AI answers are another matter. None of the big AI companies has said that its crawler uses llms.txt. OpenAI, Anthropic and Perplexity document how their bots treat robots.txt and say nothing about llms.txt. Google has been the most direct. In April, [**John Mueller of Google**](https://www.searchenginejournal.com/google-says-llms-txt-comparable-to-keywords-meta-tag/544804/)'s search team said no AI system had announced it uses the file, that server logs showed crawlers were not even requesting it, and compared it to the old keywords meta tag, the one search engines stopped trusting years ago. In July, Gary Illyes said at a Google event that Google does not support llms.txt and has no plans to. There are scattered reports of OpenAI's crawler fetching the file on some sites. Fetching a file is not the same as using it in an answer, and nobody has shown that it does. > If a file's main benefit is that one crawler occasionally downloads it, it is not an SEO strategy. ## **What matters more right now** If your goal is for AI tools to describe your business correctly, a few older, duller things carry more weight. First, make sure your pages show their text without JavaScript. Several AI crawlers fetch the raw HTML of a page and do not run its scripts. A site that builds everything in the browser, as many single-page apps do, can look nearly empty to them. Server-rendered pages avoid that problem entirely. Second, decide what you want in robots.txt. OpenAI, Anthropic, Perplexity and Google each have named crawlers, and you can allow or block them separately. In July, Cloudflare started blocking AI crawlers by default for new sites it serves, so it is worth checking whether yours is being blocked without anyone deciding to. Third, put the facts in plain words. Your services, the areas you cover, your prices or price ranges, your hours, how to book. AI answers are built from text they can find and quote. A page that says "we deliver across Dubai, Sharjah and Abu Dhabi within 48 hours" is far more useful to them than a hero banner with a slogan. Fourth, keep your expectations honest. Studies so far show AI tools send very little traffic to most websites. [**Ahrefs measured AI referrals**](https://ahrefs.com/blog/ai-traffic-study/) at well under one percent of visits across thousands of sites earlier this year. That will grow, but for now Google search still sends most of the visitors. ## **So, should you add one?** If you run a software product with documentation, yes. It takes an afternoon, and it helps coding assistants and support bots find the right page. For a typical business website, it does no harm, and if your developer can add it in half an hour, fine. Just do not pay for it as an "AI visibility" service, and do not let it jump ahead of the basics above. **// Keep reading** ## Recommended for you [**All articles**](https://vuelance.com/blog) - ### [How much should a website cost a small business?](https://vuelance.com/blog/website-cost-small-business) What actually drives the price of a site, and where spending more pays for itself. [**Continue reading**: How much should a website cost a small business?](https://vuelance.com/blog/website-cost-small-business)3 min read - ### [ChatGPT ads in India: worth a try?](https://vuelance.com/blog/chatgpt-ads-in-india-should-you-try-them) Sponsored results now appear in ChatGPT in India, and self-serve buying is due to open with budgets from ₹725 a day. Who the channel suits and how to run a test that tells you something. [**Continue reading**: ChatGPT ads in India: worth a try?](https://vuelance.com/blog/chatgpt-ads-in-india-should-you-try-them)3 min read - ### [llms.txt a year on: what the data says](https://vuelance.com/blog/llms-txt-a-year-on-what-the-data-says) Adoption is up almost ninefold, AI crawlers barely ask for it, and Google has spoken. What a year of data says, and what we would advise today. [**Continue reading**: llms.txt a year on: what the data says](https://vuelance.com/blog/llms-txt-a-year-on-what-the-data-says)3 min read ```json {"@context":"https://schema.org","@graph":[{"@id":"https://vuelance.com/#website","@type":"WebSite","description":"Vuelance is an AI-native company with forward deployed engineers. Websites, apps, software and AI automation for startups and growing businesses, with a first working demo in about 2 weeks.","name":"Vuelance","url":"https://vuelance.com/","publisher":{"@id":"https://vuelance.com/#identity"}},{"@id":"https://vuelance.com/blog/llms-txt-does-your-website-need-one#webpage","@type":"WebPage","dateModified":"2025-09-09","datePublished":"2025-09-09","description":"What the file does, who actually reads it, what Google has said, and the cheaper fixes that do more for how AI tools see your business.","name":"llms.txt: does your website need one?","url":"https://vuelance.com/blog/llms-txt-does-your-website-need-one","isPartOf":{"@id":"https://vuelance.com/#website"},"potentialAction":[{"@type":"ReadAction","target":["https://vuelance.com/blog/llms-txt-does-your-website-need-one"]}],"primaryImageOfPage":{"@type":"ImageObject","url":"https://vuelance.com/img/abstract/chrome-drip.webp","inLanguage":"en","contentUrl":"https://vuelance.com/img/abstract/chrome-drip.webp"}},{"@id":"https://vuelance.com/#identity","@type":"Organization","description":"Vuelance is an AI-native company with forward deployed engineers. Websites, apps, software and AI automation for startups and growing businesses, with a first working demo in about 2 weeks.","duns":"772053576","email":"contact@vuelance.com","foundingDate":"2025","legalName":"Vuelance LLP","name":"Vuelance","telephone":"+91 79071 41635","url":"https://vuelance.com","address":{"@type":"PostalAddress","streetAddress":"Second floor, KP Tower, Thurakkal","addressLocality":"Manjeri","addressRegion":"Keralam","postalCode":"676122","addressCountry":"IN"},"contactPoint":{"@type":"ContactPoint","contactType":"sales","email":"contact@vuelance.com","telephone":"+91 79071 41635"},"logo":{"@id":"https://vuelance.com/#logo"},"sameAs":["https://facebook.com/vuelance/","https://instagram.com/vuelance_","https://x.com/vuelance_","https://linkedin.com/company/vuelance/","https://youtube.com/@vuelance"]},{"@id":"https://vuelance.com/blog/llms-txt-does-your-website-need-one#article","articleSection":"Websites","dateModified":"2025-09-09","datePublished":"2025-09-09","description":"What the file does, who actually reads it, what Google has said, and the cheaper fixes that do more for how AI tools see your business.","headline":"llms.txt: does your website need one?","inLanguage":"en","thumbnailUrl":"https://vuelance.com/img/abstract/chrome-drip.webp","@type":["Article","BlogPosting"],"author":{"@id":"https://vuelance.com/#/schema/person/1"},"image":{"@id":"https://vuelance.com/#/schema/image/1"},"isPartOf":{"@id":"https://vuelance.com/blog/llms-txt-does-your-website-need-one#webpage"},"mainEntityOfPage":{"@id":"https://vuelance.com/blog/llms-txt-does-your-website-need-one#webpage"},"publisher":{"@id":"https://vuelance.com/#identity"}},{"@id":"https://vuelance.com/#/schema/person/1","@type":"Person","jobTitle":"Founder","name":"Ali Hassan","url":"https://vuelance.com/about","image":{"@id":"https://vuelance.com/#/schema/image/2"}},{"@id":"https://vuelance.com/#logo","@type":"ImageObject","caption":"Vuelance","contentUrl":"https://vuelance.com/img/logos/vuelance-mark-512.png","inLanguage":"en","url":"https://vuelance.com/img/logos/vuelance-mark-512.png"},{"@id":"https://vuelance.com/#/schema/image/1","@type":"ImageObject","contentUrl":"https://vuelance.com/img/abstract/chrome-drip.webp","inLanguage":"en","url":"https://vuelance.com/img/abstract/chrome-drip.webp"},{"@id":"https://vuelance.com/#/schema/image/2","@type":"ImageObject","contentUrl":"https://vuelance.com/img/team/ali-hassan-avatar.webp","inLanguage":"en","url":"https://vuelance.com/img/team/ali-hassan-avatar.webp"}]} ``` ## Sitemap See the full [sitemap](https://vuelance.com/sitemap.md) for all pages.