Empathia AI: robots.txt & llms.txt Optimization Guide
1. robots.txt Analysis & Best Practices
Current File
/robots.txtUser-agent: * Disallow: Sitemap: https://www.empathia.ai/sitemap.xml
- Located at: https://www.empathia.ai/robots.txt
- Allows all crawlers (Disallow is blank)
- Includes sitemap for SEO
- No disallowed paths; no explicit LLM/crawler rules
Recommendations
- Allow LLM and major search bots explicitly: Signals open-access and AI-friendliness
- Block private or sensitive sections if any, using
Disallow - Continue referencing your sitemap
Optimized Example
# robots.txt for https://www.empathia.ai User-agent: * Allow: / User-agent: Googlebot Allow: / User-agent: Gemini Allow: / User-agent: Googlebot-News Allow: / User-agent: Google-CloudVertexBot Allow: / User-agent: Google-Extended Allow: / User-agent: OAI-SearchBot/1.0; +https://openai.com/searchbot Allow: / User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot Allow: / User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.1; +https://openai.com/gptbot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / Sitemap: https://www.empathia.ai/sitemap.xml
Tip: If you have private/admin paths (e.g. /admin/), add:
Disallow: /admin/
2. llms.txt Analysis & Best Practices
/llms.txt- No current
llms.txtfound - Should be at https://www.empathia.ai/llms.txt
Optimized Example
# Empathia AI > Effortless AI charting assistant for healthcare professionals ### Metadata title: Empathia AI – Effortless Charting Assistant description: Empathia AI streamlines charting and note-taking for healthcare providers, reducing admin burdens and saving time. domain: www.empathia.ai language: en category: Healthcare, AI, Medical Automation, Productivity keywords: Empathia, AI charting, medical assistant, physician notes, healthcare AI, documentation, workflow, mobile app ### Core Pages - [Homepage](https://www.empathia.ai): Overview, features, download links for iOS & Android, and contact info. ### App Store Links - iOS: https://apps.apple.com/us/app/empathia-ai/id6464452134 - Android: https://play.google.com/store/apps/details?id=ai.empathia.physicians ### Accessibility alt_text_present: true structured_data: true mobile_friendly: true ### SEO robots_txt: /robots.txt ### Summary Empathia AI is built for healthcare professionals to automate and simplify patient charting—available on both iOS and Android platforms.
3. Summary Table
| File | Exists? | Best Practices | Optimized? | Improvements |
|---|---|---|---|---|
| robots.txt | Yes | Allow/disallow as needed, include sitemap, place at root | Mostly – could add explicit LLM UAs & admin disallows (if needed) | Add LLM bot rules; restrict sensitive admin/private if needed |
| llms.txt | No | Summarize product & metadata, place at root | Needs to be created | See optimized sample above |
4. Action Steps
- Place robots.txt and llms.txt at your domain root (
/robots.txt,/llms.txt) - Use the optimized templates above (edit if you have private paths or more metadata)
- Review/update regularly as your platform and LLM ecosystem evolves
Need tailored
Disallow rules or custom LLMS metadata? Feel free to reach out!