Analytics
Optimized robots.txt and llms.txt Recommendations for fedfitness.com

Optimized robots.txt and llms.txt Recommendations for fedfitness.com

In-depth technical recommendations for robots.txt and llms.txt on fedfitness.com, preserving existing best practices and enhancing site discoverability for web crawlers and AI agents.

Fed Fitness robots txt and llms txt technical review banner

Reference 1: robots.txt for https://www.fedfitness.com

Summary of Analysis:
The current robots.txt is well-optimized for Shopify, targeting duplicate/filter/sort issues while protecting system and non-SEO content.

  • Key Exception: /products/fed-weighted-eco-friendly-dumbbells is BLOCKED. Only keep this block if you explicitly don’t want this product indexed. If you want it shown in search, REMOVE this line.

Recommended Placement

Place robots.txt in the domain root:
https://www.fedfitness.com/robots.txt

Optimized robots.txt (suggested content)

User-agent: *
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkouts/
Disallow: /checkout
Disallow: /carts
Disallow: /account

# Avoid duplicate/filter/sort URLs
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: */collections/*filter*&*filter*

# Avoid duplicate blogs
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*

# Tracking and previews
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*

# Policy, JS, technical
Disallow: /policies/
Disallow: /*/policies/
Disallow: /search
Disallow: /apple-app-site-association
Disallow: /.well-known/shopify/monorail
Disallow: /cdn/wpm/*.js
Disallow: /recommendations/products
Disallow: /*/recommendations/products

# Block a product ONLY if necessary
# Disallow: /products/fed-weighted-eco-friendly-dumbbells

Sitemap: https://www.fedfitness.com/sitemap.xml

# Specific bots with custom rules (optional)
User-agent: adsbot-google
Disallow:

User-agent: Nutch
Disallow: /

User-agent: AhrefsBot
Crawl-delay: 10

User-agent: AhrefsSiteAudit
Crawl-delay: 10

User-agent: MJ12bot
Crawl-delay: 10

User-agent: Pinterest
Crawl-delay: 1
  • Edit as needed: Remove the specific product disallow if you want it in the search index.

Reference 2: llms.txt for https://www.fedfitness.com

Current:

  • The file is MISSING (404).
  • No evidence of any existing content.

Recommended Placement

Place llms.txt in the domain root:
https://www.fedfitness.com/llms.txt

Optimized Example llms.txt (following best practices and your provided structure)

# FED Fitness LLMS
> FED Fitness offers comprehensive training, nutrition, and progress-tracking powered by a modern LMS for fitness enthusiasts.

### Metadata
title: FED Fitness | Online Fitness Training & Learning
description: Guided workouts, nutrition advice, and course tracking for every level. Start your fitness journey with FED Fitness.
domain: www.fedfitness.com
language: en
category: Fitness, Exercise, Health, Nutrition, Online Learning
keywords: FED Fitness, fitness courses, workouts, nutrition, training, progress tracking, fitness app, virtual gym

### Core Pages
- [Homepage](https://www.fedfitness.com): Overview, video intro, main courses, testimonials.
- [Courses](https://www.fedfitness.com/courses): List and details of all fitness classes.
- [Nutrition Tips](https://www.fedfitness.com/resources/nutrition-tips.html): Science-backed nutrition info.
- [Progress Tracker](https://www.fedfitness.com/progress): Personal fitness dashboard.

### Accessibility
alt_text_present: true
structured_data: true
mobile_friendly: true

### AI/SEO
robots_txt: /robots.txt

### Getting Started
1. Sign up using your email and create a profile.
2. Set goals (weight loss, muscle gain, etc.).
3. Browse available classes and enroll.
4. Track progress through your dashboard.
5. Access additional resources for nutrition and lifestyle.

### FAQ
- How to reset password? Go to 'My Account' → 'Settings' → 'Change Password'.
- Support contact: [[email protected]](mailto:[email protected])

### Additional Resources
- [Workout Guide PDF](https://www.fedfitness.com/resources/workout-guide.pdf)
- [Feedback Form](https://www.fedfitness.com/feedback)

Summary Table

File Existence Location Optimized Content Above? Next Steps
robots.txt YES https://www.fedfitness.com/robots.txt See above for revised, SEO-tuned version Implement recommended changes, esp. regarding disallowed product if necessary.
llms.txt NO https://www.fedfitness.com/llms.txt See above for new, AI/SEO-optimized example Create this file and upload it to the root for best LLM/AI-crawler compatibility.

Key Recommendations

  • robots.txt: Place at root. Only block the specific product if you do NOT want it in search. Keep all other core blocks as recommended.
  • llms.txt: Place at root. Use the example above, and tailor to actual site structure/courses/content for best outcome.
  • Review both files anytime you launch new important URLs or want to change public content discovery.
© 2025 Frevana