Robots & Crawler Indexing Directives

Compassionate Love of Calvary Ministries | Official Search Engine Policy

Overview & Indexing Guidelines

This document outlines the crawler directives, bot policies, and indexing permissions for Compassionate Love of Calvary Ministries (CLM). All major search engines (including Google, Bing, Yahoo, DuckDuckGo, Baidu, and Yandex) are welcome to index our public ministry content, devotionals, events, sermons, and articles.

✔ Allowed Public Routes

Crawlers are permitted and encouraged to crawl and index all public ministry pages:

  • / (Home Page)
  • /about (About Ministry)
  • /ministries (Ministries & Outreach)
  • /bible (Holy Bible)
  • /study (Bible Study)
  • /devotional (Daily Devotions)
  • /sermons (Sermons & Media)
  • /events (Church Events)
  • /blog (Articles & News)
  • /media (Gallery & Videos)
  • /contact (Location & Inquiries)

✖ Restricted & Protected Routes

Private consoles, authentication portals, and backend APIs must NOT be indexed:

  • /admin (Admin Console)
  • /admin/* (All Admin Editors)
  • /adminLogin (Authentication Portal)
  • /api/* (Internal REST Endpoints)
  • /django-admin/* (Backend Administration)

Raw robots.txt Configuration

The active, machine-readable crawler configuration file is located at https://www.loveofcalvary.org/robots.txt.

# ==============================================================================
# Robots.txt for Compassionate Love of Calvary Ministries
# ==============================================================================

User-agent: *
Allow: /
Allow: /about
Allow: /ministries
Allow: /bible
Allow: /study
Allow: /devotional
Allow: /sermons
Allow: /events
Allow: /blog
Allow: /media
Allow: /contact

Disallow: /admin
Disallow: /admin/
Disallow: /admin/*
Disallow: /adminLogin
Disallow: /api/
Disallow: /django-admin/

Sitemap: https://www.loveofcalvary.org/sitemap.xml
Host: https://www.loveofcalvary.org