IndexNow

IndexNow is a simple, fast, and efficient Bash/Shell tool that helps webmasters submit URLs to major search engines that support the IndexNow protocol — including Bing, Yandex, Seznam, and Naver.

With this script, you can automate URL submission via:

• ✅ Single URLs
• 📄 Bulk from a file
• 🗺️ Sitemaps
• 🔍 Crawled links from a webpage
• 🤖 GitHub Actions (CI automation)

🛠️ Quick Setup

Clone the Repository

git clone https://github.com/nexoscreation/IndexNow.git
cd IndexNow

Set Your API Key

Generate a key from IndexNow.org and create a public .txt file hosted at the root of your site.

Example:

https://yourdomain.com/your-api-key.txt

Update Configuration

Edit settings.env to match your domain and key:

HOST="https://yourdomain.com"
API_KEY="your-api-key"
KEY_LOCATION="https://yourdomain.com/your-api-key.txt"

🚀 Usage Examples

🔗 Submit a Single URL

bash scripts/indexnow.sh -u "https://yourdomain.com/page"

📂 Submit Multiple URLs from a File

bash scripts/indexnow.sh -f urls.txt

🗺️ Submit All URLs from a Sitemap

bash scripts/indexnow.sh -s "https://yourdomain.com/sitemap.xml"

🕸️ Submit URLs Crawled from a Webpage

bash scripts/indexnow.sh -p "https://yourdomain.com"

🔁 Automate with GitHub Actions

You can integrate indexnow.sh into your CI/CD pipeline to auto-submit on push events. See the example workflow in .github/workflows.

❓ Troubleshooting Guide

🔴 Bulk Submission Failed (Invalid URLs)

• Make sure URLs match your verified HOST.
• Use https:// and the correct domain name in settings.env.

🔴 403 Forbidden (Invalid API Key)

• Confirm API_KEY is correct.
• Double-check that KEY_LOCATION is publicly accessible and content matches the key.

🔴 429 Too Many Requests

• Avoid re-submitting the same URLs rapidly.
• IndexNow applies rate-limits — wait before retrying.

📁 Log Files

• ✅ Success log: ./logs/indexnow.log
• ❌ Failed URLs: ./logs/failed_urls.log

🔍 Manual Debug Checklist

1. Verify Key File Access → Open your key file in the browser:

https://www.yourdomain.com/your-api-key.txt

2. Double-check settings.env

HOST="https://www.yourdomain.com"

3. Reload Configuration and Retry

source ./config/settings.env
bash scripts/indexnow.sh -s "https://www.yourdomain.com/sitemap.xml"