OpenSourceProjects logo
anubis logo

anubisWeighs the soul of incoming HTTP requests to stop AI crawlers

Weighs the soul of incoming HTTP requests to stop AI crawlers

21,057 stars
663 forks
Go
MIT

Screenshot not available yet

anubis

Anubis is a lightweight Web AI Firewall Utility written in Go that protects your website from AI scraper bots by challenging incoming HTTP requests. Designed for independent creators and small internet communities, it provides an affordable defense against the constant barrage of requests from AI training operations without requiring expensive third-party services.

Key Features

  • Challenge-Based Protection: Weighs the "soul" of incoming connections using configurable challenges to verify legitimate traffic
  • Lightweight Architecture: Minimal resource footprint ensures accessibility for projects of all sizes
  • Customizable Bot Policies: Define allowlists for known good bots like the Internet Archive while blocking scrapers

Use Cases

  • Independent Websites: Protect small websites and blogs from AI data scraping when Cloudflare or similar services aren't viable
  • Community Resources: Defend community-run projects and archives from being harvested by commercial AI training datasets
  • Self-Hosted Services: Safeguard self-hosted content and services from automated crawler bots

Who Is It For

Anubis is ideal for independent creators, small communities, and self-hosted projects that need effective bot protection but cannot or prefer not to rely on centralized third-party solutions. It's particularly valuable for those who want to prevent their content from being used in AI training datasets without sacrificing accessibility to legitimate users.