Site search

Search IndexLane

Type at least two characters to search.

    Open-source SEO launch checks

    crawlcontract — catch SEO regressions before release

    An open-source command-line tool that checks whether sitemaps, canonicals, redirects, robots rules, and internal links agree. Run it against a static build or live website, and use it in CI to block releases with the errors you choose.

    Project
    crawlcontract
    Release
    Version 0.3.1
    License
    MIT OR Apache-2.0
    Language
    Rust
    RustTokioHTTPXML sitemapsSARIFGitHub Actions

    About the project

    crawlcontract

    An open-source command-line tool that checks whether sitemaps, canonicals, redirects, robots rules, and internal links agree. Run it against a static build or live website, and use it in CI to block releases with the errors you choose.

    Early release: v0.3.1. Source and binaries are public. Snapshot formats may change before the first stable release.

    What it does

    • Checks pages from a static build or live HTTP responses
    • Reports conflicts between sitemaps, page settings, redirects, and links
    • Compares releases and flags changes beyond your chosen thresholds
    • Emits terminal, JSON, Markdown, and SARIF reports with stable CI exit codes

    How it works

    What it checks

    • Sitemap URLs resolve, remain crawlable and indexable, and identify the expected canonical
    • HTML and HTTP canonical signals agree; canonical targets resolve without chains or cycles
    • Meta robots and X-Robots-Tag directives combine restrictively with robots.txt crawl rules
    • Internal links resolve directly to verified targets and indexable pages remain reachable from the entry point
    • Hreflang alternates are reciprocal, self-inclusive, and aligned with canonical targets

    Use it in your release checks

    • Scans a static build directory or a bounded-concurrency live or preview URL
    • Maps a preview origin onto the intended public URL identity with --public-origin
    • Applies policy exclusions, failure severities, and snapshot-diff loss thresholds
    • Writes terminal, JSON, Markdown, or SARIF findings and returns CI-specific exit codes
    • Publishes checksummed binaries for Linux, macOS, and Windows from tagged releases

    Current limitations

    The v0.3.1 release uses snapshot schema 1.0, and compatibility is not promised before the first stable release. Live scans inspect response HTML rather than a browser-rendered DOM, sitemap discovery currently follows one index level without .xml.gz support, and offline scans cannot verify cross-origin targets.