Seventeen developers independently built the same fix for a Slack direct messaging bug in OpenClaw, and all sat unreviewed in the pull request backlog. According to an analysis released today by VectorCertain LLC, this is not an isolated incident but a systemic crisis costing the project an estimated 2,000 hours of wasted developer time.
Using its proprietary multi-model AI consensus platform, VectorCertain analyzed all 3,434 open pull requests in the OpenClaw GitHub repository, one of the world's most starred AI projects with 197,000 followers. The findings show that 20% of all pending contributions are duplicates, representing thousands of hours of redundant effort. Specifically, the analysis identified 283 duplicate clusters where multiple developers independently built the same fix, totaling 688 redundant PRs clogging the review pipeline. Additionally, 54 PRs were flagged for vision drift, and security fixes were duplicated three to six times each while known vulnerabilities remained unpatched.
VectorCertain's entire analysis—processing 48.4 million tokens across three independent AI models—cost just $12.80 in compute and ran in approximately eight hours. The technology uses three models (Llama 3.1 70B, Mistral Large, and Gemini 2.0 Flash) that evaluate each PR separately and fuse their judgments using consensus voting, a safety-critical approach used in autonomous vehicles and medical AI systems.
These findings arrive at a pivotal moment for OpenClaw. On February 15, project creator Peter Steinberger announced his departure to OpenAI and the project's transition to a foundation structure. The next day, the ClawdHub skill marketplace suffered a production database outage. Steinberger's public response was blunt: "unit tests aint cut it" for maintaining the platform at scale. The VectorCertain analysis proves he is right but shows the problem runs even deeper than testing. "Unit tests verify that code does what a developer intended," explains Joseph P. Conroy, founder and CEO of VectorCertain. "Multi-model consensus verifies that what the developer built is the right thing to build. These are fundamentally different questions, and large-scale open-source projects need both."
OpenClaw's governance challenges extend beyond duplicate PRs. The project has faced mounting security concerns, including the ClawHavoc campaign that identified 341 malicious skills in its marketplace and a Snyk report finding credential-handling flaws in 7.1% of registered skills. Meanwhile, PR submissions have vastly outpaced review capacity—over 3,100 PRs pending at any given time, despite maintainers merging hundreds of commits daily. The 2,000 hours of wasted developer time represent just the tip of the iceberg.
The claw-review tool used for this analysis is open source (MIT License) and available now on GitHub, enabling any project to conduct similar analyses. VectorCertain's enterprise platform scales the multi-model consensus approach to safety-critical domains including autonomous vehicles, cybersecurity, healthcare, and financial services. Founded by Joseph P. Conroy, a 25-year veteran of safety-critical AI development for federal agencies, VectorCertain holds an extensive patent portfolio covering AI ensemble systems and multi-model consensus architectures.
The comprehensive analysis of the openclaw/openclaw repository examined all 3,434 open pull requests using three AI models: Llama 3.1 70B, Mistral Large, and Gemini 2.0 Flash. The platform processed 48.4 million tokens over an eight-hour runtime, with total compute costs of just $12.80—translating to $0.0037 per PR analyzed. The analysis identified 283 duplicate clusters representing 688 redundant PRs (20% of the total backlog) and an estimated 2,000 hours of wasted developer time, with PRs averaging a quality score of 8.35 out of 10. An interactive dashboard and complete report are available at jconroy1104.github.io/claw-review/dashboard.html and jconroy1104.github.io/claw-review/claw-review-report.html.
