Screenshot of CodeLens

2026 · Solo

CodeLens

AI reviews of your pull requests from a model on your own GPU — every finding backed by the code it cites.

v1 done · Desktop 0.1.1 released

Each repo is kept as a bare git mirror and parsed with tree-sitter (Python, JavaScript, TypeScript) into a graph of modules, classes, functions and methods with calls/imports/inherits/contains edges; every function is embedded into pgvector. A review diffs the PR against its merge-base, retrieves related code for each changed function by meaning, packs the diff and context into the model's 8k window with fixed per-part budgets, and asks for schema-constrained JSON findings. Validation then drops anything not on a changed line, not citing shown code, or not confident enough — with anchoring snapping findings that land 1–3 lines off back onto the change. The evaluation harness came before any improvement: 49 seeded bugs, 18 counterfactuals (the same change made safe by its callers) and 16 clean refactors, with an upgrade adopted only if F1's paired 95% bootstrap CI is above zero. Anchoring passed (F1 +0.113); four other ideas failed the gate and were not shipped — and the honest result that, with an 8B model, retrieved context doesn't pay for itself yet is reported as is.

Features

  • GitHub App — mirrors and indexes a repo, then posts one review with inline comments on every push to a pull request
  • Code graph built with tree-sitter, with every function embedded for retrieval by meaning (pgvector, HNSW)
  • Hallucination guard — a finding must sit on a changed line and cite code the model was shown, or it is dropped (and kept, with the reason)
  • Evaluation-gated pipeline — 83-case test set, paired bootstrap confidence intervals; only upgrades that pass the gate ship
  • Dashboard that shows its work — diff with findings, live timeline, call graph around the change, and a trace of what retrieval found and what the model saw
  • Runs fully locally on Ollama — no code leaves the machine; repos are read as git objects, never executed
  • CodeLens Desktop — a Windows installer whose first-run wizard sets up Docker, Ollama, the models and your own GitHub App, no terminal
  • Public read-only demo on Vercel + Supabase, with 410+ Python tests, 130+ dashboard unit tests and 79 Playwright browser tests in CI

Tech stack

Review Pipeline

  • Python 3.12
  • tree-sitter
  • SQLAlchemy (async)
  • Pydantic
  • no LLM framework

Models

  • Ollama
  • qwen3:8b (structured JSON)
  • qwen3-embedding:0.6b

Backend

  • FastAPI
  • Server-Sent Events
  • JWT
  • GitHub App webhooks
  • Celery
  • Redis

Data

  • Postgres 16
  • pgvector (HNSW)

Dashboard

  • Next.js 16
  • React 19
  • Tailwind 4
  • shadcn/ui
  • React Flow
  • Shiki
  • Playwright + axe

Hosting

  • Vercel
  • Supabase
  • Cloudflare DNS