Skip to content

References ​

The standards eyeful reviews against, and the three projects it builds on.

Software quality ​

  • ISO/IEC 25010:2023, Product quality model. The experts are divided along its characteristics (roster).

Code review ​

Design and maintainability ​

  • T. J. McCabe, "A Complexity Measure", IEEE TSE, 1976. Cyclomatic complexity.
  • W. Stevens, G. Myers and L. Constantine, "Structured Design", IBM Systems Journal, 1974. Coupling and cohesion.
  • R. C. Martin, Design Principles and Design Patterns, 2000. SOLID.
  • M. Nygard, Documenting Architecture Decisions, 2011.

Correctness and security ​

Testing ​

  • E. T. Barr, M. Harman, P. McMinn, M. Shahbaz and S. Yoo, "The Oracle Problem in Software Testing: A Survey", IEEE TSE, 41(5), 2015. Specified, derived, implicit and human oracles (the oracle).
  • ISO/IEC/IEEE 29148:2018, Requirements engineering. Inspection, analysis, demonstration and test (evidence).
  • C. E. Jimenez et al., "SWE-bench: Can Language Models Resolve Real-World GitHub Issues?", ICLR 2024. Fail-to-pass, pass-to-pass, and the statuses PASSED, FAILED and ERROR (the verifier).
  • R. Just, D. Jalali and M. D. Ernst, "Defects4J", ISSTA 2014. A fault is tied to the change that introduced it: the introduced gate.
  • C. Zhang et al., "SoK: DARPA's AI Cyber Challenge (AIxCC): Competition Design, Architectures, and Lessons Learned", arXiv:2602.07666, 2026. A proof of vulnerability, then a patch validated by reproducing it and running the functional tests: the two claims the gates support. A precedent, not where the gates come from.
  • N. Alshahwan et al., "Automated Unit Test Improvement using Large Language Models at Meta", FSE Companion 2024. A generated test is kept only if it builds and gives the same result over five runs: the runs and not_flaky gates.
  • ISO/IEC/IEEE 29119, Software testing. Test design techniques.
  • A. van Deursen, L. Moonen, A. van den Bergh and G. Kok, "Refactoring Test Code", XP 2001. Test smells.
  • Y. Jia and M. Harman, "An Analysis and Survey of the Development of Mutation Testing", IEEE TSE, 2011.
  • Martian, "Code Review Bench", 2026, https://github.com/withmartian/code-review-benchmark. The offline set and the judge match.py runs.

Usability and accessibility ​

Readability and documentation ​

Projects ​

From antfu/pulls.review (MIT). eyeful runs @pulls.review/core to group the change (The plan) and shows its summary first in the terminal. It also takes three ideas:

IdeaWhere
Sort files with rules before any model runsTriage
Read a working tree through a copy of the indexThe snapshot
Review a large change one scope at a timeLarge changes

From umputun/revmux:

IdeaWhere
A fixed sequence of stagesStages
Merge findings within two lines and count their sourcesThe ranked report
Carry on with less when a step failsStages
Pass the previous round's findings to the nextRounds
Keep a round's input beside its outputsnapshot.json and change.diff
One process per reviewerEach expert runs on its own
A cap on concurrent reviewers and time limits per callAgents

From alibaba/open-code-review (Apache-2.0), compared on 2026-10-28 after a 58-minute cloud review:

IdeaWhere
Eight experts or judges at once, and a 15-minute cap on each callAgents
A time limit on each model requestAgents and models

Compared with similar tools ​

Claude Code ultrareviewrevmuxOpen Code Revieweyeful
Who picks reviewersNot publishedThe caller picks a profileRules match files; one agent per file bundleA planner groups the change; Go picks by rule
What is reviewedBugsWhat the profile's lenses coverDefects, guided by review rules per fileDesign, functionality, security, tests, usability, readability
How findings are verifiedReproduced in a cloud sandboxAnother agent reads the codeA reflection pass re-reads each comment; nothing runsThe verifier runs a test; the rest is marked review
FeedbackFindings, without fixesJSON or Markdown with a fix textLine comments and a summaryConventional Comments in a ranked report
Where it runsAnthropic's cloudInside the reviewed repositoryThe user's machine, CI jobs and IDE pluginsThe user's machine, or a sandbox per pull request