Introducing Wziwand: we help improve reproducibility and transparency in AI/ML research, by allowing research engineers to easily find, implement, and compare the performance of SOTA papers and methods.

Why it matters:

The AI/ML boom hasn’t just increased the number of papers — it has fragmented the landscape. With thousands of preprints hitting arXiv each month, the “state of the art” (SOTA) in a specific niche can change over a weekend. For researchers and research engineers, the cognitive overhead of filtering through incremental gains to find true architectural breakthroughs has become unsustainable. Wizwand is built to help people track AI/ML research progress across a wide range of domains.

The challenge:

Over the past many years, several products have tried to solve this problem, but we’ve seen a few common issues:

- Table understanding is hard at scale: Research papers tend to use non-standard tables, which makes extracting the right data points and their correct attributes challenging. A small mistake can produce a wildly incorrect result.

- Apples-to-apples comparison is difficult: Should general image classification methods be compared with medical image classification methods? Should methods tested on the “same” dataset but different versions or splits be compared? When building benchmarks, there hasn’t been a good way to ensure truly apples-to-apples comparisons.

Wizwand solution:

- Table understanding at the paper level is made possible through a combination of LLMs, OCR, and rule-based pipelines. We can extract data points with complex attributes from tables with high accuracy, including non-standard tables.

- We determine whether two methods are comparable using full-paper understanding — not just dataset and metric. This enables fairer, more meaningful benchmarks.

Team:

We’re a team of CS/ML engineers from UC Berkeley, Google, Airbnb, and Microsoft.

Asks:

- We’re looking for feedback from research engineers and researchers to share your feedback and thoughts on how we can improve Wizwand to work better for you.

- You can reach out to the founders directly at allan@wizwand.com or follow us on X (@wizwand_team).