Skip to content
NewA calmer, faster ZeroHour

Vals, backed by Andreessen Horowitz, is looking to become the gold standard for AI benchmarking

TechCrunch · AIby Lucas Ropek ()4 min read2
AI summary · glm-5.3-flashSummaries by Vani AI

Vals, an AI benchmarking startup, raised a $40 million Series A led by Andreessen Horowitz to evaluate models on real-world industry tasks.

Vals, a startup formed in 2024, raised a $40 million Series A led by Andreessen Horowitz after a seed round led by 8VC and Bloomberg Beta. Co-founder Rayan Krishnan says the company keeps its test materials private and evaluates models on complex tasks in domains like law, finance, coding, cybersecurity, biosecurity, and mental health. The company reports revenue eight times last year's level, has grown from 8 to 25 staff, and launched an evaluation program for US federal agencies.

Key facts
  • Raised $40M Series A led by Andreessen Horowitz; earlier seed led by 8VC and Bloomberg Beta.
  • Keeps benchmark test materials private to prevent models training against them.
  • Evaluates models on domain tasks including law, finance, coding, and cybersecurity.
  • Revenue is eight times last year's; staff tripled to 25 with plans to hire 10-15 more.
  • Launched a program providing model evaluations to federal agencies.
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

4 min read at techcrunch.com

Vals AI is hoping to make AI benchmarking a more neutral and trustworthy resource in a world increasingly inundated by AI models.

TechCrunch · AI

By Lucas Ropek · techcrunch.com

Read the full article at TechCrunch · AI

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.