---
title: "Airbnb"
description: "Global travel marketplace and engineering pioneer in industrial Eval-Driven Development (EDD) for generative AI applications."
section: "entities"
type: "entity"
created: "2026-08-27"
updated: "2026-08-27"
confidence: "high"
tags: ["organization", "evaluation", "workflow"]
canonical: "https://pyweb.dev/wiki/airbnb"
---
# Airbnb

Airbnb is a global accommodation and travel platform whose engineering organisation has pioneered the methodology of [eval driven development](/wiki/eval-driven-development) (EDD) for GenAI systems at scale. [[source: airbnb-eval-driven-development-2026]](/wiki/raw/articles/airbnb-eval-driven-development-2026)

## Contributions to GenAI Engineering

Airbnb established core industrial practices for evaluating generative AI systems, formalizing the **Three-Layer Eval Funnel**:
1. **Layer 1:** Fast, deterministic programmatic checks (schemas, AST, regex).
2. **Layer 2:** Small, sharp LLM-as-a-judge evaluators focused on single orthogonal dimensions.
3. **Layer 3:** High-leverage human evaluation for trace discovery and policy calibration.

Their foundational rule ("When in doubt, look at your data") mandates inspecting 100 baseline execution traces to derive targeted evaluators rather than creating theoretical metrics in isolation.

## Related
- [eval driven development](/wiki/eval-driven-development) — core methodology
- [agentic code quality](/wiki/agentic-code-quality) — multi-tier quality architecture
- [error analysis and evals](/wiki/error-analysis-and-evals) — trace analysis
- [hamel husain](/wiki/hamel-husain) — evals methodology

---

## Agent Navigation

cluster: person (170 pages) | betweenness: 24.2

### References (outbound)
- [Eval-Driven Development](https://pyweb.dev/wiki/eval-driven-development.md)
- [Agentic Code Quality](https://pyweb.dev/wiki/agentic-code-quality.md)
- [Error Analysis and Evals](https://pyweb.dev/wiki/error-analysis-and-evals.md)
- [Hamel Husain](https://pyweb.dev/wiki/hamel-husain.md)

### Referenced by (inbound)
- [Eval-Driven Development](https://pyweb.dev/wiki/eval-driven-development.md)
- [Agentic Code Quality Cycle 2 — Entity Accounting](https://pyweb.dev/wiki/agentic-code-quality-cycle-2-entity-accounting.md)

### Evidence (verified primary sources)
- [airbnb-eval-driven-development-2026](https://pyweb.dev/wiki/raw/articles/airbnb-eval-driven-development-2026.md) | origin: https://medium.com/airbnb-engineering/eval-driven-development-lessons-from-evaluating-genai-at-scale-e817e5ae5788 | ingested: 2026-08-27 | sha256: 94414a24787cabca4537e9a34113139762e66eb17d3996269377298569a51b0c

### Machine endpoints
- Knowledge graph: https://pyweb.dev/api/graph.json
- Graph analysis: https://pyweb.dev/api/graph-analysis.json
- Context index: https://pyweb.dev/llms.txt