Software EngineeringAirbnb
Airbnb migrated 3,500 test files with an LLM pipeline in 6 weeks instead of 1.5 years
~3,500 test files migrated in 6 weeks; about 97% fully automated and the rest finished by hand.
Company reportedLLM pipeline (custom)
Ride-hailing, delivery, travel, and logistics. 5 real deployments, each with sources, reported outcomes, and caveats.
~3,500 test files migrated in 6 weeks; about 97% fully automated and the rest finished by hand.
Average resolution time fell by more than 87%, with thousands of requests resolved per day (company claim).
70,000+ questions answered across 154 Slack channels, with an estimated 13,000 engineering hours saved.
Uber estimates a query that took about 10 minutes to write by hand now takes about 3 minutes; the limited release reached ~300 daily active users.
A voice agent ready for live testing in about two months, answering in 2.5 seconds or less, with 50x more testing capacity.