Scaling Airbnb’s identity graph with a unified knowledge graph infrastructure
Airbnb transitioned from using a PaaS graph database to building an internal knowledge graph infrastructure for improved performance. The identity graph, crucial for trust and safety, initially relied on relational databases and then a SaaS graph, facing scalability and latency challenges. The new, internally-managed infrastructure, built on JanusGraph and DynamoDB, provides a unified platform. Key optimizations like custom transactions and parallel query execution were implemented to meet Airbnb's performance needs. This platform supports multi-tenant operations with schema enforcement. Client-side query optimizations, including rewriting Gremlin queries, further enhanced performance. The internal graph infrastructure significantly increased scalability and improved system stability. Performance gains were achieved across various query patterns, leading to faster read API response times. The self-managed system provides a quicker resolution for incidents. The new system scaled to 10x the write QPS of the previous solution. The migration resulted in a considerable reduction in P99 latency for complex queries. Airbnb's knowledge graph now supports critical use cases.