Kora: A Cloud-Native Event Streaming Platform for Kafka-Reference-Cited by-同舟云学术

Kora: A Cloud-Native Event Streaming Platform for Kafka

Published:2023-08 Issue:12 Volume:16 Page:3822-3834
ISSN:2150-8097
Container-title:Proceedings of the VLDB Endowment
language:en
Short-container-title:Proc. VLDB Endow.

Author:

Povzner Anna¹,Mahajan Prince¹,Gustafson Jason¹,Rao Jun¹,Juma Ismael¹,Min Feng¹,Sridharan Shriram¹,Bhatia Nikhil¹,Attaluri Gopi¹,Chandra Adithya¹,Kozlovski Stanislav¹,Sivaram Rajini¹,Bradstreet Lucas¹,Barrett Bob¹,Shah Dhruvil¹,Jacot David¹,Arthur David²,Dagostino Ron²,McCabe Colin²,Obili Manikumar Reddy²,Prakasam Kowshik²,Sancio Jose Garcia²,Singh Vikas²,Nikhil Alok²,Gupta Kamal²

Affiliation:

1. Confluent Inc.

2. Manveer Chawla

Abstract

Event streaming is an increasingly critical infrastructure service used in many industries and there is growing demand for cloud-native solutions. Confluent Cloud provides a massive scale event streaming platform built on top of Apache Kafka with tens of thousands of clusters running in 70+ regions across AWS, Google Cloud, and Azure. This paper introduces Kora , the cloud-native platform for Apache Kafka at the core of Confluent Cloud. We describe Kora's design that enables it to meet its cloud-native goals, such as reliability, elasticity, and cost efficiency. We discuss Kora's abstractions which allow users to think in terms of their workload requirements and not the underlying infrastructure, and we discuss how Kora is designed to provide consistent, predictable performance across cloud environments with diverse capabilities.

Publisher

Association for Computing Machinery (ACM)

Subject

General Earth and Planetary Sciences,Water Science and Technology,Geography, Planning and Development

Link

https://dl.acm.org/doi/pdf/10.14778/3611540.3611567

Reference20 articles.

1. Parallel randomized load balancing

2. Balanced allocations (extended abstract)

3. Praseed Balakrishnan . 2022. Redpanda Cloud brings the fastest Kafka® API to the cloud. Retrieved March 1, 2023 from https://redpanda.com/blog/introducing-redpanda-cloud-for-kafka Praseed Balakrishnan. 2022. Redpanda Cloud brings the fastest Kafka® API to the cloud. Retrieved March 1, 2023 from https://redpanda.com/blog/introducing-redpanda-cloud-for-kafka

4. Confluent. 2022. Confluent Cloud Service Level Agreement. Retrieved March 2, 2023 from https://assets.confluent.io/m/7225ea051b0a7b42/original/20220809-Confluent_Cloud_Service_Level_Agreement-August-2022.pdf Confluent. 2022. Confluent Cloud Service Level Agreement. Retrieved March 2, 2023 from https://assets.confluent.io/m/7225ea051b0a7b42/original/20220809-Confluent_Cloud_Service_Level_Agreement-August-2022.pdf

5. Automated Demand-driven Resource Scaling in Relational Database-as-a-Service