50,000 Kubernetes Deployments Achieved: Inside the Streaming Database Odyssey

Yingjun Wu | Founder and CEO at RisingWave Labs

In the realm of distributed SQL streaming databases, RisingWave stands as a beacon of innovation and achievement. Over the last three years, RisingWave has pushed the boundaries of stream processing and database management and achieved an astounding milestone — 50,000 Kubernetes cluster deployments. This article takes you on a journey through the rise of RisingWave as a streaming database, its remarkable achievements, the driving forces behind its success, and its future outlook.

A Chronicle of Achievement

Inception and Genesis (2020)

The story of RisingWave began in 2020 with a vision to revolutionize stream processing and database management. The project’s inception marked the start of a transformative journey of stream processing, laying the groundwork for what was to come. With a clear vision, RisingWave embarked on a path to redefine data processing — how data is processed and managed in real time.

A Rusty Transformation (July 2021)

A pivotal moment arrived in July 2021 when RisingWave underwent a remarkable transformation. The project transitioned from its original C++ codebase to embrace the power of Rust. This strategic shift not only improved the technical foundation of RisingWave but also enabled greater security and efficiency. This transformation marked a turning point that set the stage for the project’s rapid growth in stream processing.

Embracing Open Source (April 2022)

In April 2022, RisingWave embraced the spirit of collaboration by becoming open-source on GitHub under the Apache 2.0 license. This decision opened the doors to a vibrant and engaged community interested in real-time analytics. The move toward open source fostered transparency, encouraged contributions, and positioned RisingWave as a project with a promising future.

Seeding Success (October 2022)

By October 2022, RisingWave had achieved a significant milestone — successful deployment in the production environments of seed customers. This achievement validated the practical applicability of the project and showcased its capabilities in real-world scenarios. The successful deployment laid the foundation for the wider adoption of stream processing across various industries.

Enterprise Encompassment (April 2023)

The transition from seed customers to enterprise production environments marked a crucial step for RisingWave. The project’s robustness and ability to handle enterprise-grade workloads were demonstrated through successful bulk deployments of Kubernetes clusters in these environments. RisingWave’s adaptability and performance were recognized, further solidifying its position as a reliable streaming database.

First Official Release (July 2023)

In July 2023, RisingWave proudly unveiled its first official release — version 1.0. This milestone reflected the project’s maturity and readiness for diverse applications. The release was met with excitement from the community and marked a significant step toward realizing RisingWave’s full potential.

Community and Recognition (August 2023)

The growth of the RisingWave community was a testament to its value and impact. By August 2023, the Slack community had surpassed 1,000 members, and the project had garnered over 5,000 stars on GitHub. This widespread recognition showcased RisingWave’s growing influence and indicated the community’s belief in stream processing.

Unveiling the Reasons Behind the Surge

The meteoric rise of RisingWave can be attributed to its standout features, making it the preferred choice for stream processing and real-time analytics.

Superior Usability: A PostgreSQL Connection

RisingWave’s compatibility with PostgreSQL sets it apart. The seamless integration within the PostgreSQL ecosystem simplifies development and debugging, enhancing program interpretability and maintainability. The PostgreSQL-like user interface reduces complexities, allowing developers to focus on innovation rather than grappling with technical intricacies.

Excellent Cost-Effectiveness: Efficiency Redefined

Through a decoupled compute-storage architecture and layered storage mechanism, RisingWave outperforms its predecessors in stream processing. It achieves over ten times the efficiency in processing complex streaming queries. The support for stacked materialized views optimizes resource utilization, allowing shared computation across different tasks.

Simplified Data Stack: Streamline and Simplify

RisingWave’s self-sufficient data storage capability is a game-changer. It supports both stream processing and ad-hoc query serving, enabling users to consolidate systems and simplify their data stack. This streamlined approach reduces the total cost of ownership and empowers users to focus on their core objectives.

A Thriving Ecosystem

RisingWave’s growth is a testament to its broad user base. Across fintech, manufacturing, energy, e-commerce, and IoT industries, RisingWave finds extensive applications. The project’s adaptability and versatility make it valuable in diverse settings. The upcoming series of user case analyses will provide deeper insights into RisingWave’s real-world implementations, offering valuable knowledge to those interested in stream processing and databases.

Unveiling Insights: User Case Analyses

To provide a comprehensive understanding of RisingWave’s application scenarios and advantages, a series of user case analyses is in the works. These analyses will delve into real-world implementations across various industries, showcasing RisingWave’s impact and benefits. By registering for the newsletter, readers can stay informed about the latest insights and developments.

CONCLUSION

RisingWave’s journey to 50,000 Kubernetes cluster deployments is a testament to its innovation, usability, and efficiency. With its focus on simplifying complex tasks and empowering users, RisingWave has emerged as a trailblazer in stream processing and real–time analytics. As its community continues to grow and its capabilities expand, RisingWave is set to shape the future of data management and analysis across diverse industries.

About RisingWave Labs

RisingWave is an open-source distributed SQL database for stream processing. It is designed to reduce the complexity and cost of building real-time applications. RisingWave offers users a PostgreSQL-like experience specifically tailored for distributed stream processing.

Official Website: risingwave.com

GitHub：github.com/risingwavelabs/risingwave

LinkedIn：linkedin.com/company/risingwave-labs