I Can See Clearly Now: Dashboarding and Multi I/O as Spring Cloud Data Flow for Kubernetes 1.1 Goes GA

September 2, 2020 Sabby Anandan

Spring Cloud Data Flow (SCDF) for Kubernetes 1.1 is now generally available, building on the open source SCDF version 2.6 released in August. The Kubernetes-based commercial offering leverages Tanzu Observability by Wavefront for dashboarding and observability, and enables developers to take their data pipelines to the next level with the introduction of Multi I/O for event-streaming applications.

Watch those pipelines

When developers are polled on the most desirable platform features, dashboards and the ability to observe what’s happening reliably are at the top of everyone’s wish list. That’s no surprise—there’s only so much that even the most talented developer can digest while watching a Matrix-style terminal window as text scrolls by. 

So we are delighted to make Spring developers’ dreams come true with a new dashboard and observability for Spring Cloud Data Flow for Kubernetes. While useful out of the box, the dashboard is just the tip of the iceberg in terms of what’s possible when you start observing behavior patterns of event-streaming and batch applications at scale.

The new SCDF dashboard, powered by Tanzu Observability

For developers who want to understand how SCDF applications perform in production, Tanzu Observability provides an SCDF Integration tile with performance overview dashboards and detailed real-time message rates, throughput, latency, and error metrics. Such comprehensive observability enables developers to drill down and find the root cause of bottlenecks for event-streaming data pipelines and of increased latencies for batch data pipelines.

With the newly released Spring Boot dashboard, Spring developers can add observability across a breadth of application scenarios. To use the SCDF dashboard (as well as a new one for Spring Boot), sign up for the Tanzu Observability free trial.

Advanced event-streaming topologies

Event-streaming data-processing in SCDF typically takes the form of linear data pipelines with data coming from a single upstream topic, and the processed data published to a single downstream topic. While this has worked well for most common event-streaming use cases, there are many in which a more functional programming model is better suited.

For example, applications that interact with multiple upstream and downstream Kafka topics are a great fit for the functional programming model. However, this Multi I/O pattern can make it cumbersome to reason through and orchestrate the advanced nature of microservices with more than a single input/output.

So, in Spring Cloud Data Flow v1.1 for Kubernetes, we are launching an interactive dashboard and a brand new UI/UX to discover the function-style event handlers and Kafka Streams topologies with one or more input and output destinations (i.e., topics). The new dashboard will help with the discovery and interactive design of data pipelines made of advanced event-streaming applications. The functional-style design also extends to SCDF’s catalog of applications, in which the new Multi I/O dashboard is also available.

As we continue to explore functional-style applications in SCDF, we’re also writing an ongoing blog series (see Part 1  Part 2  Part 3  Part 4  Part 5 and Part 6) to highlight and articulate the design patterns as case studies. 

Get started today!

For background:

To start using the Spring Boot and SCDF dashboards, sign up for the Tanzu Observability free trial.

About the Author

Sabby Anandan

Sabby Anandan is a Product Manager on the Spring Team at VMware. He focuses on building products that address the challenges faced with iterative development and operationalization of data-intensive applications at scale. Before joining VMware, Sabby worked in engineering and management consulting positions. He holds a Bachelor’s degree in Electrical and Electronics from the University of Madras and a Master’s in Information Technology and Management from Carnegie Mellon University.

More Content by Sabby Anandan
Spring at SpringOne 2020: The Enterprise Developer Platform for Right Now
Spring at SpringOne 2020: The Enterprise Developer Platform for Right Now

Spring has emerged as the standard for modern Java application development, and it keeps evolving. Here are...

What’s New in Spring Cloud Gateway for VMware Tanzu
What’s New in Spring Cloud Gateway for VMware Tanzu

Spring Cloud Gateway for VMware Tanzu offers a developer-friendly API gateway experience that includes oper...

SpringOne 2022

Register Now