Tanzu Tuesdays 55 - Orchestrating Data Pipelines with Data Flow with Glenn Renfro

June 9, 2021

With the quantity and types of data that must be processed in real time by enterprises today, we may be asking ourselves, “How do we create solutions to process this data and how do we orchestrate these solutions?” This discussion shows how Spring Cloud Data Flow (SCDF) can continuously deploy, scale, monitor, and manage your stream and batch workloads by using the capabilities on Kubernetes. This session walks you through the tooling capabilities of SCDF. In addition to the core orchestration features, you will also see a demo of creating a real-time streaming pipeline on Kubernetes, using recipes such as functional composition of the applications, and managing workloads. You will also see a demo on scheduling and continuously deploying batch workloads on Kubernetes, creating a single-step batch job with no coding, and distributing batch job processing across multiple machines. --- As a VMware engineer, Glenn Renfro is a core committer for Spring Cloud Task, Spring Batch, and Spring Cloud Data Flow. He has 14 years of experience in designing, building, and delivering enterprise-level applications in Java and 21 years total of software development experience. https://twitter.com/cppwfs https://github.com/cppwfs

Previous
Tanzu.TV/Code 32 - Spring Boot: robust, performant and efficient: pick three with Josh Long
Tanzu.TV/Code 32 - Spring Boot: robust, performant and efficient: pick three with Josh Long

Hey Spring fans! In this installment, we’re going to explore the wide world of proxies in the wide world of...

Next Video
Tanzu Talk: How Kubernetes Helps Businesses, results from the State of Kubernetes 2021 survey
Tanzu Talk: How Kubernetes Helps Businesses, results from the State of Kubernetes 2021 survey

Coté goes over his highlights for the 2021 State of Kubernetes survey: rising production use, the benefits ...

Subscribe to our videos on YouTube!

Subscribe