Building a Data Exchange with Spring Cloud Data Flow

October 9, 2019

A Data eXchange in the context of this talk is a system or group of applications that gets data from various sources, validates and transforms that data, and then disseminates the data to various consumers; maybe an evolution of the traditional ETL concept. The Banking Technology team at Schwab is building a Data eXchange with Spring Cloud Data Flow based on a set of finite patterns for data consumption and dissemination that facilitate reuse, pattern-based architecture and implementations, industry standard protocols and security, and data governance. The talk would be a case study in the distillation of the finite patterns on "each side of the exchange" and a discussion of the patterns and how they facilitate each of the items above. Additionally, we'll touch on the analysis we go through as we look at a data pipeline and discuss the merits of whether it fits better into the stream paradigm or the batch paradigm. Speaker: Channing Jackson, Technical Director, Charles Schwab & Co., Inc. Filmed at SpringOne Platform 2019 Slides: https://www.slideshare.net/Pivotal/building-a-data-exchange-with-spring-cloud-data-flow

Previous
Tech Modernization: A Cloud Migration
Tech Modernization: A Cloud Migration

SpringOne Platform 2017 John Berry, Schwab; Henri van den Bulk, Schwab Corporate organizations have tradit...

Next Video
Latency and Event Tracing with Spring Cloud Data Flow - Henri van den Bulk, Craig Duero & Tom Martin, Charles Schwab
Latency and Event Tracing with Spring Cloud Data Flow - Henri van den Bulk, Craig Duero & Tom Martin, Charles Schwab

Spring Cloud Data Flow (SCDF) provides event streaming capabilities on a modern platform. A common challeng...