Pivotal Engineering Journal

Faking OAuth2 Single Sign-on in Spring, 3 Ways

When writing a Java Spring web application that uses an OAuth2 single sign-on (SSO) service for authentication, testing can be difficult, especially if the SSO service is provided by a third...

Flow Your Tests Like Your Code

My co-worker Belinda Liu turned to me and said, “I don’t like these tests at all; they’re hard to follow, and I’m not sure what they’re testing.” I looked at the tests that I had spent much of...

How To Enable IPv6 on Your Cloud Foundry's HAProxy

0. Abstract HAProxy is an optional load balancer included in the canonical open source Cloud Foundry deployment. Its intended use is on IaaSes (Infrastructures as a Service) that do not offer...

Scaling the Firehose API and Consumers

Scaling the Loggregator API So you’ve used this article to correctly scale Dopplers in your Loggregator system. Even so, you notice that you’re still experiencing log loss. It could be that your...

Scaling Doppler VMs in Cloud Foundry

Why care about Dopplers You might be wondering what a Doppler is (and why you care about it). Doppler VMs are a core component of log and metrics transport; one that you probably won’t care about...

ESM Pairing Study Data

Studying the experience of Pair Programmers This is the raw data (after anonymization, and after the removal of freeform fields, out of an abundance of caution, so as not to leak any intellectual...

Benchmarking Apache Geode's Performance

Measuring Geode’s Performance Apache Geode™ is an in-memory data grid that provides real-time, consistent access to data-intensive applications throughout widely distributed cloud architectures....

How we built a controller using KubeBuilder with test-driven development, Part 2

Who are we? We are the Greenplum for Kubernetes team. We’re working on a Kubernetes operator to run Greenplum, and connected components of Greenplum like PXF and GPText. We started with a...

How we built a controller using KubeBuilder with Test Driven development, Part 1

Who are we? We are the Greenplum for Kubernetes team. We’re working on a Kubernetes operator to run Greenplum, and connected components of Greenplum like PXF and GPText. We started with a...

ESM Study Data

Studying the experience of XP Teams This is the raw data (after anonymization, and after the removal of freeform fields, out of an abundance of caution, so as not to leak any intellectual...

Merge Join Support In GPORCA

Introduction Pivotal’s SQL Optimizer, GPORCA, handled full outer joins by creating a union of a left outer join and a left anti-semi join, making any GPORCA generated plan slow and prevented...

Greenplum: Speeding up JDBC Reads in PXF Using Partitioning

Pivotal Greenplum Database® is an advanced, fully featured, open source data warehouse. Greenplum provides powerful and rapid analytics on petabyte scale data volumes. PXF is a query federation...

Fast Access to Your S3 Data with Greenplum PXF

In this article, we introduce the PXF feature that utilizes S3 Select for faster access to data on AWS S3. As an introduction to basic concepts, we first provide a brief introduction to the...

Administering a PXF cluster using the PXF Command Line Interface

Objective This blog aims to demonstrate some simple, but essential workflows that use the PXF CLI to administer an installation of PXF on a Greenplum cluster. Prerequisites This post assumes that...

Ensure Windows apps are using the `windows` stack

Pivotal Application Service for Windows introduced the -s windows stack name in PASW 2.4, reducing the operator and developer need to concern themselves with specific Windows Server versions. From...

A High-performing Mid-range NAS Server, Part 3: 10 GbE

Abstract “How much faster will my VM’s disks be if I upgrade my ZFS-based (Z File System) NAS to 10 GbE?” The disks will be faster, in some cases, much faster. Our experience is that sequential...

How we moved a massively parallel Postgres database onto Kubernetes

If you’ve ever wondered what type of applications are the best candidates to run on Kubernetes, distributed applications that scale out, such as Greenplum, are certainly at the top of the list, as...

Testing Spring filters without pain

The Spring framework has grown and changed at a massive pace over the last years. It has evolved from XML configured beans to annotation based beans, from synchronous to a non-blocking and...

Eureka, Zuul, and Cloud Configuration - Local Development