In this article we’ll present methods for efficiently optimizing physical resources and fine-tuning the configuration of a Google Cloud Platform (GCP) Dataflow pipeline in order to achieve cost reductions. Optimization will be presented as a real-life scenario, which will be performed in stages. Before we start, it’s time to introduce several avenues through which the cost of Big Data pipelines can be significantly reduced. These include: Careful optimization of consumed physical resources, like...