Data Engineering patterns on the cloud - A list of 84 cloud native patterns to solve common data engineering problems

What will you get from this book?

Cloud services discovery

Each pattern starts with a contextual explanation of the solved problem. It helps understand the use case scenario.

Tricky points

A pattern might require some extra care in implementation. The "Look at" section warns you about the tricky points.

AWS, Azure, GCP implementations

"Cloud details" part shows cloud providers implementation of the pattern. You can also go further by exploring the referenced links.

Implementation in the picture

New concepts can sometimes be difficult to understand. The "Schema design" image is there to facilitate the understanding.

84 data engineering patterns

The book covers data processing, data storage, data security, data warehouse, data management, data orchestration and data transfer categories.

Lifetime updates

The first release contains 84 patterns. There will be more and you'll get the new ebook version at every update.

Who This Book Is For

Cloud Data Engineer

If you're already working with one cloud provider, the book will help you extend and apply your knowledge to other providers.

Junior Data Engineer

If you have just started your data engineering adventure, you can use the book to structure your knowledge and discover new concepts.

Hadoop Data Engineer

If you've only worked with on-premise data systems, the book will help you adapt your skills to the cloud world.

Data team member

If you are another technical member of a data team , the book will help you better understand the data engineering world.

Backend Software Engineer

If you have never been a data engineer, you can get the book and learn data patterns for the backend services, such as object store, streaming broker, or NoSQL databases.

About The Author

Bartosz Konieczny is a data engineer by day and a blogger by night. In the last years he has specialized in multi-cloud data engineering by implementing Big Data pipelines on top of AWS, Azure and GCP for various industries (broadcasting, online video sharing platform, oil, worldwide dating app). He is also a certified data engineer for AWS, Azure and GCP.

By night he shares his knowledge on cloud data services and Apache Spark on waitingforcode.com, becomedataengineer.com, and data conferences like Spark+AI Summit or Data+AI Summit. He was also nominated to the first group of Databricks Beacons.