Hello! Hope you’re having a wonderful time working with challenging issues around Data and Data Engineering. In this article let’s look at the different compression algorithms Apache Spark offers…
Advanced Spark Tuning, Optimization, and Performance Techniques, by Garrett R Peternel
Distributed Computing 103: Advanced Techniques and Best Practices, by Siraj
The Battle of the Compressors: Optimizing Spark Workloads with ZStd, Snappy and More for Parquet, by Siraj
Avro vs Parquet. Let's talk about the difference between…, by Park Sehun
Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos
A gentle introduction to Apache Arrow with Apache Spark and Pandas, by Antonio Cachuan
Optimizing Apache Spark File Compression with LZ4 or Snappy, by Matthew Salminen
Accelerate Your Parquet Data for Athena Queries, by Kevin W
Spark + Cassandra, All You Need to Know: Tips and Optimizations, by Javier Ramos
Data processing with Spark: ACID, by Petrica Leuca
Garbage Collection in Spark: Why it Matters and How to Optimize it for Optimal Performance, by Siraj
Load Data using EMR Spark with Apache Iceberg, by Vishal Khondre
