Verifying Intermediate Map Output Data is Compressed in Hadoop

Note: This is a really old post, and no longer demonstrates how to verify compression.  As mentioned by Edan in the comments below, compression can be verified by observing the differences between “Map Output Bytes” and the “Map Output Materialized Bytes” at the conclusion of a job. If you’re looking for the actual intermediate compressed data on […]