This repository contains brief posts on the internals of big data tools. Spark Catalyst Internals Adding Custom Optimization Rule Catalyst Optimization Rule - Replace Except With Filter Spark Data Transformation with No Code