https://stackshare.io/heap/how-heap-built-an-analytics-platform-that-auto-tracks-every-user-event
blog-post-heap-analytics#compression-at-the-file-system-levelOne of the major projects in reducing cost involved switching to ZFS, which allows compression at the file system level. That switch alone allowed them to compress their data by a factor of 2 blog-post-heap-analytics#compression-at-the-file-system-level
blog-post-heap-analytics#initial-persistence-layer1He's also learned that you want the path between data hitting your servers and your initial persistence layer (in this case, Kafka) to be as short and simple as possible, since that is the surface area where a failure means you can lose customer data. blog-post-heap-analytics#initial-persistence-layer1