Klaus Post: Data compression with Go
Data compression with Go
Systems written in Go often have to deal with very large data sets. You may need to transfer or store many gigabytes of data. To keep storage costs down it is often a benefit to compress your data.
In this talk we will look at various techniques for data compression and evaluate the options that are available when writing Go. This will give an understanding of what to look out for and how to more efficiently choose the best compression for your data.
We will take a look at the basics of Huffman, Asymmetric numeral systems and Lempel+Ziv (LZ) Encoding which are some of the most commonly used building blocks. This should enable you to more confidently choose a compression scheme for your data.
Klaus Post
Copenhagen, Denmark
Senior Backend, Team Lead
MinIO
I have been an avid Gopher for 6 years coming from C/C++ and assembly. Everything related to speed has my interest.
I am the host of “Go After Dark” video series on realtime graphics programming in Go and author of various stream and compression packages for Go.