You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Closing as not a grievous bottleneck in many cases, and b.c. this can be handled by specialized layers relevant to the given use case that don't necessarily have general relevance.
When computation is faster than data IO, the device utitlization is reduced. To reduce the throughput gap, the data is usually compressed in many distributed computation or storage framework such as Hadoop, HBase, Hive and Kafka. Among many compressing libraries available for this purpose, Google Snappy is a very widely used one. It supports many languages and strikes a good balance between compression ratio and speed.
The text was updated successfully, but these errors were encountered: