Topic: avrotensordataset

SD Times Open-Source Project of the Week: AvroTensorDataset

Earlier this week, LinkedIn announced it was open-sourcing AvroTensorDataset, which is a “TensorFlow dataset for reading, parsing, and processing Avro data.” Apache Avro is the primary storage format that LinkedIn uses for its training data.  According to LinkedIn, it was experiencing bottlenecks in its machine learning workloads that were caused by the need to read … continue reading Protection Status