Elastic is implementing a new approach for storing vectorized data that will require 95% less memory. Better Binary Quantization, or BBQ, is based on a technique called RaBitQ, which was developed earlier this year by researchers at Nanyang Technological University Singapore. According to Elastic, the biggest differences between BBQ and native binary quantization are that: … continue reading
The U.S. Postal Service (USPS) delivers mail to almost 167 million addresses in the United States, and anyone who has tried to order something online has likely had the experience of not getting a package delivered on time (or at all) because the address was entered incorrectly or in a weird format, causing shipping delays. … continue reading
Microsoft has announced that GitHub Copilot is now integrated with Data Wrangler, an extension for VS Code for viewing, cleaning, and preparing data. By integrating GitHub Copilot capabilities into the tool, users will now be able to clean and transform data in VS Code with natural language prompts. It will also be able to provide … continue reading
Google has announced that it is open sourcing a new Java-based differential privacy library called PipelineDP4J. Differential privacy, according to Google, is a privacy-enhancing technology (PET) that “allows for analysis of datasets in a privacy-preserving way to help ensure individual information is never revealed.” This enables researchers or analysts to study a dataset without accessing … continue reading
Having the correct customer information in your databases is necessary for a number of reasons, but especially when it comes to active contact information like email addresses or phone numbers. “Data errors cost users time, effort, and money to resolve, so validating phone numbers allows users to spend those valuable resources elsewhere,” explained John DeMatteo, … continue reading
Microsoft has announced and is open-sourcing a new data processing system called Drasi that can detect and react to changes in complex systems. This new project “simplifies the automation of intelligent reactions in dynamic systems, delivering real-time actionable insights without the overhead of traditional data processing methods,” Mark Russinovich, CTO, deputy chief information security officer, … continue reading
MongoDB has announced the release of the latest version of its database platform—MongoDB 8.0. According to the company, this release offers significant performance improvements compared to MongoDB 7.0, such as 36% better read throughput, 56% faster bulk writes, 20% faster concurrent writes during replication, and 200% faster handling of higher volumes of time series data, … continue reading
Google is announcing several new Chrome features aimed at better protecting users as they browse the web. Safety Check — a tool that checks for compromised passwords, Chrome updates, and other potential security issues in the browser — has been updated to run automatically in the background so that it can be more proactive in … continue reading
Organizations are getting caught up in the hype cycle of AI and generative AI, but in so many cases, they don’t have the data foundation needed to execute AI projects. A third of executives think that less than 50% of their organization’s data is consumable, emphasizing the fact that many organizations aren’t prepared for AI. … continue reading
Time series data is an important component of having IoT devices like smart cars or medical equipment that work properly because it is collecting measurements based on time values. To learn more about the crucial role time series data plays in today’s connected world, we invited Evan Kaplan, CEO of InfluxData, onto our podcast to … continue reading
Pinecone, a vector database for scaling AI, is introducing a new bulk import feature to make it easier to ingest large amounts of data into its serverless infrastructure. According to the company, this new feature, now in early access, is useful in scenarios when a team would want to import over 100 million records (though … continue reading
With businesses uncovering more and more use cases for artificial intelligence and machine learning, data scientists find themselves looking closely at their workflow. There are a myriad of moving pieces in AI and ML development, and they all must be managed with an eye on efficiency and flexible, strong functionality. The challenge now is to … continue reading
