Data Management explained
Data is the information that drives business. It can be structured in rows and columns, like a customer name, address, and phone; and it can be unstructured, such as an email or a social media post. Structured data is what is populated in Relational Database Management Systems such as those created by Oracle, IBM and Microsoft, and open-source PostgreSQL and MySQL, among others. That data can be accessed using the standard Structured Query Language (SQL). Unstructured data resides in what are called NoSQL databases, such as Cassandra, Couchbase, MongoDB and many, many others. Many organizations today run both kinds of databases.
Once the data is stored, it must be easily retrievable, found amid the mountains of data organizations collect, and made available at scale. Numerous tools exist for those jobs, including Hadoop, Apache Spark and many more. It is through the collection and analysis of data that businesses can make decisions that affect their bottom line.
Accurate data isn’t enough — it needs to be actionable
As the COVID-19 pandemic has shut down offices, people have taken to working remotely, and many have even moved from locations where the cost of living is high to places where it’s more manageable. This raises the issue of data quality, not only in terms of the accuracy of data being input into fields in … continue reading
SD Times Open-Source Project of the Week: BumbleBee
BumbleBee simplifies building extended Berkeley Packet Filter (eBPF) tools and allows users to package, distribute, and run them anywhere. eBPF provides Linux kernels the extensibility to enable developers to program the Linux kernel to quickly build intelligent or feature-rich functions based on their business needs. BumbleBee brings a Docker-like experience for eBPF, and through simple … continue reading
GPT-3 can now be customized to individual applications
Developers can now fine-tune GPT-3 on their own data, creating a custom version tailored to their application, which allows for faster and cheaper running of models. GPT-3 is a natural language programming tool developed by AI research laboratory OpenAI. Users have to run a single command in the OpenAI CLI tool with the file that … continue reading
SD Times Open-Source Project of the Week: immudb
Immudb is a database written in Go that is immutable, which means that history is preserved and can’t be changed without clients noticing. “Traditional database transactions and logs are hard to scale and are mutable, so there is no way to know for sure if your data has been compromised,” the project’s website states. “Immudb … continue reading
Talend Fall 2021 release introduces data health concepts
Talend has announced the release of Talend Fall 2021, which adds data health concepts across Talend Data Fabric. The new version includes Stitch Unlimited, which offers industry-first, non-consumption-based pricing for unlimited users and integrations. Users will also have access to a Trust Score so that everyone can know that they’re making the right decisions based … continue reading
Progress released new troubleshooting solution, Fiddler Jam
Progress today announced the general availability of Progress Telerik Fiddler Jam, designed to provide users with a troubleshooting solution for support and development teams to address customer issues remotely. With this release, new features have become available, such as the option for video recording, capturing events during a session recording, and masking sensitive data. Progress … continue reading
Data Quality: Volume, interdependencies can create big problems
The growing mountains of data generated by organizations is literally staggering, so ensuring that data is of good quality is a huge challenge. As the SD Times Data Quality Project 2021 has revealed, one area in particular that can give companies fits is product information. In the case of the pharmaceutical industry, but likely true … continue reading
Why OpenTelemetry is driving a new wave of innovation on top of observability data
The last decade has brought a progressive transition from monolithic applications that run on static infrastructure to microservices that run on highly dynamic cloud-native infrastructure. This shift has led to the rapid emergence of lots of new technologies, frameworks, and architectures and a new set of monitoring and observability tools that give engineers full visibility … continue reading
Report: Companies prioritize securing open-source components in modern software
The rapid adoption of the cloud has led companies to increasingly secure open-source components in modern software. The newly released 12th Building Security In Maturity Model (BSIMM12) report found a 61% increase in software security groups’ identification and management of open source over the past two years. The report was created by Synopsys, a company … continue reading
SD Times news digest: GitLab 14.3, Improved Google Play Console user management, and Informatica and Snowflake announces on-prem to cloud modernization program,
GitLab announced the release of GitLab 14.3 with project-level security scan execution policies, next generation SAST to reduce Ruby false positives, group level permissions for protected environments and group access for the GitLab Kubernetes Agent. The project-level DAST and secret detection scan execution policies allow users to require DAST and secret detection scans to run … continue reading
Data is leaking as employees leave in “Great Resignation”
New data shows a direct correlation between resignations, departing employees, and data exposure events. This is of particular interest to organizations currently as companies experience what’s been called “the Great Resignation.” As employees leave their companies, they oftentimes — intentionally or otherwise — take valuable source code, patent applications, and customer lists with them. Code42, … continue reading
SD Times news digest: Package Source Mapping in Visual Studio Code, Ruby on Rails 7.0 alpha 1, and Matillion Series E
Microsoft announced the first preview release of Package Source Mapping with Visual Studio 2022 preview 4. Package Source Mapping gives users fine-grained control of where their packages come from by mapping every package in their solution to target a package source. Package Source Mappings will apply to all project types – including .NET Framework – … continue reading
