Data Management explained
Data is the information that drives business. It can be structured in rows and columns, like a customer name, address, and phone; and it can be unstructured, such as an email or a social media post. Structured data is what is populated in Relational Database Management Systems such as those created by Oracle, IBM and Microsoft, and open-source PostgreSQL and MySQL, among others. That data can be accessed using the standard Structured Query Language (SQL). Unstructured data resides in what are called NoSQL databases, such as Cassandra, Couchbase, MongoDB and many, many others. Many organizations today run both kinds of databases.
Once the data is stored, it must be easily retrievable, found amid the mountains of data organizations collect, and made available at scale. Numerous tools exist for those jobs, including Hadoop, Apache Spark and many more. It is through the collection and analysis of data that businesses can make decisions that affect their bottom line.
SD Times news digest: Package Source Mapping in Visual Studio Code, Ruby on Rails 7.0 alpha 1, and Matillion Series E
Microsoft announced the first preview release of Package Source Mapping with Visual Studio 2022 preview 4. Package Source Mapping gives users fine-grained control of where their packages come from by mapping every package in their solution to target a package source. Package Source Mappings will apply to all project types – including .NET Framework – … continue reading
SD Times news digest: Confluent announces new data governance solution, Appian announces new version of low code platform, and Builder.ai introduces beta for AI-powered product manager
Confluent announced Stream Governance to address unsolved data privacy and regulatory issues surrounding real-time, event-driven data. Distributed teams will now have quick and easy access to the data that’s critical to developing more real-time applications and business operations all while maintaining security and privacy. “With the sharp rise of real-time data, the need for governance … continue reading
Exadel Acquires Coppei
WALNUT CREEK, Calif., September 14, 2021 /PRNewswire/ — Exadel (exadel.com), a software engineering company delivering digital platforms and products, today announced it has acquired Coppei (https://coppeipartners.com/) a Seattle-based digital business strategy and technology consultancy serving global Fortune 500 clients. Coppei will continue to operate as an independent brand. The complementary services of Coppei’s digital strategy … continue reading
Broken Access Control is now the highest vulnerability in OWASP Top 10 2021
The latest edition of the OWASP Top 10 showed that all of the highest-priority vulnerabilities since 2017 have shifted and new ones have been introduced. Broken Access Control has dethroned Injection as the top vulnerability, whereas it previously held fifth place. The 34 Common Weakness Enumerations (CWEs) mapped to Broken Access Control had more occurrences … continue reading
Latest Tableau update improves data prep and management
The latest release of Tableau is now available. Tableau 2021.3 includes better ways to prepare and manage data, explore data through Tableau Server or Online site before sharing with others, and new custom sample workbooks. Improvements to Tableau Prep include linked tasks, which will allow users to automate multiple flow jobs and ensure they happen … continue reading
SD Times news digest: JetBrains launches DataSpell, an IDE for data scientists, Firefox 92 released, Apache weekly roundup
JetBrains announced a new dedicated IDE for Data Science under the Early-Access Program. DataSpell offers a productive development environment for data science professionals who are actively involved in exploratory data analysis and prototyping machine learning models. The IDE offers native support for Jupyter notebooks and provides an enhanced experience over traditional Jupyter notebooks. It also … continue reading
SD Times news digest: Tableau announces new analytics capabilities, Microsoft releases two .NET MAUI-compatible versions of Xamarin Community Toolkit, Amazon Managed Grafana now generally available
Tableau unveiled its new data and analytics platform capabilities that include new capabilities to make data challenges easier to manage and to ensure that analytics scales with enterprise demand. Tableau Prep now makes it easier for customers to reduce loads and costs of server resources automatically, and new capabilities help by alerting users of potential … continue reading
DataOps engineers run toward error and automate it away
The DataOps role is unique in the space of data analytics, with its goal to enable data engineers, scientists, analysts and governance to own the pipelines that run the assembly process. Essentially, DataOps engineers work on, but not in, these pipelines, according to a DataKitchen webinar titled “A Day in the Life of a DataOps … continue reading
SD Times news digest: Apollo GraphQL raises $130 million in funding, Git 2.33 now available, GitHub now requires two-factor authentication for Git operations
Apollo GraphQL said it will use the funding to create pioneering open-source graph technology that makes app development faster and more accessible for everyone. The graph has gained a lot of popularity among developers with 86% of JavaScript developers ranking GraphQL as the top technology they want to learn. The company also plans to expand … continue reading
SD Times news digest: Google launches Android 12 beta 4, LANSA launches portal development acceleration with Portalize, Talend announces updates toward healthier data
Google launched the fourth beta of the Android operating system, Android 12, which has now achieved the Platform Stability milestone. The changes impacting Android app developers are now finalized. One major change is a new dashboard in Settings that lets users see which apps are accessing which type of data and when. Android 12 also … continue reading
SD Times news digest: VCs pouring money into blockchain companies, Checkmarx acquires Dustico, ONUG names two new members to its board
Blockchain companies have raised $30.4 billion in total funding, marking an increase of 44% within a year, according to Block Arabia, a news media site in the field of financial markets. Crunchbase data showed that 2018 was a record year for blockchain investment, but the next two years saw a significant slump. This year, investors … continue reading
Report: 75% of developers say they’re responsible for data quality
Nearly three-quarters of developers say they are responsible for managing the quality of the data they use in their applications, a key finding in the 2nd SD Times Data Quality Survey, completed in conjunction with data management provider Melissa in July. In last year’s survey, the number of developers claiming this responsibility was less than … continue reading
