Development, testing, security and operations have all been transformed to keep up with the pace of software today — but one piece is still missing. Data is now becoming a roadblock to Agile and DevOps initiatives. “People are getting stuck with data saying ‘I have my infrastructure layer automated and self-serviced so a developer can … continue reading
There has been a lot of emphasis over the last few years about breaking down silos. This includes siloed departments, people, and even applications within a business. But one area that has historically been very siloed is data. Databases take in data with a specific schema, but with all of the interconnectedness that is required … continue reading
Fifteen years ago, the Hadoop data management platform was created. This kicked off a land rush of companies looking to plant their flags in the market and open-source projects began to spring up to extend what the platform was designed to do. As often happens with technology, it ages, and newer things emerge that either … continue reading
Data is becoming more important than ever, and developers are beginning to realize they need better ways to harness and work with data. The problem, however, is that data isn’t handled the same way development is and therefore it can become a time-consuming and complex process. “The rise of git, docker, and DevOps has created … continue reading
Facebook wants to avoid another data privacy blunder. The company is quickly trying to address a problem it found with its Groups API access. Last year, in an effort to better protect users privacy, Facebook removed and restricted a number of developer APIs — Groups API was one of these restricted APIs. Before restrictions were … continue reading
Earlier this week at Microsoft Ignite, Microsoft announced the first new service in Microsoft 365 since they released Microsoft Teams in 2017. Project Cortex is a solution that will allow business users to gain valuable insights with their data, in ways they previously couldn’t. Over the years Microsoft has created a number of different ways … continue reading
As data science becomes more and more important, so does data visualization. Data is practically useless if you don’t have a human-readable way of communicating the insights from that data with the business. This week, we’re highlighting Perspective, which is an open-source tool for creating interactive visualizations of large, real-time datasets. Perspective is a project … continue reading
The Linux Foundation has announced its intent to form a new project called Alvarium. Project Alvarium will be focused on building a Data Confidence Fabric (DCF). This will help facilitate trust and confidence in data across heterogeneous systems. According to the Linux Foundation, a DCF is a framework that inserts trust into a data’s path, … continue reading
Netflix has announced that it is open sourcing Polynote, which, as the name implies, is a polyglot notebook. Polynote provides Scala support, Apache Spark integration, as-you-type autocomplete, and multi-language interoperability with Scala, Python, and SQL. According to Netflix, Polynote will allow data scientists to integrate its JVM-based machine learning platform with Python’s ecosystem of machine … continue reading
The international standards organization Object Management Group (OMG) announced that it has begun working on defining artificial intelligence standards. These standards will be designed to help “accelerate and improve the creation of useful AI applications,” OMG explained. “When a technology area reaches a certain degree of maturity, standards enable innovation, rather than impede it,” said … continue reading
JavaScript is rising the ranks as the most in-demand developer technology. Pluralsight Technologies released its Technology Index, and found JavaScript to be at the top. Last year when the company released the index in April, JavaScript scored at number four. Following JavaScript as the most in-demand technologies are Java, HTML, Python, C++, Android, C, C#, … continue reading
Databricks has announced it is donating its open-source data lakes project to the Linux Foundation. Delta Lake is designed to improve the reliability, quality and performance of data lakes. Databricks first announced the project in April. “Today, nearly every company has a data lake they are trying to gain insights from, but data lakes have … continue reading