Topic: data lakes
Data mesh challenges common data assumptions
A data architecture that aims to challenge the preconceived notions of data and enable organizations to scale and move faster took center stage at this month’s Starburst Datanova conference. “The inconvenient truth is that despite increased investment in AI and data, the results have not been that great,” Zhamak Dehghani, director of emerging technology for … continue reading
A guide to data integration tools
CData Software is a leader in data access and connectivity solutions. It specializes in the development of data drivers and data access technologies for real-time access to online or on-premise applications, databases and web APIs. The company is focused on bringing data connectivity capabilities natively into tools organizations already use. It also features ETL/ELT solutions, … continue reading
How does your solution help customers with their data integration initiatives?
Eric Madariaga, chief marketing officer at CData Software “Ultimately, we solve data connectivity challenges through standardization — providing a common layer for accessing different data and systems. We then combine that with tooling to solve specific problems within messaging, data pipeline connectivity, and data management. While APIs have become the standard for integration, varying applications … continue reading
Data without integration is just data
As digital transformation initiatives have picked up steam due to the coronavirus pandemic, companies are getting a lot more disparate data that needs to be put together. They’re looking towards data integration solutions to streamline that process. A survey conducted by IDC in December last year found that 94% of data engineers, data integration specialists, … continue reading
SD Times news digest: Infragistics Ultimate 20.2 released, BMC new mainframe enhancement, GrammaTech awarded DARPA AIE program
Infragistics Ultimate 20.2 is a complete UX and UI solution that is compatible with Microsoft’s latest .NET 5 release. According to the company, users can speed up their app creation by using the new Indigo.Design App Builder drag and drop tool. Infragistics Ultimate 20.2 also includes new components and features such as toolkits for Angular, … continue reading
Delta Lake project joins the Linux Foundation as open data lakes standard
Databricks has announced it is donating its open-source data lakes project to the Linux Foundation. Delta Lake is designed to improve the reliability, quality and performance of data lakes. Databricks first announced the project in April. “Today, nearly every company has a data lake they are trying to gain insights from, but data lakes have … continue reading
SD Times news digest: AWS Lake Formation, Apple iPhone hack reward, and final Android Q beta release
AWS Lake Formation is now generally availability. This is Amazon’s fully managed service for building, securing and managing data likes. “AWS Lake Formation simplifies and automates many of the complex manual steps usually required to create a data lake, including collecting, cleaning, and cataloging data, and securely making that data available for analytics. Customers can … continue reading
Databricks open-sources Delta Lake for data lake reliability
Databricks today announced Delta Lake, an open-source project designed to bring reliability to data lakes for both batch and streaming data. The project was revealed during the Spark +AI Summit taking place this week in San Francisco. Data lakes are used as repositories for structured and unstructured data, but factors such as failed writes, schema … continue reading
Getting to the root of your data’s history
With the rise of big data platforms such as Apache Hadoop and Spark, more and more enterprises are pouring enterprise information into data lakes and launching related initiatives around data quality, data governance, regulatory compliance, and more reliable business intelligence (BI). To prevent the new lakes from turning into swamps, however, businesses are organizing their … continue reading
Report: 5 Big Data trends to monitor in 2018
Syncsort has released the results of its fourth annual Big Data survey, detailing the top use cases and challenges organizations face with Big Data initiatives. Based on the results, there are five key trends that organizations should monitor in 2018. 1. The composition of the data lake has been shifting. The amount of Relational Database … continue reading
SD Times news digest: Databricks Delta, SciPy 1.0, and Neo4j’s Native Graph Platform
Databricks has released a new unified data management system that combines the best features from data lakes, data warehouses and streaming systems. The company made the announcement at its annual Spark Summit Europe conference. Databricks Delta takes the scale and cost-efficiency from a data lake; the reliability and performance from a data warehouse, and the … continue reading
