Sign up for our newsletter and get the latest big data news and analysis.

Snowflake vs. Databricks – Who has the Edge?

Fivetran recently unveiled the results of a new data warehouse benchmark report that revealed just how close the competition is among five of the most popular data warehouses. The report is the passion project of Fivetran CEO and data management expert George Fraser, who has a front row seat in the cloud data warehouse race. The report explains the cost vs. performance tradeoffs of each one of the warehouses, the ins and outs of the modern data stack, and provides a perspective on how it’s all going to shake out.

Video Highlights: Modernize your IBM Mainframe & Netezza With Databricks Lakehouse

In the video presentation below, learn from experts how to architect modern data pipelines to consolidate data from multiple IBM data sources into Databricks Lakehouse, using the state-of-the-art replication technique—Change Data Capture (CDC).

CIOs Say Data Management is Critical for Successful AI Adoption in New Global Research Report

A new survey report by MIT Technology Review Insights highlights AI and data management as essential pillars to enterprise success, but found that the majority of survey respondents cited data mismanagement as a critical factor that could jeopardize their company’s future AI success. The report, “CIO vision 2025: Bridging the gap between BI and AI,” was conducted in May and June 2022 in association with Databricks, pioneer of the lakehouse architecture.

Databricks Announces Major Contributions to Flagship Open Source Projects

Databricks announced that the company will contribute all features and enhancements it has made to Delta Lake to the Linux Foundation and open source all Delta Lake APIs as part of the Delta Lake 2.0 release. In addition, the company announced MLflow 2.0, which includes MLflow Pipelines, a new feature to accelerate and simplify ML model deployments. Finally, the company introduced Spark Connect, to enable the use of Spark on virtually any device, and Project Lightspeed, a next generation Spark Structured Streaming engine for data streaming on the lakehouse. 

Databricks Announces General Availability of Delta Live Tables

Databricks, the Data and AI company and pioneer of the data lakehouse paradigm, announced the general availability of Delta Live Tables (DLT), the first ETL framework to use a simple declarative approach to build reliable data pipelines and to automatically manage data infrastructure at scale. Turning SQL queries into production ETL pipelines often requires a lot of tedious, complicated operational work. By using modern software engineering practices to automate the most time consuming parts of data engineering, data engineers and analysts can concentrate on delivering data rather than on operating and maintaining pipelines.

Databricks Launches Data Lakehouse for Retail and Consumer Goods Customers

Databricks, the Data and AI company and pioneer of the data lakehouse architecture, announced the Databricks Lakehouse for Retail, the company’s first industry-specific data lakehouse for retailers and consumer goods (CG) customers. With Databricks’ Lakehouse for Retail, data teams are enabled with a centralized data and AI platform that is tailored to help solve the most critical data challenges that retailers, partners, and their suppliers are facing.

How ML Powers Data Access Governance with Immuta & Databricks

If data isn’t accessible for real-time analytics, is it still valuable? Immuta’s native Databricks integration avoids this dilemma by using ML to streamline data access governance, and deliver analytics-ready data quickly and securely. For Databricks users leveraging Immuta, ML drives sensitive data discovery, dynamic access control, and consistent policy enforcement.

Databricks Launches SQL Analytics to Enable Cloud Data Warehousing on Data Lakes

Databricks, the data and AI company, announced the launch of SQL Analytics, which for the first time enables data analysts to perform workloads previously meant only for a data warehouse on a data lake. This expands the traditional scope of the data lake from data science and machine learning to include all data workloads including Business Intelligence (BI) and SQL.

New Guide Offers Databricks Unified Analytics Platform Machine Learning Use Cases

The fields of machine learning and deep learning are on the brink of unprecedented breakthroughs across a variety of verticals. And according to a new report from Databricks, “data is the new fuel,” for these market advancements. Download the new white paper today, “Four Real-Life Machine Learning Use Cases,” to explore Databricks Unified Analytics Platform use cases in the advertising, loan servicing, media industries and more.

Using Unified Analytics & Big Data as Path to AI Success

How can modern enterprises unlock the potential of AI to change their business? Today’s businesses and enterprises are increasingly focused on big data that can help drive innovation and transformation through the potential of artificial intelligence. According to a survey and research report commissioned with IDG’s CIO, nearly 90 percent of enterprises are investing in data and AI technology. Download the new report, “Unified Analytics for Dummies,” that explores the steps to AI success in today’s market.