Sign up for our newsletter and get the latest big data news and analysis.

News, reviews and feature articles on companies that are changing how organizations leverage massive volumes of data

Video Highlights: Modernize your IBM Mainframe & Netezza With Databricks Lakehouse

In the video presentation below, learn from experts how to architect modern data pipelines to consolidate data from multiple IBM data sources into Databricks Lakehouse, using the state-of-the-art replication technique—Change Data Capture (CDC).

Cloudera Continues Rapid Pace of Data Fabric and Data Lakehouse Innovation to Extend Data Management Leadership

Cloudera, the hybrid data company, announced new hybrid data capabilities that enable organizations to more efficiently move data, metadata, data workloads and data applications across clouds and on premises to optimize for performance, cost and security. Cloudera’s portable data services enable simple, low-risk data workload and data application movement for ultimate data lakehouse optionality.

CIOs Say Data Management is Critical for Successful AI Adoption in New Global Research Report

A new survey report by MIT Technology Review Insights highlights AI and data management as essential pillars to enterprise success, but found that the majority of survey respondents cited data mismanagement as a critical factor that could jeopardize their company’s future AI success. The report, “CIO vision 2025: Bridging the gap between BI and AI,” was conducted in May and June 2022 in association with Databricks, pioneer of the lakehouse architecture.

Research Highlights: Interactive continual learning for robots: a neuromorphicapproach

In this regular column we take a look at highlights for breaking research topics of the day in the areas of big data, data science, machine learning, AI and deep learning. For data scientists, it’s important to keep connected with the research arm of the field in order to understand where the technology is headed. Enjoy!

Cloudera Launches All-in-One Data Lakehouse Cloud Service

Cloudera, the hybrid data company, announced the launch of Cloudera Data Platform (CDP) One, an all-in-one data lakehouse software as a service (SaaS) offering that enables fast and easy self-service analytics and exploratory data science on any type of data. A simple yet powerful cloud service, only CDP One has built-in enterprise security and machine learning (ML) that requires zero cloud, security or monitoring operations staff for lower TCO and reduced risk.

New Accenture Research on Responsible AI Reveals How Organizations Can Prepare for Impending Regulation

New research from Accenture shows that almost all (97%) respondents companies believe that regulation will impact them to some extent. And 95% believe that at least part of their business will be affected by EU regulations specifically. But only 6% are fully prepared to accommodate near-term and ongoing regulatory changes.

Databricks Announces Major Contributions to Flagship Open Source Projects

Databricks announced that the company will contribute all features and enhancements it has made to Delta Lake to the Linux Foundation and open source all Delta Lake APIs as part of the Delta Lake 2.0 release. In addition, the company announced MLflow 2.0, which includes MLflow Pipelines, a new feature to accelerate and simplify ML model deployments. Finally, the company introduced Spark Connect, to enable the use of Spark on virtually any device, and Project Lightspeed, a next generation Spark Structured Streaming engine for data streaming on the lakehouse. 

Court Lifts Final Injunction in Favor of Altair in World Programming Case

Altair (Nasdaq: ALTR), a global leader in computational science and artificial intelligence (AI), paid and fully satisfied the 2019 North Carolina judgment SAS Institute obtained against recently acquired World Programming (WPL), a UK-based technology company that specializes in data analytics software. Shortly thereafter on March 3, 2022, the North Carolina court lifted the injunction that had previously prevented WPL from licensing its solutions to new customers in the United States. Altair can now license WPL solutions to customers in the United States and around the world.

Intel’s Habana Labs Launches Second-Generation AI Processors for Training and Inferencing

Intel announced that Habana Labs, its data center team focused on AI deep learning processor technologies, launched its second-generation deep learning processors for training and inference: Habana® Gaudi®2 and Habana® Greco™. These new processors address an industry gap by providing customers with high-performance, high-efficiency deep learning compute choices for both training workloads and inference deployments in the data center while lowering the AI barrier to entry for companies of all sizes.

Databricks Announces General Availability of Delta Live Tables

Databricks, the Data and AI company and pioneer of the data lakehouse paradigm, announced the general availability of Delta Live Tables (DLT), the first ETL framework to use a simple declarative approach to build reliable data pipelines and to automatically manage data infrastructure at scale. Turning SQL queries into production ETL pipelines often requires a lot of tedious, complicated operational work. By using modern software engineering practices to automate the most time consuming parts of data engineering, data engineers and analysts can concentrate on delivering data rather than on operating and maintaining pipelines.