Research Highlights: Scaling MLPs: A Tale of Inductive Bias

Multi-layer Perceptrons (MLPs) are the most fundamental type of neural network, so they play an important role in many machine learning systems and are the most theoretically studied type of neural network. A new paper from researchers at ETH Zurich pushes the limits of pure MLPs, and shows that scaling them up allows much better performance than expected from MLPs in the past. These findings may have important implications for the study of inductive biases, the theory of deep learning, and neural scaling laws.

What The Experts Expect of Generative AI: 2023 Survey Results

Generative AI is quickly becoming a top priority for any company’s digital transformation strategy. It is hijacking conversations everywhere, from the boardroom to the dining room – we’re even seeing accelerated M&A (ie. MosaicML) to help businesses build their own foundation models and generative AI tools. As business leaders assess how to be bullish on generative AI while mitigating risks such as bias, Domino Data Lab has announced findings from its second annual REVelate survey which explored what top data science leaders and practitioners really think about the technology.

Analysis of 145 Generative AI Startups IDs Opportunities to Remedy Pain Points in Healthcare and Life Sciences

Generative AI technology could deliver industry-changing improvements in healthcare delivery and life sciences productivity, efficiency and patient outcomes and presents a massive untapped opportunity for entrepreneurs and investors, according to a new market analysis by Justin Norden of GSR Ventures, Jon Wang, and Ambar Bhattacharyya of Maverick Ventures.

Artificial Intelligence: Real Estate Revolution or Evolution?

Artificial Intelligence (AI) is increasingly becoming the most important topic of the year. From data centers to financial services to technology, every real estate sector is involved in AI in one way or another, as it can help improve real estate outcomes for both investors and tenants. Commercial real estate leader JLL’s recently published whitepaper “Artificial Intelligence: Real Estate Revolution or Evolution?” discusses the role that the CRE industry will play in AI – and how AI can potentially reshape the industry.

Altair Global Survey Reveals Significant Opportunities to Improve Efficiency, Scale, and Success of Enterprise AI and Data Projects

Altair (NASDAQ: ALTR), a global leader in computational science and artificial intelligence (AI), released results from an international survey which revealed high rates of adoption and implementation of organizational data and AI strategies globally. The survey also revealed that project successes suffer due to three main types of friction: organizational, technological, and financial. 

Big Data Clusters: Building the Best Infrastructure Platform for Big Data Workloads

Our friends over at Silicon Mechanics put together a guide for the Triton Big Data Cluster™ reference architecture that addresses many challenges and can be the big data analytics and DL training solution blueprint many organizations need to start their big data infrastructure journey. The guide is for a technical person, especially those who might be a system admin in government, research, financial services, life sciences, oil and gas, or a similarly compute-intensive field.

Hitachi Vantara’s State of Data Infrastructure Sustainability Report

U.S. businesses have made sustainability a priority, with nearly four in five companies saying that they have developed plans for achieving carbon neutrality (78%) and net zero carbon emissions (79%), according to the State of Data Infrastructure Sustainability, a new report from our friends over at Hitachi Vantara, the modern infrastructure, data management and digital solutions subsidiary of Hitachi, Ltd. (TSE: 6501). However, despite this and the fact that 85% of respondents claim to be “on plan” or “ahead of plan” when it comes to their carbon reduction goals, the survey revealed that actual progress may not be as robust as many businesses believe.

Research Highlights: LLMs Can Process a lot more Text Than We Thought

A team of researchers at AI21 Labs, the company behind generative text AI platforms Human or Not, Wordtune, and Jurassic 2, has identified a new method to overcome a challenge that most Large Language Models (LLMs) grapple with – a limit as to how much text they can process before it becomes too expensive and impractical. 

Largest Data Engineering Survey Reports on Adoption of Modern Data Stack Tools

Airbyte, creators of a fast-growing open-source data integration platform, made available results of the biggest data engineering survey in the market which provides insights into the latest trends, tools, and practices in data engineering – especially adoption of tools in the modern data stack. Its first worldwide State of Data survey displays results in an interactive format so that anyone can drill further into the information using filters to see, for example, adoption patterns by organization size.

State of Data Quality Report

Bigeye, the data observability company, announced the results of its 2023 State of Data Quality survey. The report sheds light on the most pervasive problems in data quality today. The report, which was researched and authored by Bigeye, consisted of answers from 100 survey respondents.