NEW RESEARCH: Growing Database Complexity Will Fuel Significant Skills Gaps in 2024

Increasing complexity, the rapid adoption of emerging technologies and a growing skills gap are the biggest concerns facing IT leaders in 2024, according to The State of the Database Landscape, a major new survey from end-to-end Database DevOps provider Redgate. 

Post-Postgres: What’s Driving a Great Migration from the Iconic Database

In this contributed article, Tanya Bragin, product lead at ClickHouse, offers a thesis premised on an industry-wide shift from OLTP databases like Postgres for everything and into OLTP for certain functions and OLAP for others.

Big Data Industry Predictions for 2024

Welcome to insideBIGDATA’s annual technology predictions round-up! The big data industry has significant inertia moving into 2024. In order to give our valued readers a pulse on important new trends leading into next year, we here at insideBIGDATA heard from all our friends across the vendor ecosystem to get their insights, reflections and predictions for what may be coming. We were very encouraged to hear such exciting perspectives.

New Data on LLM Accuracy

Juan Sequeda, Principal Scientist at data.world, recently published a research paper, “A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model’s Accuracy for Question Answering on Enterprise SQL Databases.” He and his co-authors benchmarked LLM accuracy in answering questions over real business data.

26 Years Since its Inception, Postgres is Just Getting Started 

In this contributed article, Charly Batista, PostgreSQL Tech Lead at Percona, explores why Postgres is on the rise and why Postgres’ brand of open source is good for business.
One of the most widely used database management systems in the world, Postgres still lags quite substantially behind the likes of MySQL and Oracle in total adoption.

Marie Kondo, Zen and the Art of Enterprise Software – and Why You Need to Care

In this contributed article, Joe McCunney, CEO & President, Scalar Labs, suggests that in its simplest terms, a Zen practice is the living embodiment of the phrase, “Less is more.” This article explains how embracing Zen principles – including concepts from master organizer Marie Kondo – and supportive tools can provide a consistent, simplified data management and validation framework in place.

DynamoDB vs. Cassandra: Which Database Is a Great Fit for Your Business?

In this contributed article, April Miller, a senior IT and cybersecurity writer for ReHack Magazine, believes that If you need a new database for your business, Amazon Web Services DynamoDB and Apache Cassandra are two of the most prominent options. Choosing between them isn’t easy, but this breakdown will help you feel more informed and confident.

Why Do We Prefer ELT Rather than ETL in the Data Lake? What is the Difference between ETL & ELT

In this article, Ashutosh Kumar discusses the emergence of modern data solutions that have led to the development of ELT and ETL with unique features and advantages. ELT is more popular due to its ability to handle large and unstructured datasets like in data lakes. Traditional ETL has evolved into cloud-based ETL which allows rapid batch processing, scalability, savings, and simplicity while maintaining security, governance, and compliance.

Zilliz Cloud Slashes Prices, Launches Free Tier to Democratize Vector Databases 

Zilliz Cloud was already a fast vector database. Now it’s even more affordable. And you can’t get more affordable than free. The latest version of Zilliz Cloud, the managed service from the inventors of Milvus, includes a raft of new features along with additional pricing options for individuals and organizations. It makes vector databases accessible for projects of all sizes. Developers can now, regardless of budget, spin up generative AI applications while protecting against hallucination.

Kinetica Announces Conversational Query – ChatGPT Integration with Analytic Database

Kinetica announced an analytic database to integrate with ChatGPT, ushering in ‘conversational querying.’ Users can ask any question of their proprietary data, even complex ones that were not previously known, and receive an answer in seconds. The combination of ChatGPT’s front-end interface that converts natural language to Structured Query Language (SQL), and Kinetica’s analytic database purpose built for true ad-hoc querying at speed and scale, provides a more intuitive and interactive way of analyzing complex data sets.