Sign up for our newsletter and get the latest big data news and analysis.

10 Kubernetes Features You Must Know About

In this contributed article, technology writer Gilad David Maayan provides some of the more advanced functionalities and features of Kubernetes to help you get more from your configuration. Kubernetes (k8s) has become key to some of the biggest operations in the world, including Google, Shopify, and Slack. K8s has enabled companies to take advantage of cloud computing in a way that was previously not possible, and it might be able to do the same for big data.

Healthy Hives: Cloud Analytics Helps Save the World’s Bee Population

In this machine learning cast study, we describe how cloud analytics technology is being applied to the Global Hive Network, an initiative to collect billions of individual data points from around the world and analyze them to understand the honeybee population’s overall health and its relationship with environments, weather patterns, forage, diseases, parasites, predator species, and pesticides.

Kubernetes Driving Google Cloud

Kubernetes is increasingly being used with big data deployments. This trend is driving more big data apps to move to GCP, which offers homegrown support for Kubernetes. To make these workloads simpler and cheaper, there’s a need for a new solution for managing data workloads on Google Cloud Dataproc. With GCP’s CAGR estimated to grow by 64% CAGR through 2021, the cloud is now clearly a three-horse race.

The insideBIGDATA IMPACT 50 List for Q4 2019

The team here at insideBIGDATA is deeply entrenched in following the big data ecosystem of companies from around the globe. We’re in close contact with most of the firms making waves in the technology areas of big data, data science, machine learning, AI and deep learning. Our in-box is filled each day with new announcements, commentaries, and insights about what’s driving the success of our industry so we’re in a unique position to publish our quarterly IMPACT 50 List of the most important movers and shakers in our industry. These companies have proven their relevance by the way they’re impacting the enterprise through leading edge products and services. We’re happy to publish this evolving list of the industry’s most impactful companies!

Interview: Haoyuan Li, Founder and CTO of Alluxio

I recently caught up with Haoyuan Li, Founder and CTO of Alluxio to examine the next critical piece in the data evolution: Data Orchestration – the missing piece in building hybrid and multi-cloud analytical architectures. Haoyuan Li received his Ph.D. from UC Berkeley AMPLab, in Computer Science. At the AMPLab, he created Alluxio (formerly Tachyon) Open Source Data Orchestration System, co-created Apache Spark Streaming, and became an Apache Spark founding committer.

Serverless Data: The Winning Cloud Adoption Strategy

In this special guest feature, Venkat Venkataramani, Co-founder and CEO for Rockset, explores the benefits of serverless with a focus on the top pain points that serverless technology eliminates, so that developers can focus on creativity and how they can improve their apps. Serverless technology is the absence of technology, rather than the presence of capabilities. The main benefit of serverless technology is that it allows developers to build their application dashboards without being tied down by complexities and without having to consider any problems caused by servers.

Quilt Data Launches, Introduces Visual Index to Amazon’s Public Data

Quilt Data, where the world’s data comes together, launched and announced an index to Amazon’s public cloud data (open.quiltdata.com), enabling organizations globally to discover and share petabytes of data. The world’s cloud data is already larger than the world wide web and projected to expand 100 times over in the next five years. For the first time, Quilt enables anyone to search, understand and explore this vast universe of data with a standard web browser.

Streaming Cloud Integration: Key Data Considerations for Hybrid and Multicloud Architectures

A new white paper from Striim explores why hybrid-cloud, multicloud, or inter-cloud architecture strategies all need a modern, real-time data integration solution that keeps up with the speed of business. Striim is uniquely qualified to help make the journey to cloud fast and smooth. Striim simplifies moving real-time data across a diverse set of data sources and cloud targets with high-performance, security, and reliability.

Digital Transformation Projects Continue to be at Risk, Couchbase Research Finds

Despite rising optimism in digital transformation, the vast majority of organizations are still suffering failure, delays or scaled back expectations from digital transformation projects, research from Couchbase has found. In the survey of 450 heads of digital transformation in enterprises across the U.S., U.K., France and Germany, 73 percent of organizations have made “significant” or better improvements to the end-user experience in their organization through digital innovation. Twenty-two percent say they have transformed or completely “revolutionized” end-user experience, representing a marked increase over Couchbase’s 2017 survey (15 percent).

The Massive Risk of Lock-In: How Wall Street Future-Proofs their Move to the Public Cloud

In this contributed article, Matthew Baird, Co-Founder and Chief Technology Officer of AtScale, highlights how few statements strike fear in an IT leader’s heart like “lock-in” because in most cases you’re not aware you’re locked in until you encounter a problem big enough that you are forced to reconsider your original decision. It’s at that point one of your architects drops the bomb: Changing that code/system/vendor is going to be a year-long multi-million-dollar project.