Declarative Infrastructure with the Jsonnet Templating Language
How Databricks Provisions Infrastructure Services at Scale with Kubernetes
Parallelizing Large Simulations with Apache SparkR on Databricks
The details on one use case jointly done by Shell Oil Company and Databricks.
Managing and Securing Credentials in Databricks for Apache Spark Jobs
This blog post will describe how to leverage an IAM Role to map to any set of credentials
Managing and Securing Credentials in Databricks for Apache Spark Jobs
An easy recipe to secure your credentials
IBM Ends Hadoop Distribution, Hortonworks Expands Hybrid Open Source
IBM has followed Intel and EMC/Pivotal in abandoning efforts to make a business of Hadoop distributions.
Analysing Metro Operations Using Apache Spark on Databricks
The Metro transports more than 200.000 passengers on a daily basis and is a critical part of the city’s infrastructure.
Apache Arrow 0.4.1 Release
This is a bug fix release that addresses a regression with Decimal types in the Java implementation introduced in 0.4.0
Five Spark SQL Utility Functions to Extract and Explore Complex Data Types
This blog post is a preamble to the how as a notebook tutorial.
Five Spark SQL Utility Functions to Extract and Explore Complex Data Types
Tutorial on how to do ETL on data from Nest and IoT Devices.
10th Spark Summit Sets Another Record of Attendance
A selected collage of highlights from Databricks’ speakers at our 10th Spark Summit.
Databricks Serverless: Next Generation Resource Management for Apache Spark
IT teams constantly struggle to find a way to allocate big data infrastructure.
A Vision for Making Deep Learning Simple
From Machine Learning Practitioners to Business Analysts.
A Vision for Making Deep Learning Simple
Engineers at Silicon Valley tech companies could analyze the entire Internet.
Making Apache Spark the Fastest Open Source Streaming Engine
How to make it easy to build end-to-end streaming applications by exposing a single API to write streaming queries as you would write batch queries.
Sharing Knowledge with the Community in a Preview of Apache Spark: The Definitive Guide
Hundreds of contributors working collectively have made Spark an amazing piece of the technology.
Databricks Runtime 3.0 Beta Delivers Cloud Optimized Apache Spark
We are also making the beta of Databricks Runtime 3.0-that includes the latest release candidate build of Apache Spark 2.2
Working with Nested Data Using Higher Order Functions in SQL on Databricks
Nested data types offer Databricks customers and Apache Spark users powerful ways to manipulate structured data
On-Demand Webinar and FAQ: Deep Learning and Apache Spark: Workflows and Best Practices
Deep Learning and Apache Spark is focused on issues that are common to deep learning frameworks when running on an Apache Spark cluster
Kafka Streams – Part 2
Branch creates multiple branches from a single stream
Event-time Aggregation and Watermarking in Apache Spark’s Structured Streaming
This is the fourth post in a multi-part series about how you can perform complex streaming analytics using Apache Spark
Introducing Uno and Muchos
Uno and Muchos are tools that ease the burden on developers of installing Accumulo and its dependencies
Cloudera Enterprise 5.11 is Now Available
Cloudera Enterprise 5.11 is now generally available (GA)
Going to ApacheCon? Check out TomcatCon, a Mini-Conference Featuring Apache Tomcat
There is a series of mini-conferences running in and around ApacheCon that you will not want to miss.
Featured Content
Events
AWS re:Invent
Join us again this year in Las Vegas for our biggest, most comprehensive, and most vibrant event in cloud computing.
AI & Big Data Expo 2022
This technology event is for the ambitious enterprise technology professional, seeking to explore the latest innovations, implementations and strategies to drive businesses forward.
Current 2022: The Next Generation of Kafka Summit
Join the first-ever data streaming industry event at Current 2022: The Next Generation of Kafka Summit. You’ll be able to immerse yourself in all things real-time data with peers.
O’Reilly Open Source Convention
OSCON covers FLOSS in its entirety. Not just one language, tool, or philosophy, but all the moving parts integrated and working together.
99U 2016
The goal of the 99U Conference is to shift the focus from idea generation to idea execution. Providing road-tested insights
Consensus 2016: Making Blockchain Real
Consensus 2016 will define what is “real” in blockchain technology and focus on how to mainstream real-world applications for consumers.