The first part of this post can be found at Processing Real-Time Streams in Databricks – Part 1. This is the continuation of Part 1 — we won’t repeat the architecture and …

Databricks is becoming the new normal in data processing technologies in cloud, both Azure and AWS. This is a step-by-step guide to get started on real-time (streaming) analytics …

Data solutions and data architectures encompass key areas in data management and provide guidance on how we ingest, process, store, maintain, consume, secure, and manage data. That …

For details about what Lambda architecture is, read Introduction to Lambda Architecture. From a technology point of view, Databricks is becoming the new normal in data processing …

Azure Cost Management helps in monitoring, optimizing, and controlling costs of Azure resources in subscriptions and resource groups. It shows organizational cost and usage …

A data lake is a framework, concept, and guidance on where to place data (Microsoft named their product Azure Data Lake, but the concept is broader). From a technology point of …

Most of the customers I talk to are directly or indirectly asking to scale their workloads and use Databricks. It has become the new normal in data processing in cloud. If you are …