Clik here to view.
Kicking The Tires On Azure Functions – How To Build Simple Event-Driven Or...
Introduction There are many ways to skin the cat when it comes to using public cloud services to solve business problems, so understanding pros and cons of each can often make a big difference....
View ArticleClik here to view.
Tackling Data-Intensive Workloads with Azure Batch – Elastic, On-Demand and...
Introduction As a data domain architect (amongst many other hats I wear these days), I sometimes find it difficult to recommend a public cloud service which can fulfill all my clients’ needs without...
View ArticleClik here to view.
Data Build Tool (DBT) – The Emerging Standard For Building SQL-First Data...
Note: Part 2 of this post can be found HERE. Introduction It’s never a dull moment when working in IT and although Data Warehousing domain was not subjected to the hamster wheel of relentless...
View ArticleClik here to view.
Data Build Tool (DBT) – The Emerging Standard For Building SQL-First Data...
In Part 1 of this series, I went over the high-level introduction to dbt, stood up a small development SQL Server database in Azure, acquired a sample size of Google Analytics data to populate a few...
View ArticleClik here to view.
Kicking the tires On tSQLt – An Open-Source Unit Testing Framework for SQL...
Introduction The importance of unit testing does not have to be conveyed to most database developers and data engineers – it’s common knowledge that testing should be an integral part of any project...
View ArticleClik here to view.
Building rapid data import interfaces with PySimpleGUI and Streamlit
Note: All code from this post can be downloaded from my OneDrive folder HERE. Introduction The proliferation of low-code or no-code solutions for building simple apps has taken a solid foothold in the...
View ArticleClik here to view.
Kicking the Tires on Azure SQL Database External REST Endpoints – Sample...
Introduction SQL Server in-database REST API integration was always roll-your-own, bubble gum and duct tape type of affair – it was possible but never easy. Some may argue it’s for all the right...
View ArticleClik here to view.
DuckDB vs ClickHouse performance comparison for structured data serialization...
Introduction As the hype around DuckDB database engine was gaining momentum and popular OLAP computing platforms started to get more difficult to develop on and integrate into small to medium workloads...
View ArticleClik here to view.
SQL Server to Snowflake Solution Architecture and Implementation – How to...
Introduction Lately, I’ve been on a hunt for a simple yet comprehensive solution architecture using SQL Server as a source platform and Snowflake as a data warehouse. In spite the fact Snowflake has...
View ArticleClik here to view.
Using Polybase and In-Database Python Runtime for Building SQL Server to...
Introduction One of the recent projects I assisted with dictated that Parquet files staged in Azure Data Lake were to be consumed using a traditional ELT\ETL architecture i.e. using Databricks, Data...
View ArticleClik here to view.
AWS S3 data ingestion and augmentation patterns using DuckDB and Python
Introduction Many of the popular data warehouses vendors utilize Object Storage services provided by major cloud providers e.g. ADLS, S3 as their intermediate or persistent data store. S3 (Simple...
View ArticleClik here to view.
Snowflake Scale-Out Metadata-Driven Ingestion Framework (Snowpark, JDBC, Python)
Note: All code from supporting this architecture can be downloaded from my OneDrive folder HERE. Introduction Organizations looking to modernize and improve their data ingestion capabilities have...
View Article