Selected Work

Projects & Initiatives.

A showcase of major architectural implementations, platform migrations, and community contributions.

Community Project

sql_squared

Founded and manage a thriving data community. We host podcasts, publish technical articles, and organize regular events to foster knowledge sharing and networking among data professionals.

sql_squared brand abstract
Personal Project

Echelon

Warhammer Crusade Campaign Manager

A standalone web app for managing Warhammer 40K Crusade campaigns. Track your force's progression through battles, manage Crusade Cards, and chronicle your army's story from first skirmish to legendary status.

Crusade Tracking

Track your force's progression through battles and campaigns.

Battle History

Record growth, honours earned, and scars suffered over your army's story.

Army Import

Import existing army lists in seconds instead of manual entry.

Community

Connect with players, share campaign stories, and grow together.

Microsoft Fabric Enterprise Implementation
Microsoft FabricPower BIApache Spark

Led the strategic implementation and migration to Microsoft Fabric for an enterprise organization. Consolidated disparate data workloads into a unified SaaS analytics platform, enabling seamless data engineering, data science, and real-time analytics capabilities.

Stack
Microsoft FabricOneLakeData EngineeringPower BIData ScienceSparkLakehouseData PipelinesNotebooksJupyterBicepDelta LakeDataflows Gen2PySparkFabric REST APISemantic Models
Impact
  • Unified analytics platform
  • Reduced infrastructure complexity
  • Accelerated time-to-insight
Enterprise Master Data Management with Tamr & Microsoft Fabric
Microsoft FabricMicrosoft AzurePython

Designed and implemented an enterprise Master Data Management solution using Tamr on top of Microsoft Fabric, enabling AI-powered entity resolution and deduplication of critical business data. Built automated pipelines to master golden records across key business domains and publish authoritative data to downstream third-party services and applications via event-driven and API-based integrations.

Stack
TamrMicrosoft FabricOneLakeAzure Data FactoryREST APIsPythonSQLEvent-driven ArchitectureData GovernanceEntity ResolutionAzure Key VaultMaster Data Management (MDM)Data Matching / DeduplicationData QualityData LineageAzure Functions
Impact
  • Golden record mastering across key business domains
  • Automated publishing to 3rd party services & applications
  • Improved data consistency and reduced duplication across the platform
SAP ByDesign ERP Integration Platform
SAPMicrosoft AzureMicrosoft Fabric

Engineered robust, enterprise-scale data integration pipelines connecting SAP ByDesign ERP system with downstream financial reporting and forecasting tools. Implemented automated data validation, error handling, and reconciliation processes ensuring 99.9% data accuracy.

Stack
SAP ByDesign APIsAzure Function AppsMicrosoft FabricFinancial Reporting ToolsSOAPODataPythonETL PipelinesData ValidationXMLAzure Key VaultAzure Logic AppsInfrastructure as Code (IaC)DockerCI/CDYAML PipelinesApplication InsightsAzure Alerts
Impact
  • 99.9% data accuracy
  • Automated reconciliation
  • Enterprise-scale integration
Global Azure Synapse Platform Architecture & Delivery
Microsoft AzurePower BIPython

Architected and delivered a comprehensive Azure data platform serving 1000+ users across 12+ countries. The platform processes large daily data volumes with a high degree of data quality improvement and major performance optimization. Features real-time analytics, automated data validation, and enterprise-grade security.

Stack
Azure Synapse AnalyticsAzure Data Lake Storage Gen2Azure Data FactoryAzure Logic AppsPower BIAzure SQL DatabasePythonKQLAzure DevOpsBicepEntra ID / RBACDedicated SQL PoolsSynapse PipelinesAzure Key VaultManaged Private Endpoints / VNetData Validation
Impact
  • Performance improvement
  • £100k+ annual cost savings
  • 1500+ global users
LinkedIn Job Market Analytics & Whitespace Reporting
Azure Data ExplorerMicrosoft AzurePower BI

Built an enterprise-grade data warehousing solution ingesting and analysing daily global LinkedIn job market data using Azure Data Explorer. Integrated Azure Language and Cognitive Services to automatically extract, normalise, and map skills and industries from job postings, enabling accurate whitespace reporting that highlights unmet talent demand and emerging hiring trends for business intelligence teams.

Stack
Azure Data Explorer (Kusto)Kusto Query Language (KQL)Azure Language ServicesAzure Cognitive ServicesAzure FunctionsPower BIPythonREST APIsJSONAzure StorageMaterialized ViewsData Ingestion PipelinesTime Series AnalysisNatural Language Processing (NLP)
Impact
  • Daily job market data ingestion & processing
  • AI-powered skills & industry mapping via Azure Cognitive Services
  • Whitespace reporting to surface unmet talent demand
Global Telephony Platform Integration Suite
Microsoft AzurePower BIC#

Developed comprehensive real-time integrations with multiple global telephony platforms using event-driven architecture. Built scalable ETL pipelines processing call data for in-depth analysis, global reporting, and business intelligence across international markets.

Stack
REST APIsAzure FunctionsAzure SQL DatabasePower BIEvent-driven ArchitectureC#PythonJSONWebhooksAzure Logic AppsETL Pipelines
Impact
  • Multi-platform integration
  • Real-time call analytics
  • Global reporting capabilities
Salesforce Data Lake & Analytics Platform
Microsoft AzureSalesforcePower BI

Implemented a comprehensive batch and real-time ETL solution for ingesting Salesforce sales data into Azure Data Lake. Built dimensional data models, implemented data governance frameworks, and created self-service analytics capabilities for business users.

Stack
Azure Data FactorySalesforce APIsSOQLAzure Data Lake StorageAzure SynapsePower BIPythonSQLDimensional ModelingData GovernanceData ModelingETL Pipelines
Impact
  • Self-service analytics
  • Data governance framework
  • Real-time sales insights
Enterprise Database DevOps & CI/CD Platform
Microsoft AzureMicrosoft SQL ServerGit

Established comprehensive Database DevOps practices and implemented automated CI/CD pipelines for database changes across multiple environments. Reduced deployment risks by 90%, improved release velocity by 80%, and implemented automated testing frameworks.

Stack
Azure DevOpsCI/CD PipelinesSQL Server Data Tools (SSDT)GitPowerShellAzure SQL DatabaseAutomated TestingBicepYAML PipelinesSchema MigrationstSQLt
Impact
  • 90% risk reduction
  • 80% faster deployments
  • Automated testing framework
TalentLink to Fabric Data Integration Platform
Microsoft FabricGraphQLMicrosoft Azure

Client-focused Microsoft Fabric platform integration reading recruitment data via GraphQL from TalentLink, structuring it into a SQL database using notebooks, with a multi-platform CI/CD deployment process combining Fabric deployment, YAML pipelines, and SSDT for maximum security, validation, and flexibility.

Stack
Microsoft FabricGraphQLTalentLink APINotebooksSQLAzure DevOpsYAML PipelinesSSDTCI/CDLakehouseData PipelinesPySparkFabric Deployment PipelinesData ModelingAzure Key VaultData Validation
Impact
  • GraphQL ingestion from TalentLink into a structured SQL data model
  • Hybrid Fabric + YAML + SSDT CI/CD pipeline for defense-in-depth validation
  • Notebook-driven data structuring reduced manual transformation overhead
  • Enterprise-grade security controls for a client-specific integration