← Back to Portfolio

Herman Teng

Senior IT Data Specialist | Data Engineering · BI · AI

Professional Summary

Senior data professional with 10+ years designing enterprise-grade data platforms, BI solutions, and Lakehouse frameworks in Tier-1 banking. Proven track record unifying fragmented data landscapes, boosting operational efficiency, and governing high-stakes financial data using Databricks, Azure, and AI-augmented workflows. Early adopter of AI-augmented engineering, driving measurable productivity, governance, and business agility gains.

Professional Experience

Senior IT Data Specialist

May 2022 – Present
TD Bank · Global Technology Solution
  • AI-Augmented Engineering: Embedded GitHub Copilot (agent mode), M365 Copilot, and custom MCP servers into daily workflows for code generation, refactoring, and DAX optimization. Designed multi-LLM workflows (GPT, Claude, Gemini) with Agent Skills to accelerate migration and semantic-model documentation.
  • Platform Modernization & CI/CD: Led end-to-end migration of RMR and DAC governance reporting from legacy Tableau to Databricks Lakehouse and Power BI Premium, achieving 100% Tableau decommission via GitHub-driven CI/CD pipelines.
  • Lakehouse Architecture: Captured requirements and designed Lakehouse-native fact/dimension models on DAF2.0. Completed PoCs for Unity Catalog-enabled Azure workspaces, validating external integrations and de-risking production release.
  • Data Engineering & ETL: Re-engineered RMR pipelines to ingest governed SRZ Synapse feeds, eliminating manual ADIDO files. Optimized Triage ETL to deliver near real-time refresh, replacing batch latency and saving 2 hours daily from manual processes.
  • BI & Semantic Modeling: Designed and shipped a net-new Power BI Triage dashboard with a rebuilt semantic model, rich drillthrough UX, and AD-group RBAC, serving BISOPS operations.
  • Data Catalog & Governance: Implemented Microsoft Purview scanning, classification, and sensitivity labeling to govern PII/PCI. Built metadata mapping pipelines and stewarded end-to-end data lineage.

Business Data Management Specialist

May 2021 – May 2022
TD Bank · Treasury & Balance Sheet Management
  • Enterprise Testing & Validation: Led end-to-end SIT and production data validation across Canadian and U.S. portfolios for RESL Flexline Broker Commitment (Project Granite), directing defect resolution and business reporting.
  • ETL Orchestration & Automation: Redesigned balance mismatch pipeline, replacing manual Excel extracts with automated SSIS/SSRS workflows for daily POD volume reporting across Canoe-enriched and FTP run types.
  • Regulatory Compliance Reporting: Coordinated with tech partners to determine LCR (Liquidity Coverage Ratio) for OSFI regulatory reporting on retail loan portfolios.
  • Reference Data Governance: Authored TDEF data dictionaries and lineage for Indigo onboarding; updated Canoe RDM LOB reference mapping for U.S. Finance reorg.

Senior BIM Analyst

Aug 2017 – May 2021
TD Bank · Credit Cards
  • Large-Scale Data Migration: Drove the complex data migration of a $30B+ Merchant Solutions portfolio from legacy First Data (SQL 2005) to TSYS (SQL 2012) platform with zero defects, migrating 30 history tables and 49 SSIS packages in just 6 months.
  • Big Data Engineering: Architected the Business Control Center reporting layer on Hadoop (Hive/Impala). Developed automated Core Loyalty Knowledge Base data mart pipelines using PySpark.
  • Crisis Response & Automation: Engineered automated pipelines (Python, SSIS, VBA, CA7) during COVID-19 to support 7-day BAU operations for Minimum Payment Deferrals and card re-aging.
  • Source Code Governance: Designed Git/Bitbucket branching workflows; governed 2,261 production scripts and delivered hands-on CI/CD training to the Personal Banking analytics team.

BIM Analyst

Nov 2015 – Aug 2017
TD Bank · Credit Cards · Decision Science
  • Data Reconciliation & Optimization: Rebuilt rewards loyalty data models, deploying points-reversal logic that achieved 100% redemption reconciliation with Finance and recovered ~76B unallocated points.
  • Database Architecture: Constructed a centralized SAS Sandbox environment to streamline campaign targeting logic and DDL/DML collaboration for analytics teams.