Portfolio & Professional History

Dan Ferguson

Senior AI/ML Solutions Architect building at the intersection of machine learning systems, cloud infrastructure, and enterprise strategy. Focused on turning cutting-edge ML research into production-grade systems that create measurable business value.

New York, NY · [email protected] · GitHub

Professional Experience

Amazon Web Services
Sr. AI/ML Specialist Solutions Architect — Worldwide Specialist Organization

Working with AWS's largest enterprise customers to design and harden cutting-edge inference architectures through open-source integrations with Amazon SageMaker AI. This role sits at the frontier of ML inference — where model performance meets production reliability at scale.

I develop expert-level technical content, including blog posts and open-source tooling, that AWS field teams and customers use to build and mature their inference systems. My work focuses on bridging the gap between research-grade ML and enterprise-grade deployment.

Amazon Web Services
Sr. AI/ML Specialist Solutions Architect — Private Equity

Served as the trusted AI/ML advisor for Private Equity firms and their portfolio companies, helping them leverage ML and generative AI technologies within their 5–7 year value creation roadmaps. This role spanned the full spectrum from strategic alignment with Operating Partners to hands-on architecture and prototyping with engineering teams.

As the lead ML Specialist Solutions Architect for PE in the NAMER region, I built the playbook for AI/ML engagement across the PE landscape — then trained a cohort of generalist Solutions Architects to scale it. I cultivated a partner network of ML-focused delivery firms that extended our reach across dozens of portfolio companies. These efforts directly enabled our team to exceed our generative AI proof-of-concept program goal by more than 3x.

Alongside customer work, I contributed to the AWS knowledge base as a Subject Matter Expert: co-authoring Well-Architected papers for ML and Generative AI, writing technical blog posts, contributing to open-source repositories, and coaching colleagues as a trained speaker bar-raiser.

Ippon Technologies
Solutions Architect / Technical Manager, Consultant

Played a central role in establishing and maturing Ippon's data practice, introducing strategic frameworks for data-driven solutions and leading a team of consultants through hands-on engagements. I scoped architectures, led delivery teams, drafted business proposals, and conducted AWS Well-Architected Reviews across Ippon's client portfolio.

My client engagements during this period spanned data platform development, event-driven architectures, cloud data warehousing, and ETL modernization for companies ranging from early-stage startups to enterprise healthcare and financial services firms.

Royal Bank of Canada
Site Reliability Engineer — Market Data Operations & Engineering

Led critical infrastructure and tooling initiatives within Capital Markets, managing a global low-latency message bus spanning six data centers. This role combined deep systems engineering — troubleshooting network issues, RHEL server configurations, and Solace messaging appliances — with multi-language software development in Java, Perl, PHP, C#, and Python.

I developed production monitoring tools, automated global failover orchestration, pioneered chatbot integrations on the Symphony platform, and deployed distributed analytics stacks across regions — establishing operational practices that improved reliability and transparency across the division.

Motorola Solutions
Software Engineer — Automation Team, Testing & Validation

Started my career developing automation scripts for barcode scanner testing in C# and building data visualization software for performance benchmarking. My log analysis and visualization application — my first project as a lead developer — remained in production for several years after my departure, and served both engineering and marketing teams.

Selected Projects

A closer look at some of the projects I've led or contributed to. These reflect the hands-on, architecture-to-delivery approach I bring to every engagement. This section will continue to grow as I add deeper write-ups, code walkthroughs, and retrospectives.

Amazon Web Services
PE Generative AI POC Program
Conceived and operationalized a program to qualify, architect, fund, and execute generative AI proof-of-concept opportunities across AWS's Private Equity customer base. Built the competency framework, trained Solutions Architects, and cultivated a partner delivery network. The program exceeded its original target by over 3x.
Amazon SageMaker Generative AI Program Design Partner Enablement
Amazon Web Services — Open Source
ML Container Creator
Sole author of awslabs/ml-container-creator, an open-source tool that simplifies the creation of custom ML containers for Amazon SageMaker. Designed to reduce the friction engineers face when packaging custom training and inference code for production deployment.
Python Docker Amazon SageMaker Open Source
Ippon Technologies — Qomplx
Cyber-Security Scoring Platform & Data Lake
Designed and led development of a fully serverless scoring platform powered by Cassandra, AWS Lambda, Apache Spark on EMR, and an event-driven architecture using EventBridge, SNS, and SQS. Followed with a second engagement to build a governed data lake on AWS Glue and Lake Formation for enriching scoring data with external sources. Led a team of five engineers across both phases.
Cassandra AWS Lambda Apache Spark EventBridge AWS Glue Lake Formation
Ippon Technologies — TickPick
Centralized Data Platform & ML Lakehouse
Led the design and delivery of a cloud data warehouse supporting scoped ML workloads for the ticket marketplace. Architected a lakehouse on Azure Blob Store, Airflow, and Snowflake with managed streaming ingest. Implemented PII masking, data sanitization, custom CI/CD, and production failover procedures. Hired and trained the team that maintained the platform after engagement.
Snowflake Airflow Azure ETL CI/CD
Ippon Technologies — Pager
Kafka Migration & Event-Sourcing Modernization
Deployed as a messaging and real-time data expert to evaluate and modernize Pager's event-sourcing architecture. Designed a proof-of-concept that published across both the existing RabbitMQ bus and a new Kafka cluster. Wrote a comprehensive messaging schema and topic structure, extended Airflow ETL capabilities, and presented findings at an internal hackathon — earning credibility for Kafka as the production replacement.
Apache Kafka RabbitMQ Airflow Event-Driven Architecture
Royal Bank of Canada
Pacemaker — Global Low-Latency Messaging Monitor
Built a Java Spring application for hardware-accelerated Solace messaging appliances that exchanges heartbeats across six global data centers, each instance managing 20–100 TCP connections. Pacemaker validated messaging integrity, measured latency, and automated the checkout process for fully automated failover/failback. Extended with a REST-based web component for operator control during maintenance.
Java Spring Solace Low-Latency Networking RHEL
Royal Bank of Canada
Symphony ChatBot Platform & Standardization
Wrote a Java wrapper around the Symphony API that standardized authentication and chat bot behavior across the platform. Built Centurion, RBC's first chatbot, which used a request-response mechanism to monitor onboarded bots and ensure uptime compliance. This library and bot gave the Market Data team the governance tools to scale Symphony adoption across application teams bank-wide.
Java Symphony API ServiceNow HPSM
Royal Bank of Canada
Global Message Bus Failover Automation
Designed and developed the full automation stack for regular failovers across four globally distributed data centers. This included a transactional failover script for three-instance router clusters (handling live TCP migration, durable message migration, and SAN reconfiguration), an orchestration layer for dependent application failover, and a continuous monitoring system for hundreds of geographically distributed hosts.
PHP Perl Solace Infrastructure Automation
Royal Bank of Canada
Application Impact Profiling & Chargeback System
Built a multi-component initiative spanning a Java telemetry profiler, a C# email reporting tool, Python automation, and a SharePoint metadata system. The profiler exposed per-application impact on the global message bus, while automated reports gave application owners transparent visibility into their resource consumption. This work enabled the Market Data Operations team to develop a chargeback model for fixed-income and equities trading applications.
Java C# Python Telemetry
More coming soon. I'll be adding deeper write-ups, architecture diagrams, and code walkthroughs for these projects and others. Check back or subscribe to the blog for updates.

Publications & Expert Papers

Technical writing across AWS expert papers, the AWS Machine Learning Blog, the AWS Architecture Blog, and Ippon Technologies' engineering blog. This section will expand as I publish new pieces.

AWS Well-Architected Expert Papers

AWS Blog

Ippon Technologies Blog

New writing on the way. I'm working on pieces about the transition from model builders to SaaS companies, practical inference optimization patterns, and lessons from scaling AI across the Private Equity landscape.

Public Speaking

Scale AI agents with custom models using Amazon SageMaker AI & SGLang (AIM387)
AWS re:Invent 2025
Dec 2025
Well-Architected Custom Lens for Generative AI — AWS onAir Session
AWS NY Summit 2025
Jul 2025
AWS re:Inforce 2025
AWS re:Inforce
Jun 2025
Generative AI Workshops and Executive Briefings
Various PE Firms & Portfolio Companies
Apr – Nov 2024
Defining & Implementing Innovative Generative AI Workloads
Berkadia Generative AI Summit
Nov 2023
Cloud Cost Management
Riverside Leadership Summit '23
Mar 2023
Best Practices for Maintaining Sustainable AI/ML Workloads
JPMC AI/ML Summit
Dec 2022
Formulating Novel AI/ML Workloads
KKR Procurement Summit
Oct 2022
Cloud-Native Data Lakes
Riverside Leadership Summit '22
Mar 2022
Enforcing Data Quality on AWS
Apr 2020
Java as it Evolves Into a Functional Language
Jun 2019

Certifications

AWS Generative AI Developer — Professional
AWS Solutions Architect — Professional
AWS Machine Learning — Specialty
AWS Alexa Skill Builder — Specialty
AWS Developer — Associate
AWS Solutions Architect — Associate
AWS SysOps Administrator — Associate
Confluent Certified Developer for Apache Kafka
DataStax Apache Cassandra Developer Associate

Education

M.S. in Data Science & Analytics
Georgia Institute of Technology
Dec 2025
B.S. in Mathematics / Computer Science
St. Joseph's College, Patchogue, NY
Cum Laude with Honors · Presidential Tuition Scholarship · Honors College · ΩΠΕ Recognition
May 2014
NYU Abu Dhabi Ph.D. Global Fellowship
New York University, Abu Dhabi
Recipient, September 2014 – May 2015
2014 – 2015