Peter Song

Peter Song is a machine learning, data engineer, and AI writer with a focus on practical ML workflows. He shares insights on machine learning, data tools, and MLOps.

How to Use AWS Data Pipeline for Machine Learning

by

Machine learning workflows are inherently data-intensive, requiring orchestration of complex sequences: data extraction from multiple sources, transformation and cleaning, feature engineering, model training, validation, and deployment. Managing these workflows manually quickly becomes unsustainable as complexity grows. AWS Data Pipeline, a web service for orchestrating and automating data movement and transformation, provides infrastructure for building reliable, … Read more

Real-Time Prediction Pipelines Using Kafka and Python

by

The demand for real-time machine learning predictions has transformed from a competitive advantage into a business necessity. Whether detecting fraudulent transactions within milliseconds, personalizing content as users browse, or predicting equipment failures before they occur, organizations require prediction systems that process streaming data and deliver results in real-time. Building these systems requires combining stream processing … Read more

How to Validate Geo Holdout Experiments Using Synthetic Control Methods

by

Geographic holdout experiments have become a cornerstone of marketing measurement, allowing companies to estimate the causal impact of advertising campaigns by comparing regions where ads run (treatment) against regions where they don’t (control). Unlike digital A/B tests where individual users can be randomly assigned to treatment and control, geo experiments deal with entire markets—cities, DMAs, … Read more

Naive Bayes Variants: Gaussian vs Multinomial vs Bernoulli

by

Naive Bayes classifiers are among the most elegant algorithms in machine learning—simple in concept, fast in execution, and surprisingly effective across diverse applications. The “naive” assumption that features are conditionally independent given the class label seems unrealistic, yet in practice, Naive Bayes often performs competitively with far more complex models. However, not all Naive Bayes … Read more

Machine Learning Models for Forecasting Subscription Revenue in Ecommerce

by

Subscription-based ecommerce businesses live and die by their ability to accurately forecast revenue. Unlike traditional ecommerce where transactions are discrete, subscription models create complex, interdependent patterns involving new customer acquisition, retention rates, upgrade behavior, seasonal churn, and reactivation—all of which must be predicted simultaneously to generate reliable revenue forecasts. Traditional forecasting methods struggle with this … Read more

Fun Data Visualisation Ideas Using Free Datasets

by

Data visualisation doesn’t have to be dry corporate dashboards and quarterly sales reports. Some of the most engaging, creative, and educational visualisations come from exploring quirky datasets about topics people actually care about—pop culture, sports, food, travel, and the countless fascinating patterns hidden in everyday life. The internet is overflowing with free, high-quality datasets just … Read more

Real World Examples of LLMs in Healthcare and Life Sciences

by

Large Language Models are no longer confined to writing emails and generating code. In healthcare and life sciences, LLMs are being deployed in production systems that directly impact patient care, accelerate drug discovery, and transform how medical knowledge is accessed and applied. These aren’t experimental projects or proof-of-concepts—they’re operational systems processing millions of medical interactions, … Read more

How LLMs Are Transforming Customer Support Automation

by

Customer support has always been a challenging balance between efficiency and quality. Companies need to respond quickly to thousands of inquiries while maintaining the personalized, empathetic service that builds customer loyalty. For decades, this meant choosing between expensive human agents who provide excellent service but don’t scale, or rigid automated systems that scale well but … Read more

What is NLP vs ML vs DL: Differences and Relationships

by

If you’re exploring artificial intelligence, you’ve likely encountered the terms Machine Learning (ML), Deep Learning (DL), and Natural Language Processing (NLP). These acronyms are everywhere in tech discussions, research papers, and job descriptions. While they’re often used interchangeably in casual conversation, they represent distinct concepts with specific relationships to each other. Understanding these differences isn’t … Read more

Connecting AWS Glue and SageMaker for ML Pipelines

by

Machine learning pipelines in production require more than just model training. The reality is that data scientists spend roughly 80% of their time on data preparation, transformation, and feature engineering before they can even begin training models. This is where the combination of AWS Glue and Amazon SageMaker becomes transformative. While SageMaker excels at machine … Read more