MLA 024 Code AI MCP Servers, ML Engineering
Machine Learning Guide
Links Notes and resources at stay healthy & sharp while you learn & code audio/video editing with AI power-tools Tool Use in AI Code Agents File Operations: Agents can read, edit, and search files using sophisticated regular expressions. Executable Commands: They can recommend and perform installations like pip or npm installs, with user approval. Browser Integration: Allows agents to perform actions and verify outcomes through browser interactions. Model Context Protocol (MCP) Standardization: MCP was created by Anthropic to standardize how AI tools...
info_outline
MLA 023 Code AI Models & Modes
Machine Learning Guide
Links Notes and resources at stay healthy & sharp while you learn & code audio/video editing with AI power-tools Model Current Leaders According to the (as of April 12, 2025), leading models include for vibe-coding: Gemini 2.5 Pro Preview 03-25: most accurate and cost-effective option currently. Claude 3.7 Sonnet: Performs well in both architect and code modes with enabled reasoning flags. DeepSeek R1 with Claude 3.5 Sonnet: A popular combination for its balance of cost and performance between reasoning and non-reasoning tasks. Local Models Tools for Local...
info_outline
MLA 022 Code AI Tools
Machine Learning Guide
Links Notes and resources at stay healthy & sharp while you learn & code audio/video editing with AI power-tools I currently favor Roo Code. Plus either gemini-2.5-pro-exp-03-25 for Architect, Boomerang, or Code with large contexts. And Claude 3.7 for code with small contexts, eg Boomerang subtasks. Many others favor Cursor, Aider, or Cline. Copilot and Windsurf are less vogue lately. I found Copilot to struggle more; and their pricing - previously their winning point - is less compelling now. Why I favor Roo. The default settings have it as stable and effective as Cline, Cursor....
info_outline
MLG 033 Transformers
Machine Learning Guide
Links: Notes and resources at 3Blue1Brown videos: stay healthy & sharp while you learn & code audio/video editing with AI power-tools Background & Motivation RNN Limitations: Sequential processing prevents full parallelization—even with attention tweaks—making them inefficient on modern hardware. Breakthrough: “Attention Is All You Need” replaced recurrence with self-attention, unlocking massive parallelism and scalability. Core Architecture Layer Stack: Consists of alternating self-attention and feed-forward (MLP) layers, each wrapped...
info_outline
MLA 021 Databricks
Machine Learning Guide
to stay healthy while you study or work! Full notes at Raybeam and Databricks: Ming Chang from Raybeam discusses Raybeam's focus on data science and analytics, and how their recent acquisition by Dept Agency has expanded their scope into ML Ops and AI. Raybeam often utilizes Databricks due to its comprehensive nature. Understanding Databricks: Contrary to initial assumptions, Databricks is not just an analytics platform like Tableau but an ML Ops platform competing with tools like SageMaker and Kubeflow. It offers functionalities for creating notebooks, executing Python code, and using a...
info_outline
MLA 020 Kubeflow
Machine Learning Guide
to stay healthy while you study or work! Full notes at Conversation with Dirk-Jan Kubeflow (vs cloud native solutions like SageMaker) - Data Scientist at Dept Agency . (From the website:) The Machine Learning Toolkit for Kubernetes. The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable and scalable. Our goal is not to recreate other services, but to provide a straightforward way to deploy best-of-breed open-source systems for ML to diverse infrastructures. Anywhere you are running Kubernetes, you should be able to...
info_outline
MLA 019 DevOps
Machine Learning Guide
to stay healthy while you study or work! Full notes at Chatting with co-workers about the role of DevOps in a machine learning engineer's life Expert coworkers at Dept - Principal Software Developer - DevOps Lead (where Matt features often) Devops tools Pictures (funny and serious)
info_outline
MLA 017 AWS Local Development
Machine Learning Guide
to stay healthy while you study or work! Show notes: Developing on AWS first (SageMaker or other) Consider developing against AWS as your local development environment, rather than only your cloud deployment environment. Solutions: Stick to AWS Cloud IDEs (, , Connect to deployed infrastructure via Infrastructure as Code
info_outline
MLA 016 SageMaker 2
Machine Learning Guide
to stay healthy while you study or work! Full note at Part 2 of deploying your ML models to the cloud with SageMaker (MLOps) MLOps is deploying your ML models to the cloud. See for an overview of tooling (also generally a great ML educational run-down.)
info_outline
MLA 015 SageMaker 1
Machine Learning Guide
to stay healthy while you study or work! Part 1 of deploying your ML models to the cloud with SageMaker (MLOps) MLOps is deploying your ML models to the cloud. See for an overview of tooling (also generally a great ML educational run-down.) And I forgot to mention , I'll mention next time.
info_outlineTry a walking desk to stay healthy while you study or work!
Show notes at ocdevel.com/mlg/32.
L1/L2 norm, Manhattan, Euclidean, cosine distances, dot product
Normed distances link
- A norm is a function that assigns a strictly positive length to each vector in a vector space. link
- Minkowski is generalized.
p_root(sum(xi-yi)^p). "p" = ? (1, 2, ..) for below. - L1: Manhattan/city-block/taxicab.
abs(x2-x1)+abs(y2-y1). Grid-like distance (triangle legs). Preferred for high-dim space. - L2: Euclidean.
sqrt((x2-x1)^2+(y2-y1)^2.sqrt(dot-product). Straight-line distance; min distance (Pythagorean triangle edge) - Others: Mahalanobis, Chebyshev (p=inf), etc
Dot product
- A type of inner product.
Outer-product: lies outside the involved planes. Inner-product: dot product lies inside the planes/axes involved link. Dot product: inner product on a finite dimensional Euclidean space link
Cosine (normalized dot)