loader from loading.io

MLA 022 Vibe Coding

Machine Learning Guide

Release Date: 02/09/2025

MLA 030 AI Job Displacement & ML Careers show art MLA 030 AI Job Displacement & ML Careers

Machine Learning Guide

ML engineering demand remains high with a 3.2 to 1 job-to-candidate ratio, but entry-level hiring is collapsing as AI automates routine programming and data tasks. Career longevity requires shifting from model training to production operations, deep domain expertise, and mastering AI-augmented workflows before standard implementation becomes a commodity. Links Notes and resources at   - stay healthy & sharp while you learn & code  - use my voice to listen to any AI generated content you want Market Data and Displacement ML engineering demand rose 89% in early 2025....

info_outline
MLA 029 OpenClaw show art MLA 029 OpenClaw

Machine Learning Guide

OpenClaw is a self-hosted AI agent daemon that executes autonomous tasks through messaging apps like WhatsApp and Telegram using persistent memory. It integrates with Claude Code to enable software development and administrative automation directly from mobile devices. Links Notes and resources at   - stay healthy & sharp while you learn & code  - use my voice to listen to any AI generated content you want OpenClaw is a self-hosted AI agent daemon (Node.js, port 18789) that executes autonomous tasks via messaging apps like WhatsApp or Telegram. Developed by Peter...

info_outline
MLA 028 AI Agents show art MLA 028 AI Agents

Machine Learning Guide

AI agents differ from chatbots by pursuing autonomous goals through the ReACT loop rather than responding to turn-based prompts. While coding agents are currently the most reliable due to verifiable feedback loops, the market is expanding into desktop and browser automation via tools like Claude co-work and open claw. Links Notes and resources at   - stay healthy & sharp while you learn & code  - use my voice to listen to any AI generated content you want Fundamental Definitions Agent vs. Chatbot: Chatbots are turn-based and human-driven. Agents receive...

info_outline
MLA 027 AI Video End-to-End Workflow show art MLA 027 AI Video End-to-End Workflow

Machine Learning Guide

How to maintain character consistency, style consistency, etc in an AI video. Prosumers can use Google Veo 3’s "High-Quality Chaining" for fast social media content. Indie filmmakers can achieve narrative consistency by combining Midjourney V7 for style, Kling for lip-synced dialogue, and Runway Gen-4 for camera control, while professional studios gain full control with a layered ComfyUI pipeline to output multi-layer EXR files for standard VFX compositing. Links Notes and resources at   - stay healthy & sharp while you learn & code - use my voice to listen to any AI...

info_outline
MLA 026 AI Video Generation: Veo 3 vs Sora, Kling, Runway, Stable Video Diffusion show art MLA 026 AI Video Generation: Veo 3 vs Sora, Kling, Runway, Stable Video Diffusion

Machine Learning Guide

Google Veo leads the generative video market with superior 4K photorealism and integrated audio, an advantage derived from its YouTube training data. OpenAI Sora is the top tool for narrative storytelling, while Kuaishou Kling excels at animating static images with realistic, high-speed motion. Links Notes and resources at   - stay healthy & sharp while you learn & code - use my voice to listen to any AI generated content you want S-Tier: Google Veo The market leader due to superior visual quality, physics simulation, 4K resolution, and , which removes...

info_outline
MLA 025 AI Image Generation: Midjourney vs Stable Diffusion, GPT-4o, Imagen & Firefly show art MLA 025 AI Image Generation: Midjourney vs Stable Diffusion, GPT-4o, Imagen & Firefly

Machine Learning Guide

The AI image market has split: Midjourney creates the highest quality artistic images but fails at text and precision. For business use, OpenAI's GPT-4o offers the best conversational control, while Adobe Firefly provides the strongest commercial safety from its exclusively licensed training data. Links Notes and resources at   - stay healthy & sharp while you learn & code - use my voice to listen to any AI generated content you want The 2025 generative AI image market is defined by a split between two types of tools. "Artists" like Midjourney excel at creating...

info_outline
MLG 036 Autoencoders show art MLG 036 Autoencoders

Machine Learning Guide

Auto encoders are neural networks that compress data into a smaller "code," enabling dimensionality reduction, data cleaning, and lossy compression by reconstructing original inputs from this code. Advanced auto encoder types, such as denoising, sparse, and variational auto encoders, extend these concepts for applications in generative modeling, interpretability, and synthetic data generation. Links Notes and resources at   - stay healthy & sharp while you learn & code Build the future of multi-agent software with . Thanks to  from  for recording...

info_outline
MLG 035 Large Language Models 2 show art MLG 035 Large Language Models 2

Machine Learning Guide

At inference, large language models use in-context learning with zero-, one-, or few-shot examples to perform new tasks without weight updates, and can be grounded with Retrieval Augmented Generation (RAG) by embedding documents into vector databases for real-time factual lookup using cosine similarity. LLM agents autonomously plan, act, and use external tools via orchestrated loops with persistent memory, while recent benchmarks like GPQA (STEM reasoning), SWE Bench (agentic coding), and MMMU (multimodal college-level tasks) test performance alongside prompt engineering techniques such as...

info_outline
MLG 034 Large Language Models 1 show art MLG 034 Large Language Models 1

Machine Learning Guide

Explains language models (LLMs) advancements. Scaling laws - the relationships among model size, data size, and compute - and how emergent abilities such as in-context learning, multi-step reasoning, and instruction following arise once certain scaling thresholds are crossed. The evolution of the transformer architecture with Mixture of Experts (MoE), describes the three-phase training process culminating in Reinforcement Learning from Human Feedback (RLHF) for model alignment, and explores advanced reasoning techniques such as chain-of-thought prompting which significantly improve complex...

info_outline
MLA 024 Agentic Software Engineering show art MLA 024 Agentic Software Engineering

Machine Learning Guide

Agentic engineering shifts the developer role from manual coding to orchestrating AI agents that automate the full software lifecycle from ticket to deployment. Using Claude Code with MCP servers and git worktrees allows a single person to manage the output and quality of an entire engineering organization. Links Notes and resources at   - stay healthy & sharp while you learn & code  - use my voice to listen to any AI generated content you want The Shift: Agentic Engineering Andrej Karpathy transitioned from "vibe coding" in February 2025 to "agentic engineering" in...

info_outline
 
More Episodes

Andrej Karpathy coined "vibe coding" in February 2025 - a year later, 41% of all code is AI-generated, agents run multi-hour tasks autonomously, and the developer role has shifted from writing code to orchestrating systems.

Links

In February 2025, Andrej Karpathy posted a tweet describing how he'd stopped reading diffs, hit "Accept All" on every suggestion, and just copy-pasted error messages back into the chat. He called it "vibe coding" - fully giving in to the vibes and forgetting the code even exists. The post got 4.5 million views. By late 2025, Collins Dictionary named it Word of the Year.

But this wasn't a sudden invention. It was the culmination of a four-year arc that started with GitHub Copilot's line-by-line autocomplete in 2021 and accelerated through GPT-4, 192K+ token context windows, reasoning models, and tool-use architectures. The result: AI shifted from suggesting the next line to autonomously planning, editing, testing, and committing across entire codebases.

The tool landscape has stratified fast

The ecosystem now breaks into three categories:

Terminal-native agents like Claude Code and Gemini CLI give power users direct environment access, scriptability, and Unix-style composability. Claude Code runs on models up to Claude Opus 4.5, supports 200K tokens (1M in beta), and spawns subagents for parallel work. Gemini CLI counters with a 1M-token context window and the most generous free tier in the space - 60 requests/minute, 1,000/day.

IDE-integrated agents like Cursor and Windsurf meet developers where they already work. Cursor hit $1B+ annualized revenue and a $29.3B valuation by going agent-first - its 2.0 release runs up to 8 parallel agents via git worktrees. Windsurf was acquired by Cognition (Devin AI) for $3B.

Cloud-based agents like OpenAI Codex take a different approach entirely - each task spins up an isolated sandbox with your repo, enabling true parallel execution. GPT-5.1-Codex-Max was the first model natively trained for multi-context operation, capable of 24+ hours of independent work.

Open-source pioneers still matter too. Aider (39K GitHub stars) introduced RepoMap for structural code context and now writes 50-88% of its own code. Cline (56K stars) established the human-in-the-loop approval pattern. GPT-Engineer evolved into Lovable, now a $6.6B unicorn.

Three pillars define the emerging stack

MCP (Model Context Protocol) solves the integration problem. Released by Anthropic in November 2024 and now hosted by the Linux Foundation, it's the "USB-C for AI" - a standard protocol replacing N×M custom integrations with N+M implementations. It has 97M monthly SDK downloads and clients across Claude, Cursor, Windsurf, Zed, and VS Code.

Skills turn prompt engineering into reusable packages. They're markdown files that extend agent capabilities through instruction injection - structured recipes telling an agent how to perform specific tasks. They can be shared, version-controlled, and scoped from global to project-level.

Harnesses are the real differentiator. Two agents running the same model differ entirely based on harness quality - the infrastructure governing context bridging, progress tracking, and environment management across sessions. The recommended pattern uses a two-agent architecture: an initializer sets up the environment, and a coding agent makes incremental progress one feature at a time.

Context engineering is the new critical skill

The practical constraint isn't model intelligence - it's what fits in the attention window. The discipline of context engineering has three strategies: reduce (compact older tool calls), offload (save results to filesystem), and isolate (spawn sub-agents for token-heavy subtasks). KV-cache optimization alone delivers 10x cost reduction on repeated context.

What's next

Dario Amodei claimed AI would write 90% of code within 3-6 months of March 2025. Gartner projects 40% of enterprise apps will use AI agents by end of 2026. The near-term trajectory includes repository intelligence (AI understanding code relationships and history, not just lines), production MCP deployments, and agent monitoring with ROI measurement.

The practical takeaway: developers are becoming AI conductors - using agents for boilerplate and rapid prototyping while applying judgment for architecture, direction, and safety. Reviewing AI-generated code effectively requires deeper understanding, not less. The teams winning are those treating infrastructure as lightweight scaffolding around rapidly evolving model capabilities, and expecting to re-architect as models improve monthly.