Nathan Marz - On changing the economics of building large-scale software with Rama - #23
Release Date: 09/22/2023
Life as a Distinguished Engineer | Joakim Recht (Uber)
Software Misadventures
Out of thousands of engineers at Uber, there’s only a handful of Distinguished Engineers and Joakim was one of them. In this conversation we chat about Why software engineering is a lot like a sausage factory. Considerations for leaving big tech for a startup. “How to beat the promo commitee”. How can one effectively shape engineering culture? “Mentoring two people on the same team is a waste”. Much More. Segments: [0:01:52] The “reverse sausage” architecture [0:07:36] How to get people on board with the new deployment system? [0:13:55] What does it mean to be a...
info_outline
Learning in public | Kelsey Hightower
Software Misadventures
We’re super excited to have Kelsey back on the show! Our last conversation was around his incredible career journey - from working at McDonald’s after school to starting his own computer store, to hacking on python infrastructure with the core developers, to meeting Satya Nadella for an interview. In part two of this conversation, we dive deep into Kelsey’s experiences learning in public and writing “Kubernetes: Up and Running”: The biggest barrier to getting started with learning in public and a step-by-step guide to overcome it Cautionary tale of the “JavaScript sucks” guy ...
info_outline
Engineer's guide to startup advising | Kelsey Hightower
Software Misadventures
We’re super excited to have Kelsey back on the show! Our last conversation was around his incredible career journey - from working at McDonald’s after school to starting his own computer store, to hacking on python infrastructure with the core developers, to meeting Satya Nadella for an interview. In part one of this conversation, we dive deep into Kelsey’s experiences and expertise as a startup advisor: How to break into advising when you don’t have a lot of connections How to influence without authority Passive vs. active advising How to add value as an advisor Setting...
info_outline
The hard power of management and the soft power of senior ICs | Josh Wills
Software Misadventures
As a self-described “gainfully unemployed data person”, Josh Wills is an angel investor and has worked on and led data teams at Slack, Cloudera, WeaveGrid and Google. We discuss: How to get started with angel investing without a ton of $$ Attributes that define great engineering managers What’s it like transitioning from management back to IC Challenges in Climate Tech from a software perspective And more Segments: [0:01:35] Transitioning from management to individual contributor (IC). [0:10:19] Emotional intelligence and its role in engineering management. [0:25:21]...
info_outline
From High School Suspension to US Chief Data Scientist | DJ Patil
Software Misadventures
Known for coining the term “Data Scientist”, DJ is a renowned technologist with a diverse background spanning academia, industry, and government. Having led product teams at companies like RelateIQ and LinkedIn, DJ was appointed by President Obama to be the first U.S. Chief Data Scientist where his efforts led to the establishment of nearly 40 Chief Data Officer roles across the Federal government, new health care programs as well as new criminal justice reforms. We discuss: “Dream in years, plan in months, evaluate in weeks, ship daily” High school misadventures that shaped DJ’s...
info_outline
Building Diverse Engineering Teams | Erica Lockheimer
Software Misadventures
Erica is a former VP of Engineering at LinkedIn. Having almost dropped out of college, Erica’s journey in tech is a testament to her perseverance and dedication. In addition to leading engineering teams at LinkedIn, Erica founded WIT (Women In Tech) to empower women within the company as well as the broader tech community. We discuss: How to create incentives for diversity-building work. Building your personal “board of directors”. Balancing mentoring work vs sprint tickets. Structuring a community for long-term success. Much more. Segments: [0:18:04] building...
info_outline
Stories behind building HashiCorp | Mitchell Hashimoto
Software Misadventures
Mitchell co-founded HashiCorp in 2012 and created many important infrastructure tools, such as Terraform, Vagrant, Packer, and Consul. In addition to being a prolific engineer, Mitchell grew HashiCorp into a multi-billion-dollar public company. We discuss: How to structure large projects to avoid demotivation or burnout The "A.P.P.L.E" framework for diffusing tense situations and handling trolls How to decide what to work on Mitchell's unconventional transitions from CEO to CTO and then back to an individual contributor (IC) The quality that Mitchell values the most in an engineering...
info_outline
Practical Guide to More Effective Mentorship | Dave O'Connor (Google, Twilio, Elastic)
Software Misadventures
After 17 years building SRE teams at Google and serving as the Site Lead for Engineering in Dublin, Dave joined Elastic as the Sr Director of Engineering and later VP of Engineering at Twilio. Following a recent career break, Dave now divides his time between coaching engineering leaders and consulting to help busy teams be more effective. In the heart of our conversation, Dave shares the frameworks and practical tips he's amassed for making the most of the mentorship experience. Segments: [00:01:45] Growing remote SRE team as the Google Dublin Site Lead [00:19:49] Company Culture vs...
info_outline
War stories from early days of engineering at LinkedIn | David Henke (LinkedIn, Yahoo)
Software Misadventures
At the personal request of Reid Hoffman to emerge from early retirement, David joined LinkedIn in 2009 during a period of rapid growth to help stabilize the chaos, cultivating a much-needed culture of “Site Up and Secure.” Before this, David served as SVP of Engineering and Operations at Yahoo!, overseeing their Search Marketing organization and the Production Operations infrastructure for the entire company. Throughout his career, David has held multiple leadership positions and is recognized as one of the top operations executives. David’s intensity, passion, courage and commitment to...
info_outline
Automating away your job as a Data Scientist | Melissa Runfeldt (Salesforce, CueIn)
Software Misadventures
Before joining CueIn last year as a Founding Data Scientist, Melissa was a Lead Data Scientist at Salesforce working on the Einstein Platform that focused on automating Data Science workflows. In this conversation we dive into Melissa’s unique journey, what to do in the face of increasing job automation and explore the latest developments in practical AI. Segments: [00:02:13] Melissa’s background in computational neuroscience [00:06:08] 7 years at Salesforce vs startup [00:11:31] Joining CueIn [00:19:30] Chatbot observability [00:28:16] Feedback loops [00:33:10] Use LLM to observe.. LLMs?...
info_outlineWhat does it mean to change the economics of software development? Nathan Marz joins the show to share how they reduced the cost of building Mastodon at Twitter-scale by 100X and the 10 years journey to build Rama, a new programming platform that made this feat possible.
Nathan is the founder of Red Planet Labs. Prior to RPL, he led engineering for BackType which was acquired by Twitter in 2011. Nathan created the Apache Storm project and wrote the book Big Data: Principles and best practices of scalable realtime data systems. Outside of working, Nathan is a private pilot, loves going to stand-up comedy shows, and is forever trying to teach his dog new tricks.
Show Notes:
- Nathan’s Twitter: https://twitter.com/nathanmarz
- What is Rama? https://redplanetlabs.com/learn-rama
- Reducing the cost of building Mastodon at Twitter-scale by 100X: https://blog.redplanetlabs.com/2023/08/15/how-we-reduced-the-cost-of-building-twitter-at-twitter-scale-by-100x/
Stay in touch:
✉️ Subscribe to our newsletter: https://softwaremisadventures.substack.com
👋 Send feedback or say hi: [email protected]
Segments:
[0:00] flying
[0:07] inefficiencies of backend software development
[0:17] suffering oriented programming
[0:23] AI programming?
[0:25] RAMA’s programming model
[0:33] deployment & monitoring with RAMA
[0:36] building a twitter clone at scale with RAMA
[0:43] migrations with RAMA
[0:54] driving adoption for RAMA
[1:01] fundraising
[1:15] building a fully remote team