AWS re:Inforce conference
Next in Tech
This year’s AWS re:Inforce conference was larger and fueled by greater agentic capabilities. Part of the 451 Research team that was at the conference, Henry Baltazar, Scott Crawford, William Fellows and Melanie Posey, join host Eric Hanselman to explore the announcements and progress that’s been made in expanding agentic capabilities and much more. As an incumbent infrastructure provider, AWS is looking to the top of the infrastructure stack to secure their advantage. A suite of developer tools, including the Kiro IDE, are looking to make the creation and operation of agents simpler. There...
info_outline
SC25 Supercomputing Conference
Next in Tech
Supercomputing has shifted from an esoteric and exotic part of technology to much more mainstream, mostly driven by AI. The massive amounts of computational power that once were reserved for the largest of computing problems in high performance computing (HPC), like weather and seismic analysis, are now commonplace in the world of AI. Analyst Gabriella Brown returns to talk about complex computing problems, quantum computing and photonics with host Eric Hanselman. SC25 has grown to over 16,000 attendees and almost 600 exhibitors, enough to sprawl across St. Louis’ Americas Center and into...
info_outline
Security and Observability
Next in Tech
The worlds of IT security and operations are being pulled together and AI is a catalyst that’s making it happen. The focus on observability that’s been part of the DevOps movement, is playing an important role in improving security effectiveness and Scott Crawford, Mark Ehr and Mike Fratto return to look at how this is happening with host Eric Hanselman. Security teams have always wrestled with making effective use of telemetry data from the infrastructure and applications they are securing. Correlating data from just the security tooling is hard enough, let alone adding operational data...
info_outline
Context Engineering
Next in Tech
As organizations have worked to leverage the power of AI in interacting with large language models, they’ve invested in prompt engineering to generate better results. But agents shift the need manage the full context of not only the prompt, but also the data that’s being presented. Analysts Jean Atelsek and Alex Johnston return to the podcast to look at the new discipline of context engineering and how it’s being put to work in AI environments with host Eric Hanselman. The process of context engineering looks at ensuring that the right data context is in place for agents to act on. It...
info_outline
The Big Picture Reports
Next in Tech
The latest Big Picture reports are out and cover a wide range of topics from financial markets to supply chains and onward to technology and AI. Two of the authors, Lindsey Hall and Chris Rogers, join host Eric Hanselman to talk about sustainability, supply chains and AI. These are tightly interwoven and their dependencies spill out into geopolitics, as well. Sustainability conversations have focused on climate adaptation and resilience. Climate risks are growing and yet only 35% of businesses have adaptation plans in place. The urgent demands for AI infrastructure are consuming both energy...
info_outline
Agentic Customer Experience
Next in Tech
As the holiday shopping season gets into full swing, this year thoughts are turning to agents and the changing role of AI in commerce. Sheryl Kingstone returns to discuss the impacts and offer insights into strategies for putting agents to work and working in a world of agents with host Eric Hanselman. AI is spanning generations in technology adoption and engagement in ways that previous technologies have struggled. Search and digital engagement had strong splits between different generations. The natural language capabilities of chat interfaces are stepping across technology hesitancy. But it...
info_outline
Money 20/20
Next in Tech
One of the biggest banking and payments conferences, Money 20/20, has wrapped up and the enthusiasm for all things stablecoin has continued. Jordan McKee, Sampath Sharma and McKayla Wooldridge return to discuss how this is evolving with host Eric Hanselman. The cryptocurrency has become the buzzy headline in so many of the conversations at Money 20/20. But consumers are still wary of stablecoins and the larger questions is around how financial services companies will deliver valuable services using them. Unlike previous years, there were no dark clouds hovering over the payments markets. The...
info_outline
Open Compute Project Summit
Next in Tech
The equipment that fills data centers is evolving rapidly, driven by the need to fulfill the seemingly insatiable appetite of AI applications. The Open Compute Project (OCP) was founded by Meta/Facebook to promulgate equipment standards and its annual Summit has grown from a small specialized gathering, to an event that strains the capacity of the San Jose Convention Center. Senior research analyst Perkins Liu returns to offer his take on this meteoric growth with host Eric Hanselman. AI requirements are pushing ever greater scale both logically and physically, with the width of server racks...
info_outline
Security Gravity
Next in Tech
There are many ways to frame conversations around cyber security. They can take on many aspects of security, ranging across the technical to the human. With the press towards platform consolidation, it’s critical to reconsider the interaction between the human and technical elements and research director Scott Crawford and Javvad Malik, CISO advisor at KnowBe4, join host Eric Hanselman to dig into this important interplay. It’s all too easy to fall into security practices that focus on technical requirements and don’t account for the friction that is created for the people who use them....
info_outline
Is there an AI bubble?
Next in Tech
The enthusiasm for AI has been impressive and it’s leading to the inevitable questions about whether or not all of it is warranted. Melissa Otto CFA, head of S&P Global’s Visible Alpha research team, returns to discuss concerns about an AI bubble with host Eric Hanselman. Defining what actually indicates a bubble might be the trickiest aspect of the question. Is it outsized levels of debt? Unrealistic valuations? Both debt and valuations are high, but are they unreasonably so? So much depends on seeing what AI capabilities can deliver and we’re still in the early days of...
info_outlineEnterprises are wrestling with delivering data to fuel their AI efforts, hitting roadblocks around data security and privacy concerns and sifting through use cases and models to put it to work. Too many are making high-stake gambles feeding vast quantities of data into massive models. Jesse Robbins, one of the founders of Chef, a progenitor of the DevOps movement, a builder of the early Internet infrastructure and now partner at Heavybit, joins host Eric Hanselman to look at alternatives to the path that many are taking in pursuit of successful AI projects. In much the same way that DevOps patterns look to shift application development to more smaller, incremental changes with a pipeline that drives continuous improvement, AI projects can work with smaller models and localized datasets to manage risk and iterate faster. It’s a pattern that avoids concerns of pushing sensitive data to cloud-based offerings by working locally. Using smaller models reduces infrastructure costs and the need for vast quantities of GPU’s.
Larger models sizes and data sets create two problems – more computational power and supporting infrastructure is required and more data complicates data provenance, security and ownership issues. Starting smaller and expecting to iterate on the results locally can have multiple benefits. If the data being used never leaves the local confines, security concerns are constrained to local environments. Tools like the open source project Ollama can deliver a choice of models to fit a variety of use cases and infrastructure capacities. Just like DevOps patterns, starting small and iterating quickly can get further faster and with lower risk.
More S&P Global Content:
Credits:
- Host/Author: Eric Hanselman
- Guests: Jesse Robbins
- Producer/Editor: Donovan Menard and Odesha Chan
- Published With Assistance From: Sophie Carr, Feranmi Adeoshun, Kyra Smith
Other Resources: