Interview, Fireside Chat
E174: Inflation stays hot, AI disclosure bill, Drone warfare, defense startups & more
Podcast Status & Attendance
- Host J. Cal is absent due to a cracked tooth sustained while eating a bison rib at the Salt Lake in Austin.
- The All-In Summit 2024 is confirmed for September 8–10 in Los Angeles at the UCLA facilities.
- Summit applications are open at
summit.allinpodcast.cowith a single ticket tier offering transport, concierge booking, and elevated content. - The All-In team debated holding the event in Las Vegas or abroad but selected Los Angeles to leverage existing success.
- Speaker announcements for the summit are scheduled for "a couple of weeks."
AI & NVIDIA Market Dynamics
- Jonathan Ross (founder of Grok) stated at a Paris AI conference that NVIDIA's current strength lies in training ("learning"), while their business growth target is inference.
- Ross predicts that upon executing his roadmap, he will control 50% of available inference compute by the end of next year.
- This shift toward inference-focused compute would require a smaller physical footprint, lower power consumption, and higher tokens per second compared to current NVIDIA architecture.
- NVIDIA faces a structural "innovator's dilemma" because its architecture relies on HBM (high bandwidth memory) and specific optical cables; they have bought up world supply, making it difficult for competitors to build orthogonal designs without supply chain constraints.
- NVIDIA employs a strategy similar to Intel's historical dominance: defining industry metrics (e.g., clock speed for CPUs, throughput for GPUs) that drive consumer upgrades regardless of actual user experience improvements.
- The distinction between learning and inference is critical for chip startups and investors, as those ignoring HBM and optical cable supply constraints face significant barriers.
Urban Conditions & Policy Analysis
- The hosts observed a trend of crumbling infrastructure and rising petty crime (drug use, vandalism) in major Western cities including San Francisco, Paris, and London.
- San Francisco's issues are attributed to policies of decriminalization, deprosecution, and decarceration, including a California referendum lowering the theft felony threshold to $950.
- Recent elections in San Francisco have defeated some radical supervisors, but the hosts note the "one-party state" nature of the city makes rapid policy reversal difficult.
- Paris and London reported specific safety concerns regarding knife crime and robbery, with locals advising tourists to avoid displaying watches or valuables.
- In contrast, the hosts noted that cities in Asia (Singapore, Japan) appear orderly and well-managed, lacking the specific social liberal-driven urban decay observed in the West.
- New York City's historical turnaround in the 1980s required two mayors and a decade of enforcement, highlighting the difficulty of reversing current urban trends without strong leadership.
Cloud Computing Ecosystem
- The Google Next conference in Las Vegas had 30,000 attendees, indicating a massive ecosystem where hundreds of companies build services on top of cloud infrastructure.
- Enterprise customers generally avoid single-cloud lock-in, utilizing multi-cloud strategies (AWS, Azure, GCP) to optimize pricing and functionality across different services.
- Basic commoditized cloud services (e.g., data storage) are in a "race to the bottom" on pricing; value and margins now derive from higher-level services, proprietary models, and developer ecosystems.
- Major consulting firms (Capgemini, Deloitte, PwC) are aggressively pitching cloud services, highlighting the competitive nature of the market.
- "Lock-in" is shifting from infrastructure to the quality of developer services and tools provided by cloud vendors.
Macroeconomics & Inflation
- March CPI data came in at 3.5% year-over-year, up from 3.2% in February and higher than forecasts for the third consecutive month.
- Specific inflation sectors include: Housing (+5.7%), Transportation (+10.7%), and Car Insurance (+22.2%).
- Larry Summers argues that the "Fed Put" (expectation of rate cuts) is dead; he suggests rates may need to remain high or even rise, noting that including borrowing costs in inflation calculations would have peaked the index at 18% rather than 9%.
- The Biden administration faces political headwinds as persistent inflation reduces the likelihood of rate cuts before the election, which historically helps incumbents.
- Government debt rollover pressures are significant: $7.6 trillion in debt maturing in the next 12 months will be refinanced at significantly higher rates, adding an estimated $210 billion in annual debt service costs.
- Commercial real estate is under severe stress as "extend and pretend" loan restructuring fails if rates stay high; some properties have faced fire sales with 99% equity wipeouts.
- The 40-year trend of declining interest rates may be ending, creating a structural headwind for stocks, bonds, and private equity due to higher hurdle rates and government borrowing crowding out private capital.
- Oil prices are rising because OPEC+ production cuts are outpacing increased US production, suggesting international actors may be influencing US inflation to affect the election outcome.
- Commodities are up roughly 30% year-to-date as nations optimize for their own short-term economic security, increasing import costs for the US.
Generative AI & Copyright Legislation
- Adam Schiff introduced the "Generative AI Copyright Disclosure Act," requiring AI developers to register all copyrighted training data with the federal government.
- Skepticism exists regarding the bill's efficacy, with arguments that OpenAI trained GPT-4 on over a million hours of YouTube data without legal challenge from Google.
- The hosts debate whether AI training constitutes fair use; the consensus leans toward legal arbitration via courts rather than legislative pre-emption.
- Potential outcomes include: (1) Courts ruling training is fair use; (2) Regulations creating high barriers to entry that favor incumbents; (3) A standardized rights clearinghouse with compensation mechanisms.
- New AI music tools (e.g., Udio) demonstrate advanced capabilities to generate multi-layered, emotional tracks across genres, raising the stakes for copyright enforcement.
- The core legal question remains whether copyright infringement should be measured by the training process or the originality of the output.
Defense Technology & Autonomous Warfare
- Small, autonomous drones are reshaping warfare, demonstrated by Houthi attacks on cargo ships and Ukrainian operations against Russian tanks.
- Current drone reliance creates asymmetric cost challenges (e.g., shooting down $2,000 drones with $2 million missiles).
- Russia holds an advantage in Ukraine due to mass production capabilities and advanced electronic warfare/jamming compared to Ukraine.
- The future of warfare is shifting toward fully autonomous systems that can operate independently of teleoperation to evade jamming.
- China dominates the supply chain with 79% of global lithium-ion battery production, creating a strategic dependency for US drone manufacturing.
- US military enlistment is at historic lows, necessitating a shift toward remote, automated defense systems.
- Defense solutions include EMP (electromagnetic pulse) technology and autonomous defensive turrets (e.g., Allen Control Systems' "Bullfrog") to counter swarming drones.
- Silicon Valley faces a moral dilemma regarding defense investment, though the Department of Defense is actively seeking partnerships with tech startups to disrupt the oligopoly of traditional defense contractors.