Latest Interviews

Production Engineering When Trading Billions of Dollars a Day

Mark Doss

Mark, a production engineer at Jane Street, outlines a high-stakes trading environment where even a 0.01% error rate can trigger insolvency, necessitating a monitoring strategy that rejects standard service level objectives in favor of code-level, event-based alerts. The firm employs a defense-in-depth approach using redundant, symptom-focused detection systems to catch catastrophic failures like fat-finger trades or stale market data before they cascade. By integrating deep domain knowledge into incident response and treating monitoring infrastructure as more critical than the trading systems themselves, Jane Street ensures that traders and engineers collaborate to resolve unique operational risks with extreme precision.

The Cost of Concurrency Coordination with Jon Gjengset

Jon Gjengset, John, Gabriel Kreiman

The presentation challenges the conventional view that mutexes are inherently slow, demonstrating instead that performance degradation in high-concurrency environments stems from CPU cache coherence overheads and MESI protocol costs rather than the lock mechanism itself. To address false sharing and serialization issues found in reader-writer locks, the speaker details the Left-Right data structure, a lock-free architecture that achieves linear scaling for read-heavy workloads by decoupling reader access from writer synchronization. Finally, the discussion emphasizes that optimal synchronization strategy depends on the specific read-to-write ratio and consistency requirements, urging developers to profile cache behavior and avoid blind optimization of lock primitives.

Matt Godbolt: Advanced Skylake Deep Dive

Matt Godbolt, Jesper

Matt Godbolt, a prominent C++ developer transitioning to HRT, presents a detailed reverse-engineered analysis of the Skylake-era CPU microarchitecture based on community findings rather than official documentation. The talk dissects critical pipeline stages including the front-end's instruction decoding, the micro-op cache limitations, and the complex register renaming mechanics that define the processor's performance characteristics. Key revelations include specific hardware flaws like the Loop Stream Detector bug, port allocation strategies, and the diminishing returns of increasing architectural register counts compared to the hundreds of physical registers already available.

Arjun Guha: How Language Models Model Programming Languages & How Programmers Model Language Models

Arjun Guha

Arjun Guha presents a comprehensive analysis of large language models in programming, highlighting how traditional benchmarks are saturating while new methods like multi-PLE and language-agnostic transforms reveal significant performance gaps in low-resource languages such as OCaml. Through mechanistic interpretability techniques like activation steering, the talk demonstrates that internal model vectors can effectively correct type prediction errors and switch target languages without retraining, exposing shared representations across diverse syntaxes. These technical insights are contextualized by human studies showing that student success in prompting models hinges on providing specific semantic clues rather than syntactic fixes, while industry data reveals a surge in AI co-authorship alongside complex debates regarding actual productivity gains.

Neil Mitchell: Pyrefly: Type Checking 1.8 Million Lines of Python Per Second

Neil Mitchell, Roman

Meta engineer Neil Mitchell introduced PyreFly, an open-source Python type checker reimplemented in Rust to address performance and scalability limitations for massive codebases like Instagram. The tool utilizes an aggressive memory eviction strategy and file-level concurrency to deliver rapid IDE feedback while supporting complex type features such as structural subtyping and flow narrowing. Released under the MIT license with over 100 contributors, PyreFly aims to replace legacy systems by prioritizing broad ecosystem adoption and seamless integration with build tools like Buck.

Will Crichton: Rust for Everyone!

Will Crichton

Will Creighton's research at the Cognitive Engineering Lab applies human-centered design and formal cognitive theories to address fundamental learning and debugging barriers in Rust. By developing three core tools—Aquascope for visualizing ownership permissions, Argus for interactive trait solver trees, and Flow History for precise program slicing—the team achieved a 9-point score increase in learner assessments and a threefold speedup in error localization during user studies. Future efforts are now directed toward resolving async/await complexities and promoting extensible IDE frameworks like CodeMirror to further advance a scientific approach to programming language design.

Making OCaml Safe for Performance Engineering

Mark

Jane Street's research introduces a suite of OCaml extensions featuring unboxed types and stack allocation to eliminate memory waste and garbage collection overhead in performance-critical applications. These innovations expand into a static mode system that guarantees data race freedom for parallel execution by enforcing lifetime and portability constraints without explicit annotations. Currently deployed in production for memory management features and undergoing beta testing for concurrency safety, this work aims to integrate into mainline OCaml while earning a POPL award for its formal verification of race freedom.

Horace He: Building Machine Learning Systems for a Trillion Trillion Floating Point Operations

Horace He

Meta compiler engineer Horace He analyzes the dramatic consolidation of AI infrastructure, noting that modern model training now requires massive power resources and billions in capital to achieve state-of-the-art performance. He details how the industry has transitioned from simple imperative execution to complex compiler strategies like FlexAttention and `torch.compile`, which are essential for managing the critical balance between GPU compute and memory movement. Ultimately, He argues that the primary challenge in this field is shifting focus from pure optimization to designing robust programming models that allow developers to reliably express complex performance trade-offs in large-scale distributed systems.

East Meets West: How Asian Storytelling is Influencing a Global Audience | Asia Summit 2023

Curtis Chin, Randall Park, Guneet Monga, John Penotti, Adele Lim

Speakers at this fragmented panel discussion prioritized global market stability and the need for diverse representation, specifically advocating for more directors of color and indigenous storytelling in the film and television industries. Despite the incoherent nature of the source material, the dialogue identified critical production challenges including high costs, financing difficulties, and the necessity for deeper investment in development. The session concluded with a shared intent to foster authentic narratives and build community structures to support emerging creators before they enter the industry.

The Modi Raj 1: The chaiwallah's son

Modi, Avantika Chalkoti, Jitendra Chauhan, Nilanjan Mukhopadhyay, R. Balashankar, Shankar Singh Vaghela, Yashwant Sinha

This podcast series examines the trajectory of Narendra Modi from his impoverished upbringing in Gujarat and early induction into the Hindu nationalist RSS to his ascent as India's longest-serving Prime Minister. While Modi successfully orchestrated the nation's economic rise to fifth-largest global economy and cultivated a distinct personal brand, his tenure is simultaneously scrutinized for fueling Hindu supremacism and threatening democratic norms through divisive rhetoric. The narrative culminates in an analysis of how Modi's recent electoral defeat, which forced him into coalition governance, challenges his previous "strongman" style and sets the stage for investigating pivotal events like the 2002 Gujarat riots.

Matt Might: The Algorithm for Precision Medicine

Matt Might, Matt Mite

Matt Mite, director of the Hugh Call Precision Medicine Institute at UAB, leverages computational optimization and a knowledge graph of 30 million abstracts to derive actionable precision medicine strategies for patients with undiagnosed genetic disorders. His approach, exemplified by the successful treatment of his son Bertrand's NGLY1 deficiency and the identification of Prevacid for ion channel epilepsies, prioritizes logical mechanism proofs to overcome physician skepticism and legal liability. Through an undergraduate-led workflow and the "All of Us" initiative, Mite's institute continues to transform complex genomic data into targeted interventions, from drug repurposing to novel metabolic pathways, asserting that scientific experimentation always yields actionable solutions.

Derek Dreyer: RustBelt: Logical Foundations for the Future of Safe Systems Programming

Derek Dreyer, Ralf Jung, Jacques-Henri Jourdan, Robbert Krebbers, Hoang-Hai Dang, Jan-Oliver Kaiser

The MPI for Software Systems' "Rust Belt" project applies decades of academic research to formally verify the safety guarantees of the Rust programming language against the risks posed by "unsafe" code. By leveraging the Iris framework and mechanizing proofs in the Coq assistant, the team establishes a semantic safety model that independently verifies complex libraries like `Arc` and `Mutex`, successfully identifying critical bugs in memory ordering and reference counting. This methodology ensures that future language evolution and standard library modifications can proceed with mathematical certainty that undefined behavior remains impossible.

Safe at Any Speed: Building a Performant, Safe, Maintainable Packet Processor

Sebastian Funk, JOSE ARRIETA

Jane Street engineers optimized their OCaml-based market data distribution system to handle NASDAQ's peak load of 4 million messages per second while maintaining zero-allocation on critical paths to avoid garbage collection delays. By leveraging PPX preprocessors, immediate integer options, and a domain-specific language for protocol generation, the team reduced per-message processing latency from five microseconds to under 750 nanoseconds. This approach demonstrates that strict single-core, low-latency performance targets can be achieved with high-level functional languages through aggressive inlining and careful memory management rather than resorting to lower-level systems code.

MIT 6.S093: Introduction to Human-Centered Artificial Intelligence (AI)

The presentation argues that learning-based artificial intelligence will supersede optimization models but requires "machine teaching" and continuous human supervision to ensure safety, fairness, and explainability. Key strategies include active learning algorithms that minimize data requirements, reward engineering to align systems with societal values, and uncertainty signaling through ensemble disagreements to trigger human intervention in high-stakes domains. These human-AI collaborations aim to overcome persistent perception challenges in face and emotion recognition while scaling autonomous technologies to societal levels where safety and symbiosis are paramount.

Partnerships in Global Health

Thomas Bollyky, Deborah Birx, Kathy Calvin, Bruce Gellin, Susan Sweeney

The provided text fails to describe a coherent event, as the source material is a corrupted and semantically incoherent machine generation containing contradictory health statistics and nonsensical procedural claims. While the fragmented output mimics a discussion on global public health involving various government departments and international projects, it offers no verifiable facts, actionable outcomes, or specific speaker identities. Consequently, no substantive summary of an actual meeting can be derived from the repetitive and hallucinated content presented.