Latest Interviews

Dwarkesh Goes Inside Jane Street's Latest AI Data Center

Dwarkesh, Ron Minsky, Daniel Pontecorvo, Mark Mirchandani

Jane Street transformed a Texas data center into a high-density liquid-cooled facility housing 4,032 GPUs to execute large language model training and custom trading architectures. The retrofit replaces legacy air-cooling with an 18°C fluid distribution system that manages 140 kW per cabinet while utilizing proprietary software to dynamically redistribute power and prevent breaker trips during peak loads. Engineering safeguards now focus on mitigating new liquid-cooling risks like biological growth and leaks, enabling sub-100-nanosecond latency required for modern algorithmic trading compared to the millisecond scales of its historical "Hive" cluster.

How OCaml Represents Values in Memory

Nalen

This presentation details OCaml's critical distinction between immediate and boxed types, explaining how tagged integers and heap-allocated blocks with specific headers enable efficient memory layout and garbage collection. It outlines the precise bit-level encoding strategies for primitives, variants, and special types like floats and strings, while noting the runtime's ability to dynamically inspect values and its constraints on non-immediate constructor counts. The discussion concludes by affirming the current system's performance benefits and previewing future optimization efforts toward integrating unboxed types.

How to Use OCaml's Coercion Operator

camels

This session explores standard OCaml's subtyping and coercion mechanisms, emphasizing how the `:>` operator enables compile-time type checks without runtime overhead or data reallocation. The discussion details value inclusion principles for polymorphic variants, recursive subtyping relations, and the specific constraints imposed by private type abbreviations to enforce invariants. While confirming that list coercions remain free at runtime, the presentation notes upcoming analysis of variant annotations and object types in future sessions.

Unfolding the Mystery of Curved-Crease Sculpture with Origami Theorists from MIT

Martin Demaine, Eric Demaine

MIT researchers Eric and Martin Demaine collaborate as origami theorists to synthesize mathematical geometry with physical sculpture, operating on the principle that fun fuels superior artistic execution. Their bidirectional workflow transforms unsolved mathematical problems into interactive artworks like the "Solve Me" sculpture, which embeds hidden research challenges within complex, visually deceptive paper designs. By creating these impossible geometries, the duo simultaneously generates new mathematical puzzles and drives future research trajectories at the frontier of known solutions.

OCaml's New Proposed "include functor" Syntax | OCaml Unboxed

Goldfirere

Jane Street is developing an "include functor" feature for the OCaml compiler that allows modules to directly include functor results based on their own preceding definitions. This innovation eliminates the need for cumbersome intermediate wrapper modules and manual reordering, streamlining the implementation of repetitive patterns like reverse array iteration. A working compiler version supporting this syntax is currently available for testing, with plans to upstream the feature to the mainstream OCaml distribution.

Programming with OCaml's Local Mode | OCaml Unboxed

Jane Street Doe Camel

A Jane Street team member demonstrates practical limitations of the OCaml "Locals" region-based memory management system while optimizing the `best_of_prime_widgets` function to avoid heap allocation. To resolve type mismatches where local lists must escape their regions, the implementation employs a custom zero-overhead `global` wrapper type alongside a recursive map function annotated with `exclave` constraints. Although the solution successfully maintains local allocation for list structures while treating elements as global, the speaker identifies these manual workarounds as sharp corners requiring future improvements through mode polymorphism.

Regions with OCaml's Local Types | OCaml Unboxed

Jane Street researchers introduce a `regional` variant within the OCaml compiler's `locals` feature that treats function parameters as variables permitted to escape their enclosing region exactly once. This mechanism enforces strict type constraints on return values while enabling critical stack allocation optimizations in recursive tail calls and loop iterations. By defining regions around function and loop bodies, the system prevents $O(N)$ space complexity for local data without compromising the language's type safety guarantees.

Exploring the Hidden Secrets within OCaml’s Local Function Types | OCaml Unboxed

Jane Street's OCaml compiler branch enforces strict region safety by automatically inferring hidden `local` annotations on partial applications of functions with local arguments, preventing closures from escaping their intended stack scope. This mechanism triggers compilation errors when such intermediate closures are passed to standard functions like `List.map`, as they attempt to store local data in global heap structures, though these issues can be resolved by fully applying the function or utilizing explicit type expansions. Consequently, the team is considering syntax modifications to function definitions to make these constraints more explicit and prevent accidental region escapes during currying.

Pitfalls with Tail Calls and Locals in OCaml | OCaml Unboxed

Goldfirere

Jane Street researchers developed a "local mode" for their OCaml compiler to optimize memory allocation on the stack, but discovered that standard tail call optimization causes "local value escapes" errors when recursive closures capture variables from a region that ends immediately before the call. To address this, the team introduced a "regional" sub-mode that permits specific values to escape one region boundary, allowing tail-recursive functions to maintain $O(1)$ stack space without explicit `non-tail` annotations, though passing these values through intermediate functions can strip this status and force $O(n)$ allocations. The developers acknowledge that current workarounds like explicit annotations or variable indirection are cumbersome for practical use, prompting a push for better compiler heuristics to automate safe tail calls in future upstream releases.

Stack Allocation with Locals in OCaml | OCaml Unboxed

I

Jane Street is developing an open-source "local mode" branch for the OCaml compiler that reallocates data onto a specialized local stack to eliminate mark-and-sweep garbage collection pauses. By enforcing strict regional scoping where values cannot escape their lifecycle, this architecture enables constant-time deallocation and prevents the cache invalidation and stop-the-world latency inherent in standard heap allocation. The initiative aims to significantly boost low-latency performance by removing the overhead of garbage collection while maintaining memory safety through a novel mechanism called "exclaves."

Understanding OCaml Locals as a Mode (with Sub-Moding) | OCaml Unboxed

I

This presentation introduces local and global modes in OCaml as a type system extension that governs memory lifetime and escape properties rather than value structure. The speaker details how these modes enforce safety by preventing local values from escaping their declaration scope while establishing a sub-mode relationship where global values can safely be treated as local. Additionally, the talk outlines four distinct, incompatible function arrow types that strictly regulate argument and result modes to prevent unintended memory escapes, with future work proposed to automate these annotations.

Annotating OCaml Variables and Returns with local_ | OCaml Unboxed

Jane Street is developing an experimental OCaml feature set that enforces strict region constraints through `local` annotations to optimize memory usage and eliminate escaping values. The system introduces the `exclave` keyword to terminate function regions early, enabling specific allocations in the caller's scope while preventing mutable references from capturing local data. Current implementation faces known pitfalls regarding return position rules and compiler error precision, with further refinements planned to address these sharp edges.

Introducing the OCaml Local Mode | OCaml Unboxed

camels

Jane Street is refining the OCaml compiler's type system to introduce a "local mode" feature that enforces function parameters to remain within their execution scope, thereby preventing value escaping. This mechanism guarantees the isolation of mutations and facilitates safer resource management in callback patterns by ensuring local arguments cannot be stored or returned. While the feature remains experimental within the Jane Street branch, it aims to optimize allocation behavior for latency-sensitive code before potential upstream integration.

Get to Know Us: Ezio Talks Linux Engineering at Jane Street

Ezio

Ezio, a Linux Engineer at Jane Street's London office since 2020, leverages deep theoretical knowledge to automate infrastructure and drive complex troubleshooting within a culture that values humility and consultative decision-making. As the founder of the firm's global Pride Community Group, he secured critical health insurance benefits for trans employees while fostering collaboration across offices in New York, London, Amsterdam, Singapore, and Hong Kong. His experience highlights the firm's emphasis on balancing technical rigor with inclusive social initiatives and advises new hires to prioritize absorbing organizational context before offering suggestions.

Real Numbers – Episode 16, Finale

Sawyer

The final episode of Season 1 of *Real Numbers* derives five distinct mathematical solutions to the geometric distribution problem of calculating the expected number of half-court shots Danielle needs to make. The episode further analyzes a bonus problem involving two consecutive successes, demonstrating via a recursive state method that the expected attempts equal 30 rather than the intuitive estimate of 25. Concluding the season, the host solicits listener feedback on problem topics, format changes, and potential mathematical depth for the upcoming second season.