newsfilter.io
Interview

3Blue1Brown Talks Machine Learning with Jane Street

  • Cultural Norms and Communication

    • The company prioritizes "changing your mind" over defending ego; conversations are framed as collaborative truth-seeking rather than debate.
    • Employees frequently adopt "Bayesian habits," explicitly updating beliefs based on new information during discussions.
    • A specific lexicon exists, including phrases like "not unreasonable," which signals openness to new ideas rather than dismissal.
    • Cross-group communication is highly organic; employees often approach colleagues in different departments directly without formal managerial approval to "spitball" ideas.
    • While the environment is described as "chaotic" by outside standards, formal hierarchy and team leads emerge only for large, month-long projects.
  • Operational Structure and Compute Allocation

    • Compute clusters operate on a real-time auction system where any employee can bid for resources, contrasting with the bureaucratic allocation processes of other firms.
    • This auction model fosters a sense of collective responsibility; employees voluntarily monitor and pause erroneous jobs running on the cluster.
    • The system is globally read-write, allowing any user to "nuke" (terminate) another user's job, a feature that enabled rapid resolution of issues without reporting up the chain.
    • A past incident involved a researcher accidentally running a command without arguments in Jupyter, which altered the bid bits for every job running on the "Hive" cluster, necessitating a system fix.
  • Business Definition and Market Role

    • Jane Street describes itself as a "generalist financial services liquidity provider," acting effectively as a "grocery store for stocks."
    • The firm creates liquidity for instruments like ETFs to allow investors to access foreign markets (e.g., Chinese stocks via US-based ETFs) efficiently.
    • Pricing logic is comparable to retail: setting fair prices based on supply and demand anticipation rather than arbitrary markups.
    • The firm views its core function as a prediction problem, utilizing machine learning to anticipate inventory needs (supply/demand) to maintain liquidity.
  • Misconceptions About the Work

    • Outsiders often underestimate the novelty of Jane Street's machine learning, assuming the firm primarily uses off-the-shelf models on purchased GPUs.
    • In reality, the firm engages in "basic science" and works on the frontier of research, tackling problems too complex for standard models in financial domains.
    • The term "Trader" is often a historical misnomer; these roles are largely research-focused and heavily systematic, involving minimal manual order entry.
    • The organization is significantly more tech- and academia-oriented than traditional trading firms or banks, challenging the assumptions of industry transferees.
  • Evolution of Technical Work (20-Year Span)

    • Twenty years ago, trading systems relied on linear models, Excel spreadsheets, and heuristic logic based on relative pricing of two securities.
    • Current modeling is dominated by machine learning, specifically neural networks, Gradient Boosted Trees (GBTs), and advanced statistics.
    • Technical methodologies have shifted significantly every five years, yet the underlying culture of curiosity and problem-solving has remained stable.
    • The firm has invested heavily in machine learning as the single largest driver of its systematic trading capabilities.
  • Talent Acquisition and Retention

    • The hiring strategy prioritizes generalists who are "smart, hardworking, reasonable, and adaptable" over candidates with specific technical training.
    • Interviews focus on math puzzles and problem-solving scenarios designed to test learning potential rather than specific domain knowledge.
    • Employees report high retention because colleagues act as genuine friends who are deeply invested in each other's professional success.
    • The culture of "high agency" and low friction allows employees to re-evaluate their career fit daily, resulting in a self-selecting population of long-term employees.
    • Flexible career paths are supported, including instances of employees taking leave to complete PhDs and returning to the firm.
  • Historical Context and Founder Trajectories

    • One long-tenured employee joined in 2005 after seeing a job posting on the "Camel mailing list" for the obscure functional programming language OCaml.
    • That same employee initially planned to start a PhD but chose the job after meeting the people and finding the work engaging.
    • Other hires come from diverse academic backgrounds, with some initially expecting a focus on "galaxy brain" models only to find practical applications for abstract mathematical theories (e.g., Huber's M estimators).
    • The interview process has evolved from single phone screens to complex on-site interactions, yet the core goal of identifying adaptable learners remains unchanged.
    • Internal social and intellectual life includes ad-hoc talks on physics and mathematics, such as system mechanics and Feynman diagrams, often leading to deep theoretical discussions.