Interview, Fireside Chat, Conference Presentation, Keynote
Building a Functional Email Server with Dominick LoBraico
- Jane Street anticipates ongoing challenges in securing the email system while maintaining openness, a difficulty expected to persist as long as the foundational architecture remains unchanged.
- The MailCore migration, initiated five to six years ago, is projected to continue for the foreseeable future with a long tail of improvements, changes, and extensions.
- The organization plans to maintain a shadow instance strategy, running the new MailCore system in parallel with the legacy infrastructure to compare behaviors and build operational confidence.
- Current engineering efforts focus on developing tooling to migrate non-email content to other systems and improve inbox management efficiency for users.
- New features are being implemented to display sender audience size and communication costs at the time of email composition to increase awareness.
- The team intends to continue developing and sharing OCaml-based filters to facilitate collaboration and code review, despite the risk of accidental rule confusion by new engineers.
- Jane Street predicts a long-term future for email due to its flexibility and openness, viewing it as difficult to replace despite security failures in other internet-facing software built with unsafe languages.
- The shift to code-based configuration is expected to eliminate a class of memory safety bugs previously encountered with C-based open-source mail servers.
- Security is expected to be bolstered by both the safety of the new programming language and the "security by obscurity" resulting from a smaller user base for the specific implementation.
- Future improvements aim to overcome the limitations of the legacy configuration language, which previously required specialized knowledge and deterred generalist engineers from making necessary changes.