Skip to content
Math-for-AI-SafetyPublic

About

Open problems, research agendas, and papers in Math for AI Safety — public from draft stage onward

Topics

Resources

Contributing

Stars

68 stars

Watchers

3 watching

Forks

Repository files navigation

Math for AI Safety

Research Collaboration Hub

Mathematics has a part to play in making advanced AI safe, and much of that work is still waiting for mathematicians to take it up. MAIS is where that work happens in public: precisely stated open math problems, each paired with a theory of change for how a solution could advance AI safety; research agendas that incorporate multiple open problems and their surrounding context; and papers that grow out of solutions to the problems.

This repo hosts pre-publication math research of three kinds:

  • Open Problems — a short exposition of a single open problem
  • Agendas — a cluster of related open problems and partial progress on resolving them
  • Papers — papers in progress

The intended life cycle is open problem → agenda → paper → publication: open problems get incorporated into agendas, and a maturing agenda spins off papers. Cited external work is summarized in references/, one page per paper, suitable for stuffing an LLM's context.

Each document carries a unique permanent identifier — MAIS-On for open problems, MAIS-An for agendas, MAIS-Pn for papers — so a reference like MAIS-O1 or MAIS-A4 stays valid even if the title changes.

The open-problem index is the full registry, and the agenda guide offers a first foothold in each research direction. Conventions for numbering, structure, and building live in HOUSEKEEPING.md.

Contributing

Contributions of every size are welcome; see CONTRIBUTING.md.

The best first move is to open an issue — a public thread that anyone can answer. A substantial contribution earns an invitation to join the author list, subject to the judgment of the document's current authors.

People

MAIS grew out of Lionel Levine's survey paper Math for AI Safety: An Invitation for Mathematicians. The repository is maintained by Lionel together with

Maintainers review contributions, verify claimed results, and merge pull requests; see CONTRIBUTING.md for how to work with them.

Citing

Cite documents by their permanent identifier, as their authors' own work. Templates in CITATION.md.

License

All text and sources are released under CC BY 4.0.

Getting started in AI safety

About

Open problems, research agendas, and papers in Math for AI Safety — public from draft stage onward

Topics

Resources

Contributing

Stars

68 stars

Watchers

3 watching

Forks

Releases

Packages

Contributors

Languages