Safety and alignment for scientific AI

Resci is an open-source organization focused on safety and alignment. Our mission is to understand how AI systems conduct computational research and develop methods for making their behavior reliable, inspectable, and open to correction. Our research concerns the models, agents, and learning algorithms that participate in scientific work and the objectives they pursue as they gain greater responsibility.

Over the next five to ten years, we aim to study systems that can formulate research questions, write and execute experiments, interpret results, and evaluate one another’s findings. Their decisions may also influence which questions receive attention, which findings gain acceptance, and what subsequent research builds upon. We want to understand how their capabilities develop alongside their failure modes and what forms of evaluation and oversight remain effective as scientific workflows become more autonomous.

The longer-term goal is to give researchers and institutions evidence for deciding which scientific responsibilities to delegate to AI systems, under what conditions, and how to intervene when their behavior departs from the intended task.