IMSA Independent Study: Applying System Safety Engineering and Risk Management to LLM-based applications

Thu, 22 May 2025 10:04:46 -0700

Safety Engineering has a history going back to the 19th century. In the past 15 years, as ML research has accelerated, those responsible for ensuring safety have become detached from this history. Over the course of this project the students learned about the history of Safety Engineering and then explored how to apply it to software systems, in particular AI-based software systems, through a hazard analysis technique called System Theoretic Process Analysis (STPA).

System Safety Engineering on Butterswords | Where Words >= Swords

IMSA Independent Study: Applying System Safety Engineering and Risk Management to LLM-based applications