View source for Resource:304d4c53-fcc8-4d35-86ee-e193e723fce9

{{Resource
|Resource Type=Cases
|Title=A case study on safety engineers using AI tools to speed up  software release approvals
|Has Related Initiative=Initiative:F4d945c9-461b-44f7-91ba-db70ca6332a1
|Is About=This case study examines how safety engineers use AI tools to accelerate safety analyses in the automotive industry. Companies developing autonomous and assisted driving systems must follow strict safety standards such as ISO 26262 and ISO 21448 (SOTIF). These analyses identify hazards, unsafe control actions, and potential risks using methods like System Theoretic Process Analysis (STPA). NIT is developing an AI-assisted tool that suggests control actions, identifies failure modes, and detects gaps in safety analyses, helping engineers complete safety assessments faster while maintaining compliance with safety standards.
|Important Because=This case is important because safety analyses determine whether vehicles with autonomous and assisted driving systems are safe for road users. As automotive companies release frequent software updates through CI/CD pipelines, there is increasing pressure to speed up approval processes. AI-assisted tools can reduce analysis time and support engineers in identifying hazards. However, they also raise concerns about overreliance on automation, potential complacency among safety engineers, and the risk of unsafe software releases if human oversight is reduced.
|Important For=Research Ethics Committee Member; Technology Developer / Engineer; Trainer
|Has Best Practice=Best practices include maintaining strong human oversight when using AI-assisted safety analysis tools. Safety engineers should critically evaluate AI-generated suggestions rather than relying on them automatically. Developing algorithmic literacy helps engineers understand AI limitations, scenario coverage, and potential failure modes. Parallel manual analyses can be used to validate AI-supported results and ensure reliability. Proper documentation of why AI recommendations are accepted, modified, or rejected is also essential. Continuous monitoring of AI tool performance ensures compliance with safety standards and preserves the integrity of safety assessments.
}}
{{Link
|Has Link=https://cea.hal.science/cea-05091448v1
}}
{{Related To}}
{{Tags
|Has Virtue And Value=Accountability; Reliability; Responsibility; Safety; Transparency; Trustworthiness
|Has Good Practice And Misconduct=Continuous monitoring of AI tool performance; Critical validation of AI-generated suggestions; Documentation of decisions regarding AI outputs; Human oversight in AI-assisted safety analysis; Parallel manual and AI-assisted safety checks
}}