Ai Engineer • Senior

Who you are

You have a strong background in AI evaluation and reliability, with experience in designing and executing quality assurance processes for AI features. Your expertise includes developing pipelines, datasets, and dashboards that measure and improve AI performance in real-world security operations center (SOC) workflows. You understand the importance of ensuring that AI features operate at full production scale, handling millions of alerts daily while enhancing analyst productivity and risk mitigation.

You possess a solid understanding of explainability and compliance requirements for autonomous workflows, ensuring that AI behavior is traceable and auditable. Your background in security operations, incident response, or enterprise automation allows you to interpret logs, alerts, and playbooks effectively. You thrive in startup environments, delivering high-impact systems in fast-paced and evolving contexts.

What you'll do

In this role, you will lead the design and execution of evaluation processes for agentic AI features, ensuring that every release is safe, reliable, and production-ready. You will collaborate closely with the Product team to deliver operational excellence and build trust in AI functionalities. Your responsibilities will include developing and maintaining the necessary pipelines and datasets to evaluate AI performance, as well as creating dashboards that provide insights into agent effectiveness.

You will be responsible for ensuring that the AI features meet quality standards and compliance requirements, conducting thorough evaluations before releases. Your work will directly impact the efficiency of security operations, as you will ensure that the AI systems can handle high volumes of alerts and provide actionable insights to analysts. You will also engage in continuous improvement efforts, refining evaluation processes based on feedback and performance metrics.

What we offer

Anomali offers a dynamic work environment where innovation is encouraged, and your contributions will have a significant impact on the security operations landscape. You will have the opportunity to work with cutting-edge AI technologies and collaborate with a talented team dedicated to enhancing security operations through automation and intelligence. We value your expertise and are committed to supporting your professional growth within the company.