Software Engineer, Cybersecurity Benchmarks
Epoch AI is looking for a Software Engineer, Cybersecurity Benchmarks who will help us measure how capable frontier AI models are at cybersecurity, and keep those measurements safe to run. The role will involve building and owning cybersecurity benchmarks, securing our evaluation environments against AI escape, and using threat modelling to shape our evaluation strategy.
Epoch AI is a research institute that investigates trends in machine learning and the economic consequences of AI. Our mission is to develop a comprehensive, publicly accessible knowledge base on AI that informs policymakers, industry leaders, and society at large.
We strive to achieve both rigor and accessibility to our work, as exemplified by some of our most successful projects, including our [database of AI models](https://epochai.org/data) and our [AI trends dashboard](https://epochai.org/trends). Our body of research includes our work on [compute trends](https://epochai.org/blog/compute-trends) (IJCN 2022), [data scarcity](https://epochai.org/blog/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data) (ICML 2024), and [algorithmic progress](https://arxiv.org/abs/2403.05812) (NeurIPS 2024). You can read more about our work and mission on our [website](https://epoch.ai/about) and in [this Time profile](https://time.com/6985850/jaime-sevilla-epoch-ai/).
About The Role
We are looking for a Research Engineer to help us build trustworthy, public evaluations of AI cybersecurity capabilities as part of our AI Benchmarking Hub. You will work closely with the benchmarking team, researchers, analysts and other engineers to design benchmarks, run them on our infrastructure, and make sure the results are accurate and feed into our research.
Your day-to-day activities will include building and maintaining cybersecurity benchmarks (primarily in the Inspect library)...
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis.