Why It Matters
I tested it on 4 public benchmarks and it outperformed every other solution significantly at grading harmful prompts/generations, while being by far the cheapest option.
Overview
I've been using Jev since I got access yesterday. Lots of cool use cases on X and their official discord as well. My first attempt was to see if Jev could be a good monitor for alignment.
Why It Matters
I tested it on 4 public benchmarks and it outperformed every other solution significantly at grading harmful prompts/generations, while being by far the cheapest option.
Key Details
I tested it on 4 public benchmarks and it outperformed every other solution significantly at grading harmful prompts/generations, while being by far the cheapest option.
Not frontier level intelligence-wise, but amazing cost/performance ratio.
submitted by /u/manubfr [link] [comments]
--- *Original report published by [Reddit Singularity (Frontier AI & Social Leaks)](https://www.reddit.com/r/singularity/comments/1wiq7vn/jev_from_typesafeai_is_getting_hyped_quite_a_bit/).*
