Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Writing is often the hardest part of research, even after you’ve done all the background reading and figured out your main ...