https://zilishen.com/blog/ Recent content in Blog on Zili Shen Hugo en-us Thu, 07 May 2026 00:00:00 +0000 https://zilishen.com/blog/agentic-ai-evals/ Thu, 07 May 2026 00:00:00 +0000 https://zilishen.com/blog/agentic-ai-evals/ AI products can change under your feet. Here’s what I learned about measuring whether they do what you think they should. https://zilishen.com/blog/probellm-failure-diagnosis/ Tue, 28 Apr 2026 00:00:00 +0000 https://zilishen.com/blog/probellm-failure-diagnosis/ An eval score going down tells you something broke. It doesn’t tell you what. ProbeLLM is a new approach to automatic failure diagnosis that treats AI evaluation like an oral exam. https://zilishen.com/blog/llm-judge-validation/ Fri, 23 Jan 2026 00:00:00 +0000 https://zilishen.com/blog/llm-judge-validation/ We use AI systems to evaluate other AI systems. But validating those judges is harder than it looks — especially when the right answer isn’t as clear as it seems. https://zilishen.com/blog/cloud-computing-astro/ Thu, 26 Jan 2023 00:00:00 +0000 https://zilishen.com/blog/cloud-computing-astro/ You’ve used the cloud, but have you thought about using it for astronomy? A roundup from a panel at #AAS241. https://zilishen.com/blog/space-sustainability/ Thu, 24 Feb 2022 00:00:00 +0000 https://zilishen.com/blog/space-sustainability/ Our planet is already blanketed by space debris. As small commercial satellites rapidly multiply, will humans block ourselves from space? https://zilishen.com/blog/star-parties-to-observatories/ Fri, 12 Nov 2021 00:00:00 +0000 https://zilishen.com/blog/star-parties-to-observatories/ Reflecting on observatory trips and what I love about observing the night sky.