Interesting approach! I've been working on something complementary — local-first LLM observability called opensmith. Different angle but same philosophy of keeping everything local.