Skip to content

Tag: schema

Schema-valid isn’t enough. A second LLM validation layer in RubyA green checkmark over a chatbot reply, with a second validation layer catching a hidden, out-of-policy promise

Schema-valid isn’t enough. A second LLM validation layer in Ruby

Published by Justyna on Tuesday, June 23, 2026

Demo: github.com/justi/ruby_llm-contract_demo April 2025: Cursor’s support chatbot, named Sam, told a customer that logging in from two devices broke company policy. No such policy existed. Reddit and Hacker News picked it up within an hour and people started cancelling subscriptions. A year earlier, a Canadian tribunal ordered Air Canada to…

>>>Schema-valid isn’t enough. A second LLM validation layer in Ruby