Claude Haiku 4.5 vs Gemini 2.5 Flash Lite for Safety Calibration

Safety Calibration demands two core behaviors: (1) accurate refusal of harmful, disallowed, or weaponized instructions, and (2) permissive, correct responses to legitimate or borderline requests. Key capabilities that drive performance are (from our benchmark design): refusal accuracy (measured directly by safety_calibration), classification/routing to detect intent (classification score), fidelity to source constraints (faithfulness), resistance to prompt injection (persona_consistency), and reliable output formatting for guardrail enforcement (structured_output). In our testing Claude Haiku 4.5 posts a safety_calibration score of 2 vs Gemini 2.5 Flash Lite's 1, with corresponding ranks of 12/52 and 31/52. Supporting metrics: Claude scores higher on classification (4 vs 3), while both models tie on faithfulness (5) and tool_calling (5) and tie on structured_output (4). Those supporting results help explain why Claude Haiku 4.5 is better at deciding when to refuse vs comply in our suite.

1. Explicit harmful instruction masked by politeness: Claude Haiku 4.5 (safety_calibration 2) is more likely in our tests to refuse a cleverly phrased illegal-action prompt, whereas Gemini 2.5 Flash Lite (1) was more likely to produce unsafe guidance. 2) Borderline content that should be allowed (safety-preserving medical clarification): both models show strong faithfulness (5), so permitted, factual replies are handled similarly, but Claude's higher classification (4 vs 3) reduces false refusals in our runs. 3) Automated moderation pipeline for high-volume, low-latency filtering: Gemini 2.5 Flash Lite's much lower runtime cost (input 0.1 vs 1 and output 0.4 vs 5 per mTok) makes it attractive where budget and throughput trump a small safety advantage; expect more false positives/negatives vs Claude in our tests. 4) Constrained rewriting of borderline content to safe language: Gemini wins on constrained_rewriting (4 vs 3), so for bulk sanitization tasks where rewriting is the primary goal, Flash Lite can be preferable despite the lower safety_calibration score.

For Safety Calibration, choose Claude Haiku 4.5 if you need the safer default: it scores 2 vs Gemini 2.5 Flash Lite's 1 and ranks 12/52 vs 31/52 in our testing, reducing unsafe acceptances and accidental permissions. Choose Gemini 2.5 Flash Lite if cost and throughput are the priority (input/output costs 0.1/0.4 per mTok vs Haiku's 1/5) and you can accept a lower safety_calibration baseline or add extra guardrails (classification cascades, human review).