Flaky Test Detector

Name: OpenModels
Creator: OpenModels
License: https://github.com/openmodelsrun/openmodels

MitteltestingMindestens 32K Kontext

Diagnoses and fixes flaky tests by analyzing test code and CI failure history for common sources of nondeterminism such as time and timezone dependence, order dependence, shared mutable state, race conditions, and unmocked network calls. Proposes targeted fixes and quarantine strategies to keep the suite trustworthy.

testing flaky-tests ci reliability debugging

Anwendungsfälle

Finding the root cause of an intermittently failing test
Removing order dependence and shared state between tests
Stabilizing time- and timezone-sensitive assertions
Deciding what to quarantine versus fix immediately

Beispiel-Prompt

This test passes locally but fails ~15% of the time in CI. Analyze it for sources of flakiness,
identify the most likely root cause, and rewrite it to be deterministic. Note any shared state
or ordering assumptions it relies on.

```
[paste test code and a couple of failure logs]
```

Empfohlene Modelle

claude-opus-4-8 gpt-5-6-sol deepseek-v4 gemini-3-5-pro

Kompatible Werkzeuge

claude-codecursorgithub-copilotkiroany

Modalitäten

Eingabe: code, text

→

Ausgabe: code, text