Auto-group Failures
Identify recurring patterns and monitor failure reasons. Trunk automatically detects and groups related failures, helping you track trends over time for faster issue resolution.
BETA
Engineers Hate Flaky Tests. We can help.
Engineers Hate Flaky Tests. We can help.
Trunk detects, quarantines, and eliminates flaky tests from your code base. Works with any language, any test runner, and any CI provider.
How are flaky tests impacting your organization?
Engineering hours lost per month
56
CI hours wasted per month
48
Auto-quarantine Flaky Tests
Quarantine known flaky tests automatically to prevent them from blocking pull requests while still tracking their results. Flaky tests continue running and reporting, but won’t cause CI jobs to fail, ensuring smoother workflows and minimizing unnecessary reruns.
Integrated Ticketing
Integrate seamlessly with your existing ticketing systems to ensure flaky tests are owned and resolved without being forgotten.
"I primarily focused on the flaky tests tab and found all the information I sought. The app provided an excellent summary of our E2E pain points."
Flaky Test Analytics
AI-powered insights automatically group similar failures and track your tests' stability over time. Spot trends and patterns without sifting through endless logs.
Build with Webhooks
Tailor webhooks to flaky test events that matter most to your team. Configure endpoints to receive real-time updates for quarantines, failures, resolutions, and more.
Prioritize the worst offenders
Rank your flaky tests according to their impact on your engineering organization. Pinpoint the repositories, teams, and services hurt most by flaky tests.
Historical Test Status
Track each test’s journey from healthy to flaky to broken, capturing transitions over time. This view helps correlate the onset of flakiness with changes in your codebase or environment.
Alerting
Get real-time notifications via Slack or email whenever tests become flaky or are resolved. Stay ahead of issues and keep your workflows smooth with instant alerts.
See Test Results in PR Comments
Stay ahead of flaky test issues by tracking failures and quarantined tests where it matters most.
Test Status History
See the full status history of each test, including its behavior over time, the flake rate, and unique ways it fails. Gain insights into rerun trends, helping your team focus on stabilizing critical tests.
PR Impact Assessment
Identify which pull requests have been affected by a flaky test, uncover patterns in repeated failures, and prioritize fixes to help your team resolve critical issues faster.
"Trunk's Flaky Test solution is so far the best one we've worked with, and we look forward to continuing to work with it."
See Test Run Details
Quickly diagnose test failures with detailed insights. View specific failure reasons, job durations, and commit history in one place. Identify patterns across multiple runs and drill into stack trays for precise debugging.
Seamless Integration
Trunk integrates with all the technologies you’ll ever need.
FAQs
What are flaky tests?
Flaky tests are tests that fail and pass inconsistently, even when the code hasn't changed. They mess with the reliability of your test suite and can waste valuable development time.
Why do flaky tests happen?
Flaky tests usually come from things like race conditions, unstable dependencies, or shared test data. They’re caused by issues that are hard to reproduce and fix, like improper test setups or asynchronous operations.
How does Trunk help with flaky tests?
Trunk Flaky Tests finds, quarantines, and removes flaky tests from your code. It helps you identify patterns, figure out why your tests are flaky, and fix them before they slow down your team.
How do flaky tests affect productivity?
Flaky tests make developers waste time rerunning tests, digging through logs, and chasing problems that might not exist. Over time, they slow down your CI pipeline and make it harder to release code.
What kinds of tests can be flaky?
Any test can be flaky, including unit tests, integration tests, end-to-end tests, or UI tests. They are especially common in systems that involve significant concurrency or external dependencies.
What is failure fingerprinting?
Trunk uses AI to recognize the different ways a single test fails. It groups these failures so you can see patterns and fix the root cause, with full context of what’s happening.
How do I prevent flaky tests?
To avoid flaky tests, you need stable test data, proper handling of asynchronous events, and isolated test environments. Trunk helps by automatically catching flaky tests and letting you quarantine them without blocking progress.
Which CI providers does Trunk work with?
Trunk works with all major CI providers, including GitHub Actions, Jenkins, CircleCI, and Bitbucket Pipelines. It integrates easily with your existing tools and workflows.
How do I track and fix flaky tests in Trunk?
You’ll get real-time alerts when a test becomes flaky. You can also track the history of flaky tests and get detailed insights into their causes, then use tools like Jira to make sure they're fixed.
How does auto-quarantining work?
Trunk automatically quarantines flaky tests during your CI runs. This means the flaky tests won't break your pipeline, but they’re still tracked and monitored.
How long does it take to set up Trunk Flaky Tests?
Setting up Trunk Flaky Tests takes just a few minutes. Follow the setup guide here and you’ll be up and running quickly.
What metrics does Trunk track?
Trunk tracks metrics like flaky test rates, CI time per pull request, and time wasted due to flakiness. These numbers help you measure the real impact of flaky tests on your team’s productivity.
Who uses Trunk?
Trunk is trusted by companies like Zillow, Metabase, Vidyard, and Waabi to keep their tests stable and their CI pipelines running smoothly.