Log in
Features
Pricing
Docs
Log in

Changelog

Flaky Tests: test_case.quarantining_setting_changed webhook

Flaky Tests
June 11

We’re happy to announce that a new test_case.quarantining_setting_changed webhook is now available for all Flaky Tests users.

This webhook is fired when a test’s quarantine setting is manually changed between ALWAYS_QUARANTINE, NEVER_QUARANTINE, or UNSPECIFIED, where UNSPECIFIED means that the repo’s quarantine settings will be applied to the test case.

The webhook payload contains useful details like the new and previous settings, a user-inputted reason for the change, who made the change, and all the info you need for the affected test case:

1{
2 "quarantine_setting_changed": {
3   "actor": {
4     "email": "riley@trunk.io",
5     "full_name": "Riley Draward"
6   },
7   "previous_quarantining_setting": "UNSPECIFIED",
8   "reason": "Test is important, should not be quarantined!",
9   "timestamp": "2025-06-11T14:17:06.251Z",
10   "updated_quarantining_setting": "NEVER_QUARANTINE"
11 },
12 "test_case": {
13   "codeowners": [],
14   "failure_rate_last_7d": 0,
15   "html_url": "https://app.trunk.io/rileys-org/flaky-tests/test/cd7ef2fe-0ec1-5e40-a323-027029579f5b?repo=rdraward%2Fflaky-remix",
16   "id": "cd7ef2fe-0ec1-5e40-a323-027029579f5b",
17   "most_common_failures": [],
18   "name": "sums some nums > adds 1 + 1 to equal 2",
19   "pull_requests_impacted_last_7d": 0,
20   "quarantined": false,
21   "repository": {
22     "html_url": "https://github.com/rdraward/flaky-remix"
23   },
24   "status": {
25     "reason": "",
26     "timestamp": "2025-03-17T21:53:43.327Z",
27     "value": "flaky"
28   },
29   "test_suite": "app/utils/sum.test.ts",
30   "ticket": {
31     "html_url": "https://linear.app/riley-at-trunk/issue/RIL-10/[flaky-test]-apputilssumtestts-sums-some-nums-adds-1-1-to-equal-2"
32   },
33   "variant": ""
34 },
35 "type": "test_case.quarantining_setting_changed"
36}
37

This allows you to build automations and custom workflows when a test’s quarantine setting is changed, such as automatically creating Linear or Jira tickets to fix flaky or broken tests marked as ALWAYS_QUARANTINED, or sending a message to the team in Slack so everyone is kept up to date on status changes.

To subscribe to the new webhook:

  1. Go to Settings in the Trunk app.

  2. Click on Webhooks under Organization.

  3. Click Add Endpoint and connect to an existing endpoint, Slack, MS Teams, Linear, or Jira.

  4. Follow our guides for handling the webhook payload.


For more information on the webhook events, check out our Svix documentation.