Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.selftune.dev/llms.txt

Use this file to discover all available pages before exploring further.

​
Overview

Alert rules notify you when skills experience regressions, performance drops, or data gaps. Configure multiple alert types and delivery channels to stay informed about skill health in real time.

​
Alert Types

selftune supports four alert types, each with distinct thresholds:
TypeTriggerThresholdUse Case
Pass rate drops belowSkill pass rate falls below a percentage0–100%Catch quality regressions
Regression detectedNew evolution performs worse than baseline(no threshold)Monitor post-deploy safety
No data receivedSkill hasn’t run in N daysDays (1–90)Detect stalled deployments
Evolution failedAutonomous evolution attempt failed(no threshold)Track evolution issues

​
Notification Channels

Configure alerts to deliver via your preferred channel:

​
Email

Send alerts to email address. Useful for low-frequency, critical alerts. 
Channel: Email
Configuration: [email protected]

​
Slack

Post alerts to a Slack channel via webhook. Requires a Slack workspace and webhook URL from your Slack app settings. 
Channel: Slack
Configuration: https://hooks.slack.com/services/YOUR/WEBHOOK/URL
See Slack incoming webhooks to generate a webhook URL.

​
Discord

Post alerts to a Discord channel. Similar to Slack, requires a webhook URL. 
Channel: Discord
Configuration: https://discord.com/api/webhooks/YOUR/WEBHOOK/URL
See Discord webhooks for setup.

​
Webhook

Send POST requests to a custom endpoint. selftune POST’s the alert payload to your URL. 
Channel: Webhook
Configuration: https://your-api.example.com/alerts
Payload format: 
{
  "type": "pass_rate_below",
  "skill": "my-skill",
  "threshold": 0.7,
  "current_pass_rate": 0.65,
  "triggered_at": "2026-04-08T14:23:00Z"
}

​
Creating Alerts

​
Dashboard UI

  1. Navigate to Settings → Alerts
  2. Click + Create Rule
  3. Select alert type and configure threshold (if applicable)
  4. Choose notification channel and enter configuration
  5. Click Save Rule
The rule activates immediately. Use the toggle to enable/disable without deleting.

​
API

Create alerts programmatically: 
curl -X POST https://api.selftune.dev/api/v1/alerts \
  -H "Authorization: Bearer YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "type": "pass_rate_below",
    "threshold": 0.7,
    "channel": "email",
    "config": {
      "email": "[email protected]"
    }
  }'
Response: 
{
  "alert": {
    "id": "alert_abc123",
    "type": "pass_rate_below",
    "threshold": 0.7,
    "channel": "email",
    "config": {
      "email": "[email protected]"
    },
    "enabled": true,
    "created_at": "2026-04-08T14:23:00Z"
  }
}

​
Managing Alerts

  • Enable/disable — toggle the rule on without deleting
  • Delete — remove the rule permanently
  • Edit — currently, delete and recreate with new settings

​
Best Practices

  • Critical alerts only — set high thresholds to avoid noise (e.g., pass_rate_below 60%, not 95%)
  • Multiple channels — create separate rules for different channels and severities
  • No data thresholds — set 7–14 days to allow for natural variation
  • Test webhooks — validate custom webhook URLs before deploying to production

​
API Reference

See Alerts API for complete endpoint documentation.