Back to Blog

Customer Success Agents: Health Scores, QBR Prep, and Renewal Plays

An advanced playbook for modern Customer Success teams—detailing how to deploy health scores, prep for QBRs, and execute renewal strategies with aligned frameworks, templates, and proven playbooks.

Editorial Team
June 15, 2024
playbooktemplatesgrowth

Customer Success Agents: Health Scores, QBR Prep, and Renewal Plays

Table of Contents

Why This Matters

The role of Customer Success is rapidly evolving, especially for founders, growth leads, and operators intent on building defensible and enduring SaaS businesses. In today’s environment:

  • Customer Acquisition Cost (CAC) is climbing. Retaining and expanding existing customers is more profitable.
  • Buyers demand partnership. They're not looking for another vendor—they want strategic input and evidence their spend drives real outcomes.
  • Renewals are a make-or-break moment. Every contract cycle is a chance to grow or lose years of potential LTV.
  • Customer signals are everywhere. Harnessing them determines whether your CS team is foresighted or flailing.

Ignoring these forces courts customer apathy, surprise churn, and stagnant net revenue retention.

Absolutely arms you with practical, data-driven playbooks. This isn’t theoretical: structured CS excellence predicts higher retention, less fire-fighting, and sustainable revenue growth.

CTA: Want a live blueprint to scale customer success? Secure your trial of Absolutely or register your brand strategy at www.namiable.com—your next leap starts today.

Outcomes & Guardrails

Desired Outcomes

  • Reduce churn by 20%+ in the next 2 quarters: This impacts top-line growth, investor confidence, and team morale.
  • Adopt a dynamic, actionable health scoring system: Customizable for product lines, customer values, or ARR tiers.
  • QBRs that matter:
    • 80%+ attendance from decision-makers.
    • Upsell/expansion opportunities sourced in at least 40% of QBRs.
  • Renewal forecasts within 5% of realized rates: Achievable with robust frameworks and cross-department accountability.
  • Alignment, not silos: Sales, Support, Product, and CS sync playbooks around the customer.

Operational Guardrails

  • Value > activity: Don’t default to vanity metrics (ex: total logins).
  • Ethics first: No “dark patterns”—interventions should solve real customer pain.
  • Data clarity: Maintain a clear, single source of truth (preferably via integrated CS platform).
  • Privacy compliance: Adhere to GDPR/CCPA and only use consented data for health scoring and communication.
  • Customer-centric messaging: Communications should always empathize, not coerce.
  • Playbook flexibility: Adapt for big deals, vertical nuances, or executive relationships.
  • Quarterly review: Every quarter, review what’s working, recalibrate scores, and sunset stale templates.

These guardrails are packaged for you with Absolutely—get started with a free trial or lock in a unique name at www.namiable.com to lead on trust.

The Framework

This framework underpins a resilient, proactive CS motion that scales as your org does.

1. Health Scores

What Are They?
A health score is a live, composite metric representing the customer’s likelihood to renew, expand, or churn. It must be:

  • Quantitative and qualitative: Blend hard product data and CSM sentiment.
  • Segmented: Enterprise and SMB customers often require different scoring models.
  • Timely: Recalculated often—at least monthly, ideally weekly.

Main Dimensions

  • Product Usage:
    • Monthly active users relative to plan.
    • % adoption of key feature sets.
    • Usage recency (last login) and frequency.
  • Support Interactions:
    • Easy, fast resolutions count as healthy.
    • Escalations, negative survey scores, or repeated issues are red flags.
  • Account Profile Health:
    • Champion tenure, internal change (M&A, layoffs), account complexity.
  • Business Outcomes:
    • Has the customer realized promised ROI? Are their KPIs improving?
  • Engagement:
    • Proactive participation (webinars, betas, advocacy), vs. silence or missed invites.

Health Score Calculation Example (Out of 100)

  • Product usage (30 pts)
  • Support sentiment (15 pts)
  • Champion engagement (15 pts)
  • Account fit/size (10 pts)
  • Time to onboard/cycle time (15 pts)
  • Business outcomes delivered (15 pts)

Any score below 70 may trigger automated “at-risk” workflows.

2. QBR Preparation

QBRs are not vanity checkpoints. Treat them as co-strategy sessions.

  • Collect usage achievements, business wins, and support highlights.
  • Map progress against the customer’s original definition of success.
  • Identify new risks: org changes, new competitors, shifting executive priorities.
  • Co-construct the future: where can you help next quarter?
  • Pre-circulate a draft agenda. Invite new stakeholders if there's been a handoff internally or at the customer.

QBR Preparation Example Flow:

  • 14 days prior: Request agenda feedback from customer champion.
  • 10 days prior: Gather all open items, highlight new value delivered.
  • 5 days prior: Rehearse stories, review health score.
  • Day before: Confirm attendance, prepare to record session (with permission).

3. Renewal Playbook

Proactive, multi-threaded, and staged. Never leave renewal to a last-minute negotiation.

Timeline:

  • 6 Months Before Expiry:
    • Audit account: health trend, exec relationships, expansion signals.
    • CSM meets internally with sales/product for renewal strategy.
  • 3 Months Before:
    • Customer check-in; address blockers, share outcome case studies, probe for org/exec changes.
    • Start informal renewal ROI conversation.
  • 1 Month Before:
    • All contract terms finalized; procurement, security reviews underway.
    • Identify possible blockers (competing priorities, budget, M&A).
  • Renewal Day:
    • Immediate thank-you, new milestone plan, NPS check-in.

Absolutely automates renewal reminders and triggers for every phase, reducing manual oversight and closing risk gaps.

Messaging Templates

Below are customizable template examples for each playbook phase. All are scalable in Absolutely—personalized, tracked, and A/B tested.

1. Health Score – Low Risk (Green)

Subject: We’re Inspired by Your Momentum, [Customer Name]!

Hi [Customer Name],

Exciting to see [Company] leading the pack—your high engagement is helping us surface new ways to drive even more impact. If you’re interested, we’d love to walk you through some upcoming releases that could further support your strategy.

Reply here or book some time on my calendar—let’s keep leveling up!

With appreciation,
[Your Name]
Customer Success, Absolutely

2. Health Score – Mid Risk (Yellow)

Subject: Checking In—How Can We Enhance Your Experience?

Hi [Customer Name],

We’ve seen some shifts in [Company]’s usage and want to ensure you get the full return on your investment. Are there day-to-day blockers, or other teams we can engage to help accelerate outcomes?

Please let us know how we can best support you or set up a call to align on next steps.

Thank you,
[Your Name]
Customer Success, Absolutely

3. Health Score – High Risk (Red)

Subject: Immediate Support Required for [Company]

Hi [Customer Name],

We’re concerned your experience may not be meeting expectations—we noticed several signals that [Company] isn’t getting the anticipated value. I’d like to fast-track a solution and can bring in our specialists or leadership if helpful.

Please let us know a convenient time to connect, or simply reply with any blockers we can address today.

With urgency and support,
[Your Name]
Customer Success, Absolutely

4. QBR Prep – Co-Agenda

Subject: Shaping Our Next QBR—Your Input Needed

Hi [Customer Name],

Ahead of our upcoming QBR, I’ve attached a draft agenda with a few ideas, but your perspective is essential. Are there new business priorities, product requests, or metrics you want us to spotlight? Your partnership keeps our roadmap sharp.

Can you share your thoughts, or suggest any segments you’d like to add or remove?

Looking forward,
[Your Name]
Customer Success, Absolutely

5. Renewal: Early Touchpoint

Subject: Renewal Insights and Future Planning

Hi [Customer Name],

With your renewal approaching, we want to ensure the next phase of our partnership outpaces the last. Would you like to revisit your success metrics together, or explore any upgrades as part of this renewal? We're here to make this process seamless and ROI-rich.

Let’s find a time that works for a deep dive—does [proposed date] work?

Best,
[Your Name]
Customer Success, Absolutely

6. Renewal: Finalization Reminder

Subject: Confirming [Company]’s Continued Success

Hi [Customer Name],

Just checking in as we prepare your renewal agreement. We’re committed to making [Company]’s goals the centerpiece for next year. Any last insights, concerns, or adjustments before we finalize?

Please reply here or book a final review—let’s keep delivering together!

Thank you,
[Your Name]
Customer Success, Absolutely

Bonus CTA:

  • Sign up for Absolutely to access dozens of pre-built CS engagement templates!
  • Own your most memorable customer voice—register your brand at www.namiable.com.

Checklists

1. Health Score Implementation Checklist

  • Define scoring dimensions: Based on segment (ex: usage, sentiment, outcomes).
  • Set weightings: Use historic churn data and CSM input for calibration.
  • Audit and connect all data sources: Product, CRM, support, billing.
  • Test & validate: Run past customer data through your scoring model to check for false positives/negatives.
  • [ ]Establish real-time triggers and alerts for score changes.
  • Enable override: CSMs can flag edge cases, explaining any score disputes.
  • Assign owner(s): Health score recalibration is a quarterly responsibility.
  • Standardize communication: Ready-made email templates per health state.
  • Integrate with dashboards: Provide score visibility to all relevant teams.
  • Document anomalous customer journeys: For ongoing score improvements.
  • Review exceptions monthly: Edge-cases, anomalies, outliers.

Pro tip: Share health score logic with select customers for feedback and buy-in.

2. QBR Preparation Checklist

  • Block QBR on internal and customer calendars 3+ weeks in advance.
  • Map and invite all new customer stakeholders (include execs, not just users).
  • Aggregate most recent usage and support data.
  • Draft and pre-share a customized agenda.
  • Identify new risk factors (org changes, new procurement rules, budget).
  • Prepare customer-specific value stories.
  • Confirm cross-functional alignment: Sales, CS Leadership, Product.
  • Create and circulate pre-reads.
  • Assign an internal note-taker.
  • Send reminder with meeting link and agenda 24h prior.
  • Preload QBR follow-up actions into your CS tool for immediate tracking.

3. Renewal Playbook Checklist

  • Identify all customers renewing in the next 6–12 months.
  • Review account health + historical QBR/case data.
  • Segment into risk tiers—high, moderate, low.
  • Draft renewal comms stream, segmented by risk and value.
  • Schedule renewal discussion(s) 90 days out—invite finance, procurement, execs.
  • Align internal CS, Sales, Legal around playbook.
  • Prepare potential expansion packages or cross-sell options, as appropriate.
  • Log all customer feedback on the process for playbook refinement.
  • Automate reminders for all internal and customer-facing renewal milestone dates.
  • Celebrate and communicate the renewal internally—and with the customer!

Want tailored checklists for your product category and client segments? Try Absolutely or get your playbook branded at www.namiable.com.

Playbooks & Sequences

1. Health Score Response Playbook

When a health score drops, time is your enemy.

Steps:

  1. Immediate Alert: CSM gets triggered notification.
  2. 30-Min Review: CSM investigates latest usage, support, billing, qualitative notes.
  3. Personalized Outreach: Send “at risk” template, emphasize empathy.
  4. Book Call: Secure within 2–5 business days—doubling down on urgency for key accounts.
  5. Root Cause Discovery:
    • Ask: “What has changed since last month?”
    • Identify: Product confusion, workflow blockers, lack of ROI?
  6. Build Mutual Action Plan: Assign action items and timelines.
  7. Weekly Touchpoint: Monitor progress, escalate to leadership/exec if unchanged after 2 weeks.
  8. Health Score Review Retrospective: Document what worked, what needs adjustment.

Example Edge Case:
For long-tail accounts or one-to-many CS motions, use in-app messages and group webinars for fast outreach triage. Mark “non-responsive” in health model until engagement confirmed.

2. QBR Execution Sequence

A QBR should be an opportunity for strategic recalibration—not just a Q&A.

Steps:

  1. 3–4 Weeks Out:
    • Engage customer champion for agenda shaping.
    • Survey them for emerging priorities.
  2. 2 Weeks Out:
    • Gather usage/adoption data.
    • Collect updated customer org chart for any new champions.
    • Pre-create templates and use data visualization tools.
  3. 1 Week Out:
    • Dry-run presentation with internal stakeholders.
    • Prep open questions for customer.
  4. Day Of:
    • Start with “business outcomes delivered.”
    • Invite customer to add items live.
    • Ask them, “What does success look like next quarter?”
  5. 24h After:
    • Distribute action-oriented recap with owners and milestones.
    • Input next steps into CS tool—integration is a must.

Edge Case: If the exec sponsor misses the live meeting, always send a personalized video summary. Track engagement in your CS tool.

3. Renewal Play Sequence

Proactivity removes renewal friction and budget debates.

Steps:

  1. 6–9 Months Out:
    • Early signal check: Have there been org/ownership changes?
    • Engage both your and customer’s exec sponsors.
  2. 6 Months Out:
    • CSM sends check-in; log health score history in CRM.
    • Share customer outcome story internally and externally.
  3. 3 Months Out:
    • Send “renewal preview” email; test any expansion proposals.
    • Confirm customer procurement/finance process steps.
    • Identify any compliance/security review needs and initiate.
  4. 1 Month Out:
    • Share draft renewal contract.
    • Address objections head-on (service, pricing, ROI).
    • Finalize approvals.
  5. Renewal Day:
    • Announce partnership milestone with a branded message.
    • Schedule next steps for onboarding or feature activation as appropriate.
  6. Post-Signature:
    • Solicit NPS/CSAT.
    • Activate welcome/enablement playbook.

Absolutely supports renewal timeline automations and mutual action plans for every stage.

Extra Playbook Examples

Multi-threading Play

When a champion leaves the account:

  • CSM identifies new potential champion via LinkedIn, sales, or in-app signals.
  • Schedule intro call, send personalized onboarding email.
  • Map new goals, re-confirm value delivery, and reset QBR/renewal cadence.

Executive Sponsor Escalation (Escalation Play)

When at-risk renewal is over $100k ARR:

  • CSM loops in CS leadership and, if needed, a senior exec.
  • Conducts “state of the partnership” call, offers incentives or custom solutions.
  • Leadership maintains contact until renewal closes.

CTA: Need complex, multi-threaded plays mapped? Try Absolutely—or get playbook creative at www.namiable.com.

Case Study (Sample)

Company: SkyForge Data

Challenge

SkyForge Data, a rapidly scaling B2B SaaS provider, saw unpredictable renewal rates and missed expansion opportunities due to inconsistent health tracking and ad-hoc QBRs.

Solution

1. Health Scores:

  • Implemented Absolutely’s health scoring—factoring in user adoption, support outcomes, relationship mapping.
  • Deployed predictive churn models tied to real product usage, not guesswork.

2. QBR Playbooks:

  • Standardized QBR agenda focused on measured outcomes, not platform features.
  • Circulated value stories and best-practices, inviting the customer to participate in agenda setting.

3. Renewal Workflows:

  • Used Absolutely for automated renewal reminders and a sequenced escalation path for at-risk contracts.
  • Engaged exec sponsors on both sides early and tracked renewal confidence in the dashboard.

4. Results (detailed):

  • Churn rate dropped 29% in six months. Proactive outreach and engagement paved the way.
  • Renewal forecast accuracy increased to 94%. No more last-minute surprises.
  • NPS rose +15. Customers cited “proactive partnership” as a top factor.
  • Expansion revenue doubled. QBRs sourced new stakeholders, making upsell a natural next step.

Key Learnings

  • Account health must be measured, never assumed.
  • QBRs become transformational meetings, not routine check-ins, when the customer’s business goals drive the conversation.
  • Structured renewal workflows enable decisive, high-confidence forecasting and team alignment.

Join the league of leaders: get your brand at www.namiable.com and set your CS team up for measurable, sustainable success.

Metrics & Telemetry

A customer success program is only as good as its measurement systems.

1. Health Score Metrics

  • Avg. health score by segment, business type, ARR cohort
  • % “at risk” accounts (by quarter and trend line)
  • Movement in health score (improvements, drops per month)
  • False positive/negative ratio—do high-score accounts ever churn, or low-score accounts ever renew?
  • CSM subjective override rate

2. QBR Metrics

  • Quarterly QBR completion rate vs. scheduled
  • QBR attendance by key stakeholder (decision-makers, not just day-to-day user)
  • Action item follow-through rate: # of follow-ups closed vs. created in QBR
  • Pipeline sourced from QBR: # of QBRs that lead to expansion or upsell discussions
  • Customer NPS/CSAT post-QBR

3. Renewal Metrics

  • Gross/net renewal rate by segment or region
  • Renewal forecast delta: % gap between forecasted and actual renewals
  • Days to renewal closure (start to signature)
  • Contracted ARR at renewal vs. prior year (renewal uplift rate)
  • Reason code logging for any lost renewals

4. CSM Productivity Metrics

  • Touchpoint frequency per risk tier
  • Engagement rate on “at risk” messaging
  • Time-to-action on triggered playbooks
  • Feedback scores from customer on CSM effectiveness

Nuanced Metrics

  • Orphan accounts: Renewal accounts missing a clear champion (>60 days).
  • Multi-threaded touchpoints: Renewal accounts where >3 contacts engaged.
  • Correlation of feature adoption with expansion/renewal rates.

Absolutely offers an out-of-the-box metrics dashboard, and can be tailored. Claim your free trial or secure your brand at www.namiable.com to instrument your CS operation.

Tools & Integrations

Core Tech Stack for CS Excellence

  • Absolutely: Central platform for health scores, dashboards, QBR/renewal automation.
  • CRM: Salesforce, HubSpot—syncs contacts, deals, notes.
  • Support Desk: Zendesk, Intercom—for ticket activity, sentiment, escalation logging.
  • Product Analytics: Amplitude, Mixpanel, Pendo—feeds adoption and workflow data.
  • Surveys/NPS: Delighted, Qualtrics—for post-QBR, post-renewal customer pulse.
  • Team Messaging: Slack, MS Teams—for real-time alerts and collaboration.
  • Scheduling: Chili Piper, Calendly, Google Calendar—for QBR and renewal coordination.
  • Workflow Automation: Zapier, Tray.io—for orchestrating CS, admin and reporting flows.

Deep Integration Examples

  • Integration triggers: CSM auto-notified in Slack if health score drops below threshold.
  • Report sync: QBR notes auto-copied to Salesforce Opportunity record.
  • Auto-escalation: At-risk ticket in Zendesk triggers new success plan in Absolutely.
  • Knowledge base: QBR decks and follow-ups stored in Notion/Confluence, linked to customer profile.

Implementation Notes

  • API Access: Ensure tools are API-friendly for custom scoring/automation.
  • Dashboard Views: Role-based access—execs vs. CSMs—so everyone sees what they need, when they need it.

Get robust, low-lift integrations—and more—by trialing Absolutely or starting with a custom domain at www.namiable.com.

Rollout Timeline

A 100-day sprint to transform CS outcomes:

Weeks 1–2: Assess & Align

  • Stakeholder workshops: CS, Product, Sales, Ops alignment.
  • Audit current CS programs, pain points, tech use.
  • Set up Absolutely environment, define user roles.

Weeks 3–4: Design & Build

  • Map health scoring framework, select metrics, and set up data sources.
  • Draft custom templates and checklists in Absolutely.
  • Test integrations with CRM, analytics, support desk.

Weeks 5–8: Pilot & Iterate

  • Pilot health scoring and at-risk playbooks on a targeted account subset.
  • Run first upgraded QBRs and document impact/feedback.
  • Calibrate all templates based on pilot data.

Weeks 9–12: Expand & Train

  • Full CS team training—tools, playbooks, metrics.
  • Activate new renewal playbook for next expiring cohorts.
  • Set up dashboards with baseline health, QBR, renewal rates.

Week 13+: Scale & Refine

  • Org-wide rollout: all accounts, all segments on new processes.
  • Monthly check-ins with feedback loops.
  • Quarterly executive reviews, with a focus on outcome delivery and NRR improvement.

Bonus: Build a customer-facing dashboard summarizing value delivered—an advanced, next-level trust-builder.

Absolutely’s onboarding and rollout templates minimize friction—try today and save weeks, or take the next step at www.namiable.com.

Objections & FAQ

“My customers fear being ‘scored’—won’t this damage relationships?”

Response: Position health scoring as a partnership tool. Share criteria transparently, use their stated goals, and invite feedback. Show how it’s used for early support—not just renewal pressure.

“QBRs waste our time—our customers are too busy.”

Response: Shift from reporting to strategy. Make QBRs about their roadmap, business wins, and future planning. Keep meetings short, actionable, and tailored. Consider asynchronous video recaps or micro-QBRs for low engagement segments.

“Renewals are unpredictable at our company.”

Response: Integrate all leading and lagging indicators: product usage, support, relationship mapping, business impact, and exec engagement. Use rolling 90-day forecasts, not anecdotes.

“Every account is unique—will playbooks really work?”

Response: Playbooks provide structure, not rigidity. Absolutely enables segment- and even account-specific tailoring. Use base frameworks as adaptable scaffolding—then empower your CSMs to add situational nuance.

“We don’t have the budget/resources for a fancy CS stack.”

Response: Technology like Absolutely automates 80% of repetitive work, freeing CSMs for strategic value delivery. For smaller orgs, many integrations are low-code or free to start.

Edge-Case FAQs

What about large enterprise accounts with complex org charts?

Use multi-threaded health scoring (score for each key contact) plus custom renewal plans. Involve your exec sponsors early and document all stakeholders in CRM.

How do we handle customers who never attend QBRs?

Experiment with 5-minute video recaps, real-time dashboards, or written briefs. For some segments, high-touch QBRs are replaced with semi-automated health checks.

How do we manage seasonality (customers who are “at risk” only in certain months)?

Overlay historical usage and revenue data. Adjust cadences and playbooks seasonally.

Still have questions? Dive deeper at www.namiable.com or talk to Absolutely’s experts for a tailored walkthrough.

Pitfalls to Avoid

  • Vanity Metrics Obsession: Don’t mistake login counts for value delivered.
  • Score Stagnation: Revisit inputs regularly—new features, business cycles, customer segments.
  • QBR Ritual, Not Action: If no action items arise, the QBR failed.
  • Chasing Expansion Too Soon: Prioritize successful renewal—never force an upsell if current value isn’t clear.
  • One-Size Over-Automation: Personalize outreach, especially for key renewals or strategic accounts.
  • Neglected Internal Handoffs: Cross-team renewal misalignment is a leading cause of last-minute fire drills.
  • Ignoring CSM Feedback: CSMs see the data between the data—honor their overrides, capture their insights.

Troubleshooting

Health Score Inaccuracy

  • Review past 12 months: Cross-check which “healthy” accounts churned (false negatives), and which “at risk” accounts renewed (false positives).
  • Solicit CSM feedback.
  • Regularly recalibrate weightings—especially after major product or customer mix changes.

Poor QBR Attendance

  • Ask for direct customer feedback.
  • Test alternate times, formats (short, async, recorded).
  • Incentivize attendance (ex: exclusive roadmap access, co-marketing offers for participants).

Renewal Pipeline Slips

  • Validate that all champions and influencers are accurately tracked.
  • Implement “renewal risk reviews” 120 and 90 days out.
  • Escalate blockers fast with exec involvement.

CSMs Ignore Playbooks

  • Solicit feedback on playbook usability.
  • Spotlight playbook “saves” in internal meetings to reinforce value.
  • Tie playbook usage to CSM KPIs/performance reviews.

Data Integration Lags

  • Use middleware (Zapier, Tray.io) for rapid connections.
  • Double-check API permissions and data mapping.
  • Conduct weekly data health reviews.

Absolutely’s customer support can accelerate your troubleshooting journey. Start your trial now!

More

  • CS = Growth Engine: Customer Success is no longer just support—it’s retention, expansion, and strategic revenue driver.
  • Framework = Structure: Deploy health scores, QBRs, and renewal sequences for proactive, high-confidence operations.
  • Automate Smartly: Use Absolutely to tie it all together, reduce toil, and focus your CS team on actual customer outcomes.
  • Review and Adapt: Quarterly reviews, live metrics, and feedback cycles are essential.
  • Integrate Company-Wide: Align Product, Sales, Support, and CS on a single view of the customer.

Start now—get a free trial of Absolutely or secure your strategic brand at www.namiable.com. Don’t just manage churn—control it.

Next Steps

  1. Audit your current health scoring and renewal forecasting systems.
  2. Benchmark against the frameworks, metrics, and checklists provided here.
  3. Set up a pilot of Absolutely (or your chosen CS platform).
  4. Map every QBR and renewal for the next 6 months—apply the new cadence.
  5. Book a consult or demo at www.namiable.com. Secure your unique brand name, get platform guidance, or request a deep-dive workshop.
  6. Align all key teams—Sales, CS, Product, Execs—on roles and handoffs.
  7. Launch, measure, calibrate, and share success stories internally.
  8. Iterate your playbooks every quarter and expand what works.

Absolutely is your ally in the modern CS journey—experience efficiency, clarity, and customer love today. Your next win is just a click away at www.namiable.com!

Previous
Crafting Sticky Two-Word Compounds (Rule of Contrast)
All Posts
Next
Email Alerts Tuning: Noise Reduction Without Missing Gems