Bezpieczeństwo i społeczność · basic
Moderacja treści
Klasyfikuj treść według zdefiniowanych kategorii bezpieczeństwa i znajdź przypadki do sprawdzenia.
choicenoul
Kiedy używać
- Community routing
- Comment triage
- Human-review queues
Przykładowy state
{
"reply": "This number is wrong — the release notes say 1.8%, not 18%. Here is the source.",
"context": "Reply to a technical product post"
}Pytania decyzyjne
choicereply_type
Classify the primary role of this reply.
question— Genuine request for informationcorrection— Relevant factual correctionjoke— Humor or playful sarcasmpromotion— Unsolicited promotion or spamhostility— An attack meant to provokeother— None of the above
noulhuman_review
Should a human moderator review this reply under the community's moderation workflow?
Oczekiwane wyjście
A semantic reply category plus an independent probability that human review is warranted.
TypeScript
import { choice, noul, TypeSafeClient } from "@typesafe-ai/sdk";
const client = new TypeSafeClient();
const result = await client.systemOne({
state: {
reply:
"This number is wrong — the release notes say 1.8%, not 18%. Here is the source.",
context: "Reply to a technical product post",
},
questions: {
reply_type: choice("Classify the primary role of this reply.", {
question: "Genuine request for information",
correction: "Relevant factual correction",
joke: "Humor or playful sarcasm",
promotion: "Unsolicited promotion or spam",
hostility: "An attack meant to provoke",
other: "None of the above",
}),
human_review: noul(
"Should a human moderator review this reply under the community's moderation workflow?"
),
},
});Dlaczego to działa
- Classification and review escalation are separate decisions.
- The category set distinguishes factual correction from hostility.
Ograniczenia
- Your actual moderation policy must define what gets removed, warned, or escalated.
- This demo is not a universal safety policy or legal compliance system.
Oficjalne źródło
2026-09-21
Następny krok: Jev Playground、Wzorce。