Smells Scoring decides how much each Translation Smell lowers a segment's confidence score, which severity each kind of smell gets, and whether pre-translated segments are confirmed automatically when their score is good enough. This article explains how the score is calculated, how to set each part at the account, Organizational Unit and project level, and how to avoid the settings that most often produce unexpected results.
Who can do this:
Account: Account Admin.
Organizational Unit: users with the Organizational Unit Retrieve permission can view the settings; changing them requires Organizational Unit Update.
Project: Account Admins and Project Managers with the Project Update permission. Clients don't see the Smells Scoring tab.
Linguists don't change these settings. They see the result: the confidence score of each segment in the Editor, and a tooltip on each smell's severity that says what it costs.
How the confidence score works
Every smell has a severity. Each severity has a weight: the confidence a segment keeps when that smell is the worst one still open on it.
Severity | Meaning | Default weight |
Blocker | Unusable as delivered. | 0% |
Critical | Changes the meaning or breaks the content. | 30% |
Major | A clear error a reviewer would correct. | 50% |
Minor | A small error that keeps the meaning. | 80% |
Info | A note. Does not lower the score. | 100% |
A segment's confidence is the weight of its worst open smell, and 100% when there is none. Smells are not added up: a segment with one Major and three Minor smells scores 50%, the same as a segment with only the Major. Smells a linguist ignores no longer count, so ignoring the worst smell raises the score to the weight of the next one. The same calculation is used everywhere the score appears: the QA batch, the Editor's QA panel, and the new score after a smell is ignored.
Worked example. A recent batch has 26 segments: 23 with no smell that counts, 1 whose worst smell is Minor, and 2 whose worst smell is Major. With the default weights, the average confidence is (23 × 100% + 1 × 80% + 2 × 50%) ÷ 26 = 95.4%. With the confirmation rule set to Up to Minor, 24 of the 26 segments are confirmed and the 2 Major segments stay for review.
Where the settings live
Level | Where | What it affects |
Account | Settings > Translation > Smells Scoring | Every Organizational Unit and project that follows the account |
Organizational Unit | The Organizational Unit's page > Translation > Smells Scoring | The Organizational Unit and the projects that follow it |
Project | The project's Smells Scoring tab | That project only |
The page has four parts: Smells sensitivity, How much each severity weighs, Which severity each smell type gets, and When segments are confirmed. Organizational Units and projects follow the level above for each part separately until someone changes that part there (see Customize an Organizational Unit or project below).
1. Set the Smells sensitivity
Sensitivity controls how much the Smells check reports in the Editor:
Low: reports only what blocks delivery.
Standard: reports what a reviewer would send back.
High: reports style and wording too, as Minor or Info.
Every level reports meaning errors, missing or invented content, untranslated text, numbers, placeholders and project rules. Turn on Translators can adjust it in the editor to let linguists change the level for themselves.
ℹ️ Note: Sensitivity only changes what linguists see while they work. Quality scores and confirmation by confidence always use Standard, so a translator who switches to Low doesn't raise the scores.
2. Set how much each severity weighs
Under How much each severity weighs, use − and + to set each weight, in steps of 5%. Or open Presets and pick one:
Preset | Blocker | Critical | Major | Minor | Info |
wxrks default | 0% | 30% | 50% | 80% | 100% |
MQM-style | 0% | 0% | 50% | 85% | 100% |
Strict | 0% | 20% | 40% | 70% | 100% |
A lighter severity can never weigh less than a heavier one. If it does, the page shows an error such as Minor can't lower the score more than Major. and the impact preview asks you to fix the weights first.
Why change the weights? The weights decide where segments land relative to your confirmation rule and how the average confidence moves. Lower weights make the same smells cost more. Weights that are equal make severities indistinguishable for the rule (see Common misconfigurations below).
3. Set the severity of each smell type
Which severity each smell type gets lists every kind of smell the detector has reported for your account, with how often it was seen in the last 90 days (Seen, 90 days) and the severity the model usually gives it (Model usually says). For each type, choose a Severity:
Model's rating: the severity the model assigns each time. This is what a type you haven't set uses.
Blocker, Critical, Major, Minor or Info: always this severity, whatever the model says.
Don't report: the type is not reported at all. It doesn't lower the score, and Fix all in the Editor doesn't fix it.
Use the filters (All, New, Set by you, Changed below) to find types, and Bulk actions to select several rows, choose Set to, and click Apply. The Set by column shows where each severity comes from.
The list starts empty and fills as the detector reports smells, so a new account shows No smell types yet.
4. Turn on confirmation by confidence score
When pre-translation finishes, the Smells check scores the segments it wrote. When segments are confirmed decides what happens to them.
Turn the switch on. While it's Off, segments are never confirmed or locked by their confidence score; the score is still computed and shown.
Under Confirm when the worst open smell is at most, pick the worst severity a segment may still have open and be confirmed: * No smell that lowers the score: only segments with no open smells, or only Info. * Up to Minor, Up to Major or Up to Critical: segments whose worst open smell is at most that severity.
Each option shows how many of your recent segments it would confirm, for example confirms 24 of 26, and Segments with these severities stay for review lists what will not be confirmed. 3. Choose what happens to the segments the rule accepts: * Confirm: marks them as confirmed. They stay editable. * Lock: locks them so they can no longer be edited. * Include in the cost analysis: counts their words in the Confirmed by Confidence Score band of the analysis, so they can be priced at their own rate.
⚠️ Warning: With Lock on, confirmed segments can't be edited by linguists. Only lock when a segment at your chosen severity can safely be delivered without a human look.
5. Check the impact preview and save
Before you save, the Impact preview shows what your draft would have done to the QA and pre-translation runs of the last 90 days. It is computed from smells already stored, so it makes no AI calls and costs nothing.
Average confidence: the draft's average, how many points it moves, and the saved value.
Segments by worst open smell: how many segments fall under each severity with the draft weights.
Auto-confirm by org unit: for each Organizational Unit, how many segments the Saved settings and the Draft confirm, and the Change. Each Organizational Unit is computed with its own effective settings.
When the numbers look right, click Save changes. The confirmation dialog lists each change, how many Organizational Units and projects follow these settings, and which ones keep their own. Click Save to apply, or Discard on the page to drop the draft.
ℹ️ Note: The new settings apply to QA runs from now on. Scores already computed stay as they are.
Customize an Organizational Unit or project
At an Organizational Unit or a project, each part shows Follows account or Follows followed by the Organizational Unit's name, and a Customize button.
Click Customize on the part you want to change, change it, and save as above.
The part now shows Custom. It no longer follows the level above, even when that level changes later.
To follow again, click Restore followed by the level's name (for example Restore Default) and save.
The other parts keep following. For smell types, a lower level changes only the rows it needs: set a row back to what the level above says and it follows again. If most types end up different, change the account's table instead, as the page suggests.
On a project, Translation & Editor Settings > Confirm & lock still shows a read-only Confirm segments by confidence score line with the current state and an Edit in Smells Scoring button that opens this tab.
If you used the old confidence threshold
Smells Scoring replaces the old Confirm segments by confidence score switch and its minimum confidence slider. Your previous settings were converted automatically: a minimum above 80% became No smell that lowers the score, above 50% became Up to Minor, and above 30% became Up to Major. Confirm, Lock and the cost setting were kept.
Common misconfigurations
The rule is on but nothing changes. If Auto confirm pre-translated segments is on for the project, every pre-translated segment is confirmed whatever its score, and the page shows Auto confirm is on, so this rule has no effect. Turn Auto confirm off for the rule to apply.
No segments are scored. If the Smells action is blocked for the account, Organizational Unit or project, pre-translated segments are not scored and confirmation by confidence is skipped. See wxrks Augmented Actions.
Two severities with the same weight. When a heavier severity weighs the same as the one your rule names, the rule can't tell them apart, so both stay for review and the page says, for example, Critical weighs the same as Blocker, so it stays for review too. With MQM-style (Blocker and Critical both 0%), Up to Critical confirms exactly what Up to Major confirms.
Setting a type to Don't report to make it go away. The smell disappears from the Editor and the score. Prefer Info when linguists should still see it without it lowering the score.
Expecting old scores to change. Saving affects QA runs from now on. Run QA again to see new scores on existing work.







