Skip to main content

loop.improvement/1

One turn of improving the improvement loop itself: the loop scorecard, computed over at least three recorded self.improvement turns, shows a metric below its target on the promoted loop definition (the scenario corpus, the metric definitions, the review panel, the intake rules, the protocols and the agent profiles); a candidate change to the loop is delivered; the candidate is checked not to redefine a metric without reporting the previous definition beside it; the owner, or a role the owner delegated the grant to on record, merges it; and after at least three further turns under the candidate the metric is compared again. Accepted once the metric improved; declined when it did not. Every change to the loop is a judge-surface change, so its merge needs the owner's grant or that of a role the owner delegated it to by a revocable record; a revoked delegation grants nothing (story:judge-guard enforces it).

Dependency graph​

Which actions may produce which evidence, which claims that evidence establishes, and which outcomes and obligations rest on those claims. Hover or focus a node to trace what it rests on.

Protocol · revision 1

loop.improvement/1

One turn of improving the improvement loop itself: the loop scorecard, computed over at least three recorded self.improvement turns, shows a metric below its target on the promoted loop definition (the scenario corpus, the metric definitions, the review panel, the intake rules, the protocols and the agent profiles); a candidate change to the loop is delivered; the candidate is checked not to redefine a metric without reporting the previous definition beside it; the owner, or a role the owner delegated the grant to on record, merges it; and after at least three further turns under the candidate the metric is compared again. Accepted once the metric improved; declined when it did not. Every change to the loop is a judge-surface change, so its merge needs the owner's grant or that of a role the owner delegated it to by a revocable record; a revoked delegation grants nothing (story:judge-guard enforces it).

  • Actions6
  • Evidence kinds4
  • Claims4
  • Outcomes3
  • Obligations2
  • Precondition, traced on hover
  • Needs authority
ACTION · WRITEloop.change.deliverACTION · READloop.compareACTION · READloop.definition.checkACTION · WRITEloop.finding.fileACTION · READloop.measureACTION · WRITEloop.mergeEVIDENCE KINDdefinition_checkEVIDENCE KINDloop_comparisonEVIDENCE KINDloop_measurementEVIDENCE KINDmerge_observationCLAIMloop.change_mergedCLAIMloop.definition_honestCLAIMloop.metric_below_targetCLAIMloop.metric_improvedOUTCOMEabandonedOUTCOMEacceptedOUTCOMEdeclinedOBLIGATIONhonesty.requiredOBLIGATIONimprovement.required

Hover or focus a node to trace what it rests on and what rests on it. Press Enter to pin it, Escape to clear.

Protocol as text
Actions
NameDescriptionRuleLeads to
loop.change.deliverdeliver a candidate change to the loop definition: the corpus, a metric definition, the review panel, the intake rules, a protocol or an agent profileclaim loop.metric_below_target effect write—
loop.compareonce at least three self.improvement turns ran under the merged candidate, compare the metric with the baseline'sclaim loop.change_merged effect readproduces loop_comparison
loop.definition.checkcompare the candidate's metric definitions with the baseline'seffect readproduces definition_check
loop.finding.filefile the lowest metric as a finding against the loopclaim loop.metric_below_target effect write—
loop.measurecompute the loop scorecard over the recorded self.improvement caseseffect readproduces loop_measurement
loop.mergemerge the loop candidate; the owner holds this capability, or a role the owner delegated it to by a revocable record, and a revoked delegation grants nothing (story:judge-guard enforces it)claim loop.definition_honest needs repository.merge.judge_surface effect writeproduces merge_observation
Evidence kinds
NameDescriptionRuleLeads to
definition_checkthe candidate's diff against the baseline's metric definitions; its result is unchanged, dual_reported (a changed definition whose previous figures are printed beside the new ones) or redefined (a changed definition without them)—establishes loop.definition_honest (dual_reported about loop_candidate); establishes loop.definition_honest (unchanged about loop_candidate)
loop_comparisonthe metric over at least three turns under the candidate against the same metric under the baseline; its result is improved or not_improved—establishes loop.metric_improved (improved about loop_candidate, independent on different_agent_run)
loop_measurementthe loop scorecard over at least three recorded self.improvement cases at a loop definition revision; figures no validator can observe (escaped defects) enter as human-sourced counts, labelled so; its result is below_target or at_target—establishes loop.metric_below_target (below_target about loop_baseline)
merge_observationthe loop candidate merged into the mainline; its result is merged—establishes loop.change_merged (merged about loop_candidate)
Claims
NameDescriptionRuleLeads to
loop.change_mergedthe current loop candidate is merged into the mainlineevidence = merged: merge_observationrequires accepted; gates loop.compare
loop.definition_honestthe current loop candidate leaves every metric definition unchanged, or reports the previous definition's figures beside the new onesany of evidence = dual_reported: definition_check evidence = unchanged: definition_checkrequires accepted; requires honesty.required; gates loop.merge
loop.metric_below_targeta loop metric is below its target on the baseline loop definitionevidence = below_target: loop_measurementgates loop.change.deliver; gates loop.finding.file
loop.metric_improvedthe metric improved under the current loop candidate, observed by another agent run than the one that delivered itevidence = improved: loop_comparisonrequires accepted; requires improvement.required
Outcomes
NameDescriptionRuleLeads to
abandonedthe loop turn closed because it was explicitly abandoned——
acceptedthe loop turn closed with an honest change merged and its metric improvedall of claim loop.change_merged claim loop.definition_honest claim loop.metric_improved—
declinedthe loop turn closed because the metric did not improve; the candidate is reverted by a further loop turnevidence = not_improved: loop_comparison—
Obligations
NameDescriptionRuleLeads to
honesty.requireda loop change never redefines a metric silentlyclaim loop.definition_honest—
improvement.requireda loop change counts only when its metric improvedclaim loop.metric_improved—

Source: protocols/loop-improvement/1.yaml

Actions​

What can be done in a case: what it needs first, which authority it requires, the class of effect it has and the evidence it may produce.

ActionDescriptionPreconditionRequires capabilityEffectMay produce
loop.change.deliverdeliver a candidate change to the loop definition: the corpus, a metric definition, the review panel, the intake rules, a protocol or an agent profileloop.metric_below_target is TRUEno authoritywriteno evidence
loop.compareonce at least three self.improvement turns ran under the merged candidate, compare the metric with the baseline'sloop.change_merged is TRUEno authorityreadloop_comparison
loop.definition.checkcompare the candidate's metric definitions with the baseline'snoneno authorityreaddefinition_check
loop.finding.filefile the lowest metric as a finding against the looploop.metric_below_target is TRUEno authoritywriteno evidence
loop.measurecompute the loop scorecard over the recorded self.improvement casesnoneno authorityreadloop_measurement
loop.mergemerge the loop candidate; the owner holds this capability, or a role the owner delegated it to by a revocable record, and a revoked delegation grants nothing (story:judge-guard enforces it)loop.definition_honest is TRUErepository.merge.judge_surfacewritemerge_observation

Evidence kinds​

The kinds of evidence this protocol admits.

Evidence kindDescriptionProduced byUsed by claims
definition_checkthe candidate's diff against the baseline's metric definitions; its result is unchanged, dual_reported (a changed definition whose previous figures are printed beside the new ones) or redefined (a changed definition without them)loop.definition.checkloop.definition_honest
loop_comparisonthe metric over at least three turns under the candidate against the same metric under the baseline; its result is improved or not_improvedloop.compareloop.metric_improved
loop_measurementthe loop scorecard over at least three recorded self.improvement cases at a loop definition revision; figures no validator can observe (escaped defects) enter as human-sourced counts, labelled so; its result is below_target or at_targetloop.measureloop.metric_below_target
merge_observationthe loop candidate merged into the mainline; its result is mergedloop.mergeloop.change_merged

Claims​

Each claim is TRUE, FALSE or UNKNOWN, established from evidence by its predicate. Missing or stale evidence leaves a claim UNKNOWN, never FALSE.

ClaimDescriptionTrue when
loop.change_mergedthe current loop candidate is merged into the mainlineevidence merge_observation with result merged about loop_candidate
loop.definition_honestthe current loop candidate leaves every metric definition unchanged, or reports the previous definition's figures beside the new onesany of (evidence definition_check with result dual_reported about loop_candidate; evidence definition_check with result unchanged about loop_candidate)
loop.metric_below_targeta loop metric is below its target on the baseline loop definitionevidence loop_measurement with result below_target about loop_baseline
loop.metric_improvedthe metric improved under the current loop candidate, observed by another agent run than the one that delivered itevidence loop_comparison with result improved about loop_candidate, from a producer independent on different_agent_run

Obligations​

What must be done before a case can be complete, and what discharges it. An obligation stays open until its predicate is TRUE; its predicate being UNKNOWN does not discharge it.

ObligationDescriptionDischarged when
honesty.requireda loop change never redefines a metric silentlyloop.definition_honest is TRUE
improvement.requireda loop change counts only when its metric improvedloop.metric_improved is TRUE

Outcomes​

The legitimate terminal interpretations of a case, and what each requires.

OutcomeDescriptionRequires
abandonedthe loop turn closed because it was explicitly abandoneddecision explicitly_abandoned
acceptedthe loop turn closed with an honest change merged and its metric improvedall of (loop.change_merged is TRUE; loop.definition_honest is TRUE; loop.metric_improved is TRUE)
declinedthe loop turn closed because the metric did not improve; the candidate is reverted by a further loop turnevidence loop_comparison with result not_improved about loop_candidate

Artifacts​

The things whose revisions evidence is bound to.

ArtifactDescription
loop_baselinethe promoted loop definition the metric was measured on
loop_candidatea changed loop definition meant to raise the metric
loop_findinga finding against the loop, naming the metric, its target and the turns it was computed from

Independence dimensions​

What an evidence match may demand of a record's producer (independent_on). The case lists, for each producer, the dimensions on which it is independent of the case's work; a match that demands a dimension reads only records whose producer the case lists on it. A record that fails the demand neither establishes nor contradicts the match, so a match only such records would decide is UNKNOWN.

DimensionDescription
different_agent_runthe producer is another agent run than the one that delivered the candidate