> ## Documentation Index
> Fetch the complete documentation index at: https://docs.moonbounce.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Get the improvement loop's status

> Accepted suggestions with their evidence labels, review counts, spot-check agreement (on the version that last served production before the first acceptance vs on accepted candidates, by the version that served each production review) and the stop check: after `threshold` reviews with no suggestion beating the original on held-out cases, stop and rethink. Counts the key's environment only: a test key's reviews, random stratum and suggestions, with no accepted suggestions and so no spot check (acceptance is production's).



## OpenAPI

````yaml /openapi.json get /v1/decisions/{decision_id}/loop
openapi: 3.1.0
info:
  title: Moonbounce Decisions API
  version: 0.0.0
  description: >-
    Moonbounce decisions: evaluate items against a decision spec (features
    combined by aggregators), record feedback and seed examples, review a ranked
    queue, and improve the spec through suggestions that ship as code diffs,
    each with a preview (backtest) and an evidence label.


    **Authentication.** Send an API key as `Authorization: Bearer <key>` on
    every operation except `GET /health` and `POST /v1/specs/hash`. Call the API
    from a server, never a browser: a key must not reach one, and the API sends
    no CORS headers. A key belongs to one organization and one environment:
    production, or test for a key with the `env:test` permission. Test traffic
    never counts as production traffic.


    **Requests.** JSON bodies (`Content-Type: application/json`) of at most 1
    MB, parsed strictly: duplicate keys, lone surrogates, integers outside
    ±(2^53 - 1), `__proto__` keys, U+0000 and nesting deeper than 64 are a 400.


    **Retries.** Send an `Idempotency-Key` on every POST under /v1 that takes
    one (all but `POST /v1/specs/hash`). Keep it for the request's retries. The
    same key with the same request returns the first stored result, marked
    `Idempotent-Replayed: true`, for 24 hours (410 if that result was since
    deleted); with another request it is 422 IDEMPOTENCY_KEY_REUSED. Keys are
    scoped to the organization and environment across every operation, so use a
    fresh key per request. A request that failed before its result was stored
    runs again when retried. 429 and 503 under /v1 may carry `Retry-After`
    (seconds); a daily QUOTA_EXCEEDED cap instead names its reset time.


    **Errors.** Every error under /v1 is `{"error": {"type", "message",
    "reason"?, "param"?, "details"?}}` (ErrorBody); `GET /health` answers its
    own shape. Every response carries a `Request-Id` header. Rate limits apply
    per key, and per client IP for requests without a valid key; a 429
    RATE_LIMITED carries `Retry-After`.
servers:
  - url: https://api.moonbounce.ai
    description: Production
security: []
paths:
  /v1/decisions/{decision_id}/loop:
    get:
      tags:
        - suggestions
      summary: Get the improvement loop's status
      description: >-
        Accepted suggestions with their evidence labels, review counts,
        spot-check agreement (on the version that last served production before
        the first acceptance vs on accepted candidates, by the version that
        served each production review) and the stop check: after `threshold`
        reviews with no suggestion beating the original on held-out cases, stop
        and rethink. Counts the key's environment only: a test key's reviews,
        random stratum and suggestions, with no accepted suggestions and so no
        spot check (acceptance is production's).
      operationId: getLoopStatus
      parameters:
        - schema:
            $ref: '#/components/schemas/DecisionId'
          required: true
          name: decision_id
          in: path
      responses:
        '200':
          description: The loop status
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/LoopStatus'
        '400':
          description: 'Invalid request: `param` names the field at fault when one applies'
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorBody'
        '401':
          description: Missing or invalid API key (reason KEY_INVALID)
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorBody'
        '403':
          description: The key may not do this
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorBody'
        '404':
          description: Not found, or not in this key's organization and environment
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorBody'
        '429':
          description: >-
            RATE_LIMITED: retry after Retry-After seconds; QUOTA_EXCEEDED:
            details.reset_at gives the daily reset time (no Retry-After), or
            details.too_large asks for a smaller request
          headers:
            Retry-After:
              schema:
                type: string
                description: Seconds to wait before retrying, when waiting helps.
              required: false
              description: Seconds to wait before retrying, when waiting helps.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorBody'
        '503':
          description: >-
            Temporarily unavailable, with Retry-After (for example reason
            AUTH_UNAVAILABLE, ENGINE_UNAVAILABLE or STORE_UNAVAILABLE): retry
            with the same Idempotency-Key
          headers:
            Retry-After:
              schema:
                type: string
                description: Seconds to wait before retrying, when waiting helps.
              required: true
              description: Seconds to wait before retrying, when waiting helps.
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorBody'
      security:
        - bearerAuth:
            - decisions:develop
components:
  schemas:
    DecisionId:
      type: string
      pattern: ^[a-z][a-z0-9_.-]{0,127}$
    LoopStatus:
      type: object
      properties:
        environment:
          $ref: '#/components/schemas/Environment'
        decision_id:
          $ref: '#/components/schemas/DecisionId'
        accepted:
          type: array
          items:
            type: object
            properties:
              suggestion_id:
                $ref: '#/components/schemas/SugId'
              evaluation_id:
                $ref: '#/components/schemas/EvlId'
              accepted_at:
                $ref: '#/components/schemas/Timestamp'
              evidence_label:
                $ref: '#/components/schemas/EvidenceLabel'
              holdout_win:
                type: boolean
            required:
              - suggestion_id
              - evaluation_id
              - accepted_at
              - evidence_label
            additionalProperties: false
        reviews:
          type: integer
          minimum: 0
        random_lane:
          type: object
          properties:
            'n':
              type: integer
              minimum: 0
            agree:
              type: integer
              minimum: 0
            nonresponse:
              type: number
              minimum: 0
              maximum: 1
            changed_after_reveal:
              type: integer
              minimum: 0
          required:
            - 'n'
            - agree
            - nonresponse
            - changed_after_reveal
          additionalProperties: false
        spot_check:
          anyOf:
            - type: object
              properties:
                before:
                  type: object
                  properties:
                    'n':
                      type: integer
                      minimum: 0
                    agree:
                      type: integer
                      minimum: 0
                  required:
                    - 'n'
                    - agree
                  additionalProperties: false
                after:
                  type: object
                  properties:
                    'n':
                      type: integer
                      minimum: 0
                    agree:
                      type: integer
                      minimum: 0
                  required:
                    - 'n'
                    - agree
                  additionalProperties: false
              required:
                - before
                - after
              additionalProperties: false
            - type: 'null'
        stop_check:
          type: object
          properties:
            reviews:
              type: integer
              minimum: 0
            threshold:
              type: integer
              minimum: 1
            any_holdout_win:
              type: boolean
          required:
            - reviews
            - threshold
            - any_holdout_win
          additionalProperties: false
      required:
        - environment
        - decision_id
        - accepted
        - reviews
        - random_lane
        - stop_check
      additionalProperties: false
    ErrorBody:
      type: object
      properties:
        error:
          type: object
          properties:
            type:
              $ref: '#/components/schemas/ErrorType'
            reason:
              type: string
              pattern: ^[A-Z][A-Z0-9_]+$
              description: >-
                Set where a caller can act on it, one of the reasons in the
                ErrorReason schema. New reasons may be added: treat an unknown
                one by the status and `type`.
            message:
              type: string
              description: For people; don't parse it.
            param:
              type: string
              description: >-
                The request field at fault, as a dotted path (`subject.0.text`,
                `claims.1.value`).
            details:
              type: object
              additionalProperties: {}
          required:
            - type
            - message
          additionalProperties: false
      required:
        - error
      additionalProperties: false
    Environment:
      type: string
      enum:
        - production
        - test
      description: >-
        The environment of the key that made the call: `production` or `test`.
        Evaluations, feedback, reviews and suggestions are separate per
        environment; registered structures are shared.
    SugId:
      type: string
      pattern: >-
        ^sug_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$
    EvlId:
      type: string
      pattern: >-
        ^evl_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$
    Timestamp:
      type: string
      format: date-time
    EvidenceLabel:
      type: string
      enum:
        - starting_examples
        - training_cases
        - holdout
    ErrorType:
      type: string
      enum:
        - invalid_request
        - authentication
        - permission_denied
        - not_found
        - conflict
        - rate_limited
        - engine_failed
        - unavailable
        - internal
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      description: >-
        An API key, sent as `Authorization: Bearer <key>`. Each operation lists
        the scope its key needs: `decisions:evaluate` (evaluate and read
        evaluations), `decisions:feedback` (your app's feedback) or
        `decisions:develop` (everything else, including owner feedback and the
        review queue). An operation listing no scope takes any scoped key. A key
        with no scope, or without the operation's, gets 403 INSUFFICIENT_SCOPE.

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.