Skip to content

Caching model responses for quicker development and branching of runs #40

Description

@jas-ho

Note: this needs to be defined more carefully.
Currently, this is mostly a bookmark for a discussion we had with @spirali and @gavento .

The rough idea would be to allow an actor to read responses from a context instead of querying an API.

How this would help?

  • could speed up debugging by avoiding slow API calls
  • could help debugging by providing a reproducible / deterministic actor response
  • could allow branching experiments where, e.g., a run of a debate which looks promising up to round 10 can be repeated with several possible continuations after round 10

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions