Skip to content

feat: add repetition functionality for experiments - #8

Open
jim-junior wants to merge 6 commits into
urunc-dev:mainfrom
jim-junior:ft-add-repitition
Open

feat: add repetition functionality for experiments#8
jim-junior wants to merge 6 commits into
urunc-dev:mainfrom
jim-junior:ft-add-repitition

Conversation

@jim-junior

Copy link
Copy Markdown
Collaborator

This PR adds repetition functionality for the HTTP readiness latency and Memory collection benchmarks. It introduces a new field in the experiment.yml file that is applied to experiments as:

experiments:

  http-readiness:
    repetitions: 10 # repetitions value for this experiment
    workloads:
      default:
        image: docker.io/library/nginx:latest
        ....

Theoreticaly it can be added to all experiments(the schema alows this) but aggregation of the results from all the repeated experiment runs has only been implemented for HTTP readiness latency and Memory benchmark.

Further more in the different adaptor.go files for different experiments, a new GenerateResult() method has been introduced, this is incharge of aggregating all the results from all the repeated experiment runs.

A new package internal/utils has been added, it includes standard implementations of the Interquartile range math function(and its tests) that is used to remove outliers in the HTTP readiness benchmark that often skew results. In future PRs, i also intend to use this package to transfer certain functions that are highly reused in the code to this package, e.g image pulling functions.

…ding tests

Signed-off-by: Beingana Jim Junior <jimjunior854@gmail.com>
Signed-off-by: Beingana Jim Junior <jimjunior854@gmail.com>
…ate stage results

Signed-off-by: Beingana Jim Junior <jimjunior854@gmail.com>
Signed-off-by: Beingana Jim Junior <jimjunior854@gmail.com>
Signed-off-by: Beingana Jim Junior <jimjunior854@gmail.com>
Signed-off-by: Beingana Jim Junior <jimjunior854@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant