Releases: NVIDIA/garak
Releases · NVIDIA/garak
Release list
v0.15.1
What's Changed
New plugins
- probes: add ProPILE probes for PII leakage detection by @stefanoamorelli in #1504
- generator: add
simonw/llmlibrary support by @Nakul-Rajpal in #1633
New features
Improved plugins
- Fix ggml generator call output handling by @zw5 in #1733
- fix: handle None response.choices in OpenAICompatible by @Christbowel in #1654
- Handle local paths in Hugging Face file probe by @musaabhasan in #1740
- fix(detectors): keep packagehallucination entries with invalid dates by @ChrisJr404 in #1738
- Fix malformed MISP tag on snowball detectors by @adityasingh2400 in #1796
- fix(divergence): guard max_tokens override when the generator lacks it by @adityasingh2400 in #1795
- allow promptinject probes to limit
generation_paramsby @jmartin-tech in #1729 - fix: preserve all turns in NVMultimodal prompt prep by @fallintoplace in #1837
Documentation
- housekeeping: amend arXiv
doc_uris fromhtmlwhere available, elseabsby @leondz in #1750 - Housekeeping: extend
AGENTS.mdby @leondz in #1771 - docs: Update contribution, agent instructions by @leondz in #1819
Tuning & fixes
- chore: remove stale .orig merge artifact from detectors by @markd88 in #1731
- stabilize tests of reasoning lorem generation by @jmartin-tech in #1741
- chore: remove deprecated maxrecall evaluator by @markd88 in #1732
- remove action workflow no longer used as the standard for the project by @jmartin-tech in #1743
- update expectations for litellm proxy to openai by @jmartin-tech in #1777
- fix: when tiktoken encoding is unclear fallback during estimation by @jmartin-tech in #1749
- fix: improve data_path escape protections by @jmartin-tech in #1781
- fix(evaluators): inline score_to_defcon in get_z_rating by @ppradyoth in #1794
- test(config): regression guard for config_files dedup by @ppradyoth in #1791
- test: add tests for evaluators by @r3v5 in #1656
- fix(docs): pin sphinx-rtd-theme>=3.1.0 for Sphinx 9.x compatibility by @AlexanderSanin in #1811
- fix: clearer error when probespec module has only inactive plugins by @notnick2 in #1797
- test: add unit tests for phrasing and sata probe modules by @markd88 in #1747
- Skip invalid payloads in _scan_payload_dir instead of crashing by @Kymi808 in #1810
- bump javascript dependencies by @jmartin-tech in #1839
New Contributors
- @markd88 made their first contribution in #1731
- @zw5 made their first contribution in #1733
- @musaabhasan made their first contribution in #1740
- @stefanoamorelli made their first contribution in #1504
- @ChrisJr404 made their first contribution in #1738
- @0x3df made their first contribution in #1641
- @adityasingh2400 made their first contribution in #1796
- @ppradyoth made their first contribution in #1794
- @AlexanderSanin made their first contribution in #1811
- @notnick2 made their first contribution in #1797
- @Kymi808 made their first contribution in #1810
Full Changelog: v0.15.0...v0.15.1
v0.15.0
What's Changed
New plugins
- probes: Add multi-turn GOAT probe by @saichandrapandraju in #1424
- probes: Agent breaker by @eliyacohen-hub in #1628
- probes: Added system prompt extraction probe by @Nakul-Rajpal in #1538
- probes: add homoglyph obfuscation prompts to smuggling probe by @dentity007 in #1660
- detectors: Add ModernBERT refusal detector by @patriciapampanelli in #1650
- generators: NeMoGuardrails server support by @jmartin-tech in #1675
- generators: test generator with reasoning traces by @leondz in #1697
New features
- Agent breaker probe by @eliyacohen-hub in #1628 adds support for testing tools available to target systems.
Improved plugins
- generators: add mTLS client certificate authentication to REST generator by @JakeBx in #1681
- generators: Add support for reasoning models to Bedrock generator by @TheTeaCat in #1642
- detectors: limit tensor length passed to roberta by @leondz in #1715
- probes: Enforce soft_probe_prompt_cap in GCGCached probe by @precognitivem0nk in #1665
- detectors: fix logic flip bug in encoding detection, add tests to catch by @leondz in #1711
Documentation
- docs: structure docs out of flat dir into tree by @leondz in #1662
- docs: explicitly enumerate configurable params in docs by @leondz in #1683
Tuning & fixes
- fix: prevent semaphore leak by @r3v5 in #1657
- Replace base2048 with mikeshardmind-base2048 and add spec tests by @onceandtwice in #1518
- fix: remove duplicate status:2 attempt writes in TreeSearchProbe by @Christbowel in #1655
- task: dependency updates by @jmartin-tech in #1678
- fix: report_digest -t taxonomy option not working by @HayatoFujihara in #1672
- fix: use magic.from_file() instead of from_buffer() for libmagic 5.47 compatibility by @HayatoFujihara in #1671
- housekeeping: prune phantom rapidfuzz dep by @leondz in #1701
- housekeeping: supply hook for signing, document signing prefs by @leondz in #1702
- first version of AGENTS.md by @leondz in #1698
- bug: avoid TBSA double horizontal rule by @leondz in #1712
- Handle unrecognized probes and detectors in report digest generation by @precognitivem0nk in #1663
- report: snapshot plugin cache into report jsonl by @patriciapampanelli in #1723
- docs: add build test for docs by @leondz in #1713
- improve compatibility with older reports by @jmartin-tech in #1728
New Contributors
- @r3v5 made their first contribution in #1657
- @onceandtwice made their first contribution in #1518
- @TheTeaCat made their first contribution in #1642
- @Christbowel made their first contribution in #1655
- @HayatoFujihara made their first contribution in #1672
- @precognitivem0nk made their first contribution in #1665
- @JakeBx made their first contribution in #1681
- @eliyacohen-hub made their first contribution in #1628
- @dentity007 made their first contribution in #1660
Full Changelog: v0.14.1...v0.15.0
v0.14.1
What's Changed
New plugins
- generator: Add WebSocket generator for real-time LLM security testing by @dyrtyData in #1379
New features
- OpenAI Harmony format for audio inputs by @erickgalinkin in #1618
- add probe tier to
--list_probesby @leoneperdigao in #1571 - Add Bootstrap Confidence Intervals for Attack Success Rates by @patriciapampanelli in #1577
Notice: Breaking changes in this release
- remove deprecated nemollm generator and dependencies by @jmartin-tech in #1643
Improved plugins
- probes: activate sata & badchars by @leondz in #1623
- Add résumé prompt injection examples by @Sid-V5 in #1616
- fix: binary inclusion of jailbreak components now selects correctly by @leondz in #1621
- Improve Jinja Injection Detection by @erickgalinkin in #1609
Documentation
- docs: reorganise detector metrics out of code reference section by @leondz in #1617
- docs: improve docs on bar for acceptable probe; link these from other places by @leondz in #1647
Tuning & fixes
- reporting: have
qual_reviewsupportreport.jsonleval entries from 0.13.3 and earlier by @leondz in #1605 - linting, 2026 01 30 by @leondz in #1587
- bump black version to 26.x, remove pin by @leondz in #1591
- Fix core cfg listed twice in report in default run by @arjun-krishna1 in #1544
- task: bump yarn dependencies to ensure secure posture by @jmartin-tech in #1611
- tests: reorg test assets into one dir by @leondz in #1615
- task: update yarn based dependencies by @jmartin-tech in #1631
- task: add report tests automation by @jmartin-tech in #1632
- tests: force brew installed libmagic version to 5.46 by @jmartin-tech in #1635
- task: ensure calls to json.dumps allow non-ascii for language support by @jmartin-tech in #1630
- fix: detector description and CLI follow-ups by @patriciapampanelli in #1625
- chore: add optional pre-commit hook for garak-report by @otavionvidia in #1594
- lock litellm by @jmartin-tech in #1648
- update
yarn.lockfor latest packages by @jmartin-tech in #1661 - fix: use parameterized SQL queries in report_digest.py by @gn00295120 in #1645
- task: add preliminary build prep action by @jmartin-tech in #1570
New Contributors
- @Sid-V5 made their first contribution in #1616
- @dyrtyData made their first contribution in #1379
- @leoneperdigao made their first contribution in #1571
- @gn00295120 made their first contribution in #1645
Full Changelog: v0.14.0...v0.14.1
v0.14.0
What's Changed
New features
- feature: support JSON config as well as YAML by @patriciapampanelli in #1490
- feature: remove
--generate_autodanCLI option by @sinhaabhiraj0 in #1521 - expand items in report
entry_type:evalby @leondz in #1547 - reporting: tier biased security aggregate by @leondz in #1329
- feature: Report Generator refactor by @otavionvidia in #1573
- feature: Add detector evaluation doc and benchmark results by @patriciapampanelli in #1597
- task: calibration data updates winter 2026 by @jmartin-tech in #1599
Notice: Breaking changes in this release
- Modified format of
evalanddigestentires in JSONL report
See "Run analysis" documentation for more details of compatibility expectations. - Fully redesigned HTML reports
- Removal of
--generate_autodancli option
Improved plugins
- Fix atkgen verbose output displaying incorrect conversation turns by @snehalvartak in #1542
- generator: relax constraint to specify valid openai model name by @leondz in #1557
- generators: check message count requested matches message count generated by @leondz in #1558
- fix: JavaScript detector regex improvement by @erickgalinkin in #1588
Documentation
- docs: add guardion ai / promptintel to project by @leondz in #1530
- docs: add brief stubs for garak.analyze content by @leondz in #1569
Tuning & fixes
- Make GoogleTranslator multiprocessing-safe by @motlaharsh0909-lgtm in #1543
- Fix: improved unsafe pickle strategy by @jmartin-tech in #1545
- track which detector is reporting invalid pkg entry; only report once by @leondz in #1556
- arch: Remove many builtin configs by @leondz in #1555
- update: rm deprecated
gpt-3.5model from defaults by @leondz in #1552 - task: update openai library to 2.x by @jmartin-tech in #1550
- test: isolate _config in all tests by @jmartin-tech in #1549
- update LangChain generator for 1.x library support by @jmartin-tech in #1551
- add license to docs footer by @leondz in #1572
- guard for
Nonecontent as response from target by @jmartin-tech in #1574 - fix: 100% pass rate should not give 'elevated risk' for relative scores by @leondz in #1579
- Move generation output cardinality check into
Generator.generate()by @leondz in #1578 - calling
as_dict()on default instantiatedAttemptnow doesn't raiseTypeErrorby @leondz in #1590 - task: remove fschat by @erickgalinkin in #1567
- task: report test tweaks and dependency lock updates by @otavionvidia in #1593
- Task: transformers 5 support by @jmartin-tech in #1582
- task: exclude files not needed in distributed package by @jmartin-tech in #1601
- reporting: factor up defcon calculation by @leondz in #1581
- rm
jinja2direct dependency requirement by @leondz in #1596 - task: update huggingface config pattern by @jmartin-tech in #1602
- reporting: stabilise tbsa hashes by @leondz in #1603
New Contributors
- @snehalvartak made their first contribution in #1542
- @sinhaabhiraj0 made their first contribution in #1521
- @motlaharsh0909-lgtm made their first contribution in #1543
- @otavionvidia made their first contribution in #1573
Full Changelog: v0.13.3...v0.14.0
v0.13.3
What's Changed
New plugins
- probe: Api key probe + detector by @martinebl in #1406
- probe: zero width bad char injection by @Har1sh-k in #1489
- generator: AWS bedrock generator by @fabriziorocco in #1462
New features
- enable consistent PRNG access in generators by @jmartin-tech in #1496
Improved plugins
- probe: Add more unreal pkghallu targets by @leondz in #1480
- feature:
OpenAICompatibleclasses do one generation at a time by default by @leondz in #1524
Documentation
- docs: add test for file extensions in docs dir by @leondz in #1474
- docs: describe probe module doc standard; implement it in all probe modules by @leondz in #1473
- docs(fix): Format list in RST by @mikemckiernan in #1491
- docs: add projects file for tracking garak ecosystem by @leondz in #1493
- doc: rm links to doc source; show links to github code source by @leondz in #1506
- docs: check for markdown in plugin docs, check for plugin module docstrings by @leondz in #1505
- docs: refine markdown checks by @leondz in #1510
Tuning & fixes
- tests: detector cardinality test tweaks by @leondz in #1476
- tool: add script for rebuilding plugin cache by @leondz in #1478
- allow for
apikeycase wheregroup=Noneby @boltzmann-brain in #1497 - fix: metadata and vuln_id handling in AVID report export by @saichandrapandraju in #1495
- test: add tests for
apikeydetectorNone-group handling by @leondz in #1501 - bugfix:
TreeSearchProbeshould handleNones by @leondz in #1509 - housekeeping: add code of conduct by @leondz in #1517
- arch: rm support for init'ing
attempt.promptwithstr, rm support forattempt.langvalue by @leondz in #1361 - fix: encoding probes storing translated text in
pre_translation_promptby @paulinek13 in #1483 - feature: deferred loading and requirement pruning by @leondz in #1199
New Contributors
- @boltzmann-brain made their first contribution in #1497
- @fabriziorocco made their first contribution in #1462
- @saichandrapandraju made their first contribution in #1495
- @Har1sh-k made their first contribution in #1489
Full Changelog: v0.13.2...v0.13.3
v0.13.2
What's Changed
New plugins
- probe: Base class for iterative probes and FITD as an example by @aishwaryap in #1414
- detectors: any by @leondz in #1427
Improved plugins
- detectors: Fix incorrect target class for MustRefuteClaimModel by @RobGeada in #1419
- probes: Win11 probe still uses Windows 10 product names and goal by @2020ashish in #1422
- probes: properly parse the OFCOM list file by @paulinek13 in #1438
- probes: atkgen probe verbose output by @MrMoshkovitz in #1447
- probes: NameError in TAP/PAIR probes by @MrMoshkovitz in #1452
- detectors: access Message.text in PlainJSON by @jmartin-tech in #1454
- generators: enable parameter suppression to LiteLLM by @JDSmith-F1 in #1411
Documentation
- docs: revert unintended changes to translation configs by @paulinek13 in #1458
- docs: guide to running garak faster by @leondz in #1463
- docs: patch filename in doc on accelerating garak by @leondz in #1465
Tuning & fixes
- bugfix:
transformersdisconnect btw pegasus andtransformers-community/group-beam-searchby @leondz in #1403 - Use ABC to exclude abstract classes from --list_probes by @patriciapampanelli in #1398
- limit langchain version until migration by @jmartin-tech in #1420
- correct _mint_attempt conversation support by @jmartin-tech in #1417
- update github-specific content to 'target' param pattern by @leondz in #1426
- add init.py for all test paths containing
.pyby @jmartin-tech in #1428 - Fix/recommended detector migration by @patriciapampanelli in #1409
- refactor DAN probes using metaclass pattern by @patriciapampanelli in #1380
- update detectors to reflect immutable attempt prompt by @jmartin-tech in #1415
- improve prompt translation support for Conversation related types by @jmartin-tech in #1441
- fix: aggregate probes details in digest by @parkanzky in #1459
- fix: reduce window for multiprocessing race by @jmartin-tech in #1464
New Contributors
- @RobGeada made their first contribution in #1419
- @2020ashish made their first contribution in #1422
- @paulinek13 made their first contribution in #1438
- @MrMoshkovitz made their first contribution in #1447
- @JDSmith-F1 made their first contribution in #1411
- @parkanzky made their first contribution in #1459
Full Changelog: v0.13.1...v0.13.2
v0.13.1
What's Changed
New plugins
- probe: Atbash Encoding by @Nakul-Rajpal in #1343
- probe: ansi escape codes in tokenizer by @leondz in #1351
- dropbox repeated token attack by @dchiitmalla in #1244
- probe: DRA (Disguise and Reconstruction Attack) by @patriciapampanelli in #1345
- probes: package hallucination support for dart, perl, & raku by @dchiitmalla in #1243
- probe: Added token smuggling probe module by @mrowebot in #1192
New features
- feature: support detectors including
Nonein output values by @leondz in #1280 - config:
model_*totarget_*by @leondz in #1383 - cli: add filtering support for --list_* options by @JosephDavisC in #1367
Improved plugins
- bugfix: future probes now use future phrasing by @leondz in #1388
- rename and extend Web injection probes by @erickgalinkin in #1335
Documentation
- fixing probable typo in cliref.rst by @cassiasamp in #1353
- docs(chore): Fix most build warnings by @mikemckiernan in #1359
- docs: reorganize table of concepts and getting started page by @mikemckiernan in #1360
- docs: theme recolor by @leondz in #1385
- docs: auto-include ASR in probe doc page if current calibration exists by @leondz in #1387
- bugfix: ASR figures in probe docs are now actual ASRs by @leondz in #1392
Tuning & fixes
- Specify
flitbuild-system withinpyproject.tomlby @06kellyjac in #1317 - Update how license is defined in pyproject.toml by @06kellyjac in #1315
- reporting: add basic docs to scripts in analyze pkg by @leondz in #1369
- update: tektronix typo fix by @leondz in #1372
- cli: standardise reporting tool invocation patterns by @SubGlitch1 in #1370
- adding local fixture to setup wordnet environment by @dhruvmalik007 in #1342
- reporting: add aggregation of report jsonl digest objects, and tests for aggregation by @leondz in #1336
- update: rename
data/misp_descriptions.tsvtodata/tags.misp.tsvby @leondz in #1381
New Contributors
- @cassiasamp made their first contribution in #1353
- @Nakul-Rajpal made their first contribution in #1343
- @SubGlitch1 made their first contribution in #1370
- @dhruvmalik007 made their first contribution in #1342
- @patriciapampanelli made their first contribution in #1345
- @JosephDavisC made their first contribution in #1367
Full Changelog: v0.13.0...v0.13.1
v0.13.0
What's Changed
New plugins
- Doctor attack + encoding/Leet by @leondz in #1180
- Simple Assistive Task Linkage Probe by @erickgalinkin in #1319
- Ascii Smuggling by @erickgalinkin in #1299
- Added more generalized version of Markdown exfil probe by @aishwaryap in #1259
New features
- Feature: rename failure -> attack success by @leondz in #1326
- Feature: conversation support by @jmartin-tech in #1254
- Feature: Configurable system prompt by @erickgalinkin in #1337
Improved plugins
- Expand python exploitation payloads by @erickgalinkin in #1300
- Bug fix in python regex in malwaregen.AnyCode detector by @aishwaryap in #1296
- Bug fix to malwaregen anycode detector in keyword using by @aishwaryap in #1302
- Adding wider detection of :: and // in malwaregen.AnyCode detector by @aishwaryap in #1307
- Update datasets and regex for package hallucination by @arjun-krishna1 in #1124
Documentation
- amend docs copyright by @leondz in #1284
- documentation: typo fix by @dbaker-arch in #1286
- docs: improve conformance to PEP-0257 by @jmartin-tech in #1298
- docs: update contact email in readme by @leondz in #1341
Tuning & fixes
- Replace deprecated
np.inftywithnp.inf. by @erickgalinkin in #1283 - restrict datasets version due to new torchcodec dependency by @jmartin-tech in #1290
- Promptinject cleanup by @erickgalinkin in #1292
- add missing import for
rein azure generator by @jmartin-tech in #1294 - fix missing '.' in default config probe_spec by @jmartin-tech in #1295
- download models used in translation tests early by @jmartin-tech in #1308
- Tweaks to how
wnis used by @06kellyjac in #1316 - Added NASM sections in regex for assembly in malwaregen.Anycode detector by @aishwaryap in #1310
- Use numpy v2 by @06kellyjac in #1314
- update usage of fschat required for compatibility by @jmartin-tech in #1322
- cohere version upgrade by @dchiitmalla in #1252
- improve cache and label automation by @jmartin-tech in #1324
- fix doc extending.rst by @solo-daemon in #1328
- reporting: add tags to digest, tidy naming by @leondz in #1334
- reporting: update defcon descriptions to talk about risk by @leondz in #1348
- judge detectors conversation refactor by @jmartin-tech in #1346
New Contributors
- @dbaker-arch made their first contribution in #1286
- @06kellyjac made their first contribution in #1316
- @solo-daemon made their first contribution in #1328
Full Changelog: v0.12.0...v0.13.0
v0.12.0
What's Changed
New plugins
- Add audio NIM model and audio probes by @erickgalinkin in #1163
- Leakreplay refactor by @dchiitmalla in #1264
- probes: refactor fact snippet mixin by @leondz in #1187
New features
- reporting: result summary object by @leondz in #1245
- rm octo generator by @leondz in #1248
- UX: add progress indicators for translation tasks by @jmartin-tech in #1257
- Feature: add google translate language provider by @jmartin-tech in #1232
- update LocalDataPath and testing for python 3.13 support by @jmartin-tech in #1188
Documentation
- docs: correct reference to langproviders configuration by @jmartin-tech in #1253
- chore: The bare .active has too much blast radius by @mikemckiernan in #1262
- docs: Address RST issues by @mikemckiernan in #1263
- chore: Update pre-commit hooks and use RST comment by @mikemckiernan in #1267
- docs: mistral syntax fix and minor code cleanup by @jmartin-tech in #1270
- chore: Reformat docstrings to reduce docs issues by @mikemckiernan in #1268
Tuning & fixes
- data correlation during calibration missed rename by @jmartin-tech in #1240
- bug fix: enable extended detectors, module-specified encoding payloads by default by @leondz in #1238
- adjust calling convention for perf_stats.py by @jmartin-tech in #1246
- remove modality redundant check by @jmartin-tech in #1251
- Llava tests by @dchiitmalla in #1256
- add action for closing stale PRs/issues by @leondz in #1269
- update refusal prompt by @katherine-luna in #1083
- add stale exempt tags by @leondz in #1272
- actions: add 'high priortiy' to never-stale label list by @leondz in #1274
- reset tiers for
Completeleakreplayprobes by @leondz in #1278
New Contributors
- @mikemckiernan made their first contribution in #1262
- @dchiitmalla made their first contribution in #1256
- @katherine-luna made their first contribution in #1083
Full Changelog: v0.11.0...v0.12.0
v0.11.0
What's Changed
New plugins
- Template / SQL injection probes by @erickgalinkin in #1138
- Feature/add mistral generator by @dimensi0n in #1135
New features
- feature: update default toxicity detector by @leondz in #1106
- feature: lightweight probe defaults by @leondz in #1116
- feature: max_workers / give kinda helpful message if too many open files by @leondz in #1110
- Multiprocess enabled logging config by @jmartin-tech in #1140
- Feature: multilingual machine translation by @SnowMasaya in #943
- Support stripping until end think token given empty skip_seq_start in config by @aishwaryap in #1185
- update: add probe tiers by @leondz in #1151
- update: promptinject detector now accepts multiple triggers by @leondz in #1148
- update: rename atkgen probe model to be clear about toxicity by @leondz in #1149
- update: remove ambiguous terms from
slur_terms_enpayload by @leondz in #1150 - reporting: update report aggregation funcs by @leondz in #1156
- script: qualitative review output by @leondz in #1144
- Add -no-cnv flag support to ggml generators by @IanYHChu in #1189
- reporting: add option for no group score by @leondz in #1194
- reporting: aggregate probe as min by @leondz in #1218
- reporting: add defcon lozenges for relative & absolute scores by @leondz in #1216
- Update/refactor specialwords by @leondz in #1178
- reporting: smooth z-score wildness by @leondz in #1212
- Task: 2025 Q2 scoring calibration by @jmartin-tech in #1231 (thanks to Vijil.ai for data contributions)
- update calibration data for additional probes by @jmartin-tech in #1236
- reporting: change default aggregation by @leondz in #1234
Documentation
- Fix typo in README for leak replay probe by @arjun-krishna1 in #1142
- docs: split 'extending' docs out from 'contributing' by @leondz in #1146
- doc file class corrections by @jmartin-tech in #1200
- docs: formatting fixes by @leondz in #1215
Tuning & fixes
- clear pip cached files by @jmartin-tech in #1129
- set a default soft_probe_prompt_cap in
_configby @jmartin-tech in #1133 - enhance response type support from local NeMo-Guardrails by @jmartin-tech in #1131
- bugfix: encoding detection generating false positives by @leondz in #1130
- update: unify on
attempt.notes["triggers"]by @leondz in #1147 - Bump datasets version by @JanetVictorious in #1137
- make all workflow permissions explicit by @jmartin-tech in #1162
- update: add soft prompt caps to encoding probes by @leondz in #1154
- update: rename
bcp47tolangby @leondz in #1164 - one detection result per output when testing regex based matches in
exploitationby @jmartin-tech in #1167 - Removed detector prefix from eval records by @mrowebot in #1157
- bugfix: HF Detector exceptions now handled gracefully by default by @leondz in #1170
- cache workflow resources by @jmartin-tech in #1173
- refactor probe
tieras enum with value in plugin cache by @jmartin-tech in #1159 - update: more meaningful values in tier enums by @leondz in #1176
- block failing litellm 1.67.2 by @leondz in #1179
- ux: give more verbose message for CLI typos by @leondz in #1182
- refactor
LatentInjectionby @leondz in #1152 - cap
litellmmax version to avoid their windows bug by @leondz in #1186 - update: rename
Translator->LangProviderand associated elements by @leondz in #1183 - bugfix: reduce latent optimisation permutation explosion by @leondz in #1181
- replicate generator pickle support improvements by @jmartin-tech in #1190
- Fix ambiguous series value error when running --report by @marcorosa in #1171
- add arm64 runner to Linux testing by @jmartin-tech in #1196
- Testing: storage reduction by @jmartin-tech in #1204
- remove unused tooling to free space by @jmartin-tech in #1206
- update deps away from insecure versions by @leondz in #1207
- update
Tierimpl by @leondz in #1205 - config: sync probe active defaults with default config used in practice by @leondz in #1214
- update: revert default
_config.run.generationsto5by @leondz in #1227 - fix: stop
atkgenturn count variation in test relying on fixed turn count by @leondz in #1226 - fix plugin cache tests by @emmanuel-ferdman in #1229
- ux: move translator load msg into translator instantiation by @leondz in #1184
- extract text when processing multi-modal prompts by @jmartin-tech in #1228
New Contributors
- @JanetVictorious made their first contribution in #1137
- @SnowMasaya made their first contribution in #943
- @dimensi0n made their first contribution in #1135
- @mrowebot made their first contribution in #1157
- @aishwaryap made their first contribution in #1185
- @marcorosa made their first contribution in #1171
- @IanYHChu made their first contribution in #1189
Full Changelog: v0.10.3.1...v0.11.0