Skip to content

Configure vLLM instruct and thinking modes - #261

Open
ArtemVazh wants to merge 1 commit into
mainfrom
configure-vllm-instruct
Open

Configure vLLM instruct and thinking modes#261
ArtemVazh wants to merge 1 commit into
mainfrom
configure-vllm-instruct

Conversation

@ArtemVazh

@ArtemVazh ArtemVazh commented Aug 4, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • always initialize WhiteboxModelvLLM with instruct=True
  • derive the adapter’s enable_thinking value from ThinkBooster’s existing model.disable_thinking_mode setting
  • avoid introducing a separate instruct configuration option in this reasoning-focused repository

The thinking-mode mapping reuses the existing setting as the single source of truth:

  • disable_thinking_mode: falseenable_thinking=True
  • disable_thinking_mode: trueenable_thinking=False
  • missing value → disable_thinking_mode=Falseenable_thinking=True

Dependency

Depends on IINemo/lm-polygraph#464, which adds the configurable enable_thinking constructor argument. Merge that PR first.

Validation

  • Python compilation passed
  • git diff --check passed
  • no test files are included in the commit

@ArtemVazh
ArtemVazh force-pushed the configure-vllm-instruct branch 2 times, most recently from 546a8ca to 8efb27b Compare August 4, 2026 11:48
@ArtemVazh
ArtemVazh force-pushed the configure-vllm-instruct branch from 8efb27b to 69497bf Compare August 4, 2026 11:48
@ArtemVazh
ArtemVazh requested a review from smirnovlad August 4, 2026 12:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant