Claude cli

Install with winget winget install -e --id Anthropic.ClaudeCode

Setup to use models with local litellm

$env:CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS = "1"                       # opt out of using beta versions
$env:DISABLE_PROMPT_CACHING = "1"                                       # disable prompt caching
$env:ANTHROPIC_BASE_URL = "https://litellm.internal.syslifters.com/"    # set local litellm url 
$env:ANTHROPIC_AUTH_TOKEN = <myToken>                                   # set your personal auth token

Run Claude with local default model:

claude.exe --model local_model_default # alias to use currently running local model

Run Claude with specific local model:

claude.exe --model <model-name> # e.g. gemma-4-31b-it-fp8

Cline

Setup to use models with local litellm

• Install cline (https://cline.bot/) extension from marketplace in e.g. VSCode.
• When asked "How will you use Cline?" click "Bring my own API key"
• Use the following configuration:
  • API Provider: OpenAI Compatible
  • Base URL: https://litellm.internal.syslifters.com/v1
  • API Key: Bearer
  • Model: local_model_default

Pentesting AI

TODO