Skip to content

Using AI

We host our own internal AI models for use with AI tools and integrations. You can access them through LiteLLM at https://litellm.internal.syslifters.com/.

You will receive your own LiteLLM key so you can use (almost) any AI-powered software in combination with our self-hosted models.

Setup

Claude CLI

  1. Install with winget winget install -e --id Anthropic.ClaudeCode
  2. To use our own LLMs with claude cli, set the following environment variables
sh
# Powershell
$env:CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS = "1"                       # opt out of using beta versions
$env:DISABLE_PROMPT_CACHING = "1"                                       # disable prompt caching
$env:ANTHROPIC_BASE_URL = "https://litellm.internal.syslifters.com/"    # set local litellm url 
$env:ANTHROPIC_AUTH_TOKEN = "YOUR_LITELLM_TOKEN"                        # set your personal auth token

# Linux
export CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS=1
export DISABLE_PROMPT_CACHING=1
export ANTHROPIC_BASE_URL=https://litellm.internal.syslifters.com/
export ANTHROPIC_AUTH_TOKEN=YOUR_LITELLM_TOKEN
  1. Now run claude with the default model
Powershell
claude.exe --model local_model_default  # alias to use currently running local model, you can choose any running model

Cline

Cline is a VSCode extension, which adds custom AIs to your IDE. It allows you to use many different AI providers:

  • Install cline (https://cline.bot/) extension from marketplace in e.g. VSCode.
  • When asked "How will you use Cline?" click "Bring my own API key"
  • Use the following configuration:

Source Code Analysis

For white-box pentests where we receive source code, we have an AI enhanced SAST tool: PentestAI.

How it works

This tool analyzes source code in stages:

  1. Discovery: This phase divides the source code into multiple sections. You can choose a model for that
  2. Planning: In this phase, agents analyze each section from phase 1 against a checklst of vulnerability types. You can choose a model for all the agents.
  3. Analysis: This is the actual analysis where agents search for vulnerabilities based on reported vuln types from phase 2. You can choose multiple models for all agents.
  4. Verification: An agent verifies each discovered vulnerability from phase 3. Choose one model for this step.
  5. Consolidation: Because there are likely duplicate findings, we deduplicate them. Choose a model for this phase as well.

Starting an audit

  1. To create an audit, set a project name and upload the source code (either ZIP or folder)
  2. Start the sandbox and choose a model for the discovery phase

Start sandbox and choose the model

  1. Next, choose the model used for planning. When using selfhosted LLMS make sure to hit the checkbox to force agents to work through the whole checklist.

Force checklist and select LLM for phase 2

  1. Choose multiple models for analysis
  2. Choose one model for verification and afterwards consolidation