Using AI
We host our own internal AI models for use with AI tools and integrations. You can access them through LiteLLM at https://litellm.internal.syslifters.com/.
You will receive your own LiteLLM key so you can use (almost) any AI-powered software in combination with our self-hosted models.
Setup
Claude CLI
- Install with winget
winget install -e --id Anthropic.ClaudeCode - To use our own LLMs with claude cli, set the following environment variables
sh
# Powershell
$env:CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS = "1" # opt out of using beta versions
$env:DISABLE_PROMPT_CACHING = "1" # disable prompt caching
$env:ANTHROPIC_BASE_URL = "https://litellm.internal.syslifters.com/" # set local litellm url
$env:ANTHROPIC_AUTH_TOKEN = "YOUR_LITELLM_TOKEN" # set your personal auth token
# Linux
export CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS=1
export DISABLE_PROMPT_CACHING=1
export ANTHROPIC_BASE_URL=https://litellm.internal.syslifters.com/
export ANTHROPIC_AUTH_TOKEN=YOUR_LITELLM_TOKEN- Now run claude with the default model
Powershell
claude.exe --model local_model_default # alias to use currently running local model, you can choose any running modelCline
Cline is a VSCode extension, which adds custom AIs to your IDE. It allows you to use many different AI providers:
- Install cline (https://cline.bot/) extension from marketplace in e.g. VSCode.
- When asked "How will you use Cline?" click "Bring my own API key"
- Use the following configuration:
- API Provider: OpenAI Compatible
- Base URL: https://litellm.internal.syslifters.com/v1
- API Key:
Bearer YOUR_LITELLM_TOKEN - Model:
local_model_default
Source Code Analysis
For white-box pentests where we receive source code, we have an AI enhanced SAST tool: PentestAI.
How it works
This tool analyzes source code in stages:
- Discovery: This phase divides the source code into multiple sections. You can choose a model for that
- Planning: In this phase, agents analyze each section from phase 1 against a checklst of vulnerability types. You can choose a model for all the agents.
- Analysis: This is the actual analysis where agents search for vulnerabilities based on reported vuln types from phase 2. You can choose multiple models for all agents.
- Verification: An agent verifies each discovered vulnerability from phase 3. Choose one model for this step.
- Consolidation: Because there are likely duplicate findings, we deduplicate them. Choose a model for this phase as well.
Starting an audit
- To create an audit, set a project name and upload the source code (either ZIP or folder)
- Start the sandbox and choose a model for the discovery phase

- Next, choose the model used for planning. When using selfhosted LLMS make sure to hit the checkbox to force agents to work through the whole checklist.

- Choose multiple models for analysis
- Choose one model for verification and afterwards consolidation