Skip to content

Using AI ​

We host our own internal AI models for use with AI tools and integrations. You can access them through LiteLLM at https://litellm.internal.syslifters.com/.

You will receive your own LiteLLM key so you can use (almost) any AI-powered software in combination with our self-hosted models.

Setup ​

Claude CLI ​

  1. Install with winget winget install -e --id Anthropic.ClaudeCode
  2. To use our own LLMs with claude cli, set the following environment variables
sh
# Powershell
$env:CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS = "1"                       # opt out of using beta versions
$env:DISABLE_PROMPT_CACHING = "1"                                       # disable prompt caching
$env:ANTHROPIC_BASE_URL = "https://litellm.internal.syslifters.com/"    # set local litellm url 
$env:ANTHROPIC_AUTH_TOKEN = "YOUR_LITELLM_TOKEN"                        # set your personal auth token

# Linux
export CLAUDE_CODE_DISABLE_EXPERIMENTAL_BETAS=1
export DISABLE_PROMPT_CACHING=1
export ANTHROPIC_BASE_URL=https://litellm.internal.syslifters.com/
export ANTHROPIC_AUTH_TOKEN=YOUR_LITELLM_TOKEN
  1. Now run claude with the default model
Powershell
claude.exe --model local_model_default  # alias to use currently running local model, you can choose any running model

Cline ​

Cline is a VSCode extension, which adds custom AIs to your IDE. It allows you to use many different AI providers:

  • Install cline (https://cline.bot/) extension from marketplace in e.g. VSCode.
  • When asked "How will you use Cline?" click "Bring my own API key"
  • Use the following configuration:

Cursor ​

You can ask for a Cursor subscription if you need one. You can also bring your own model.

If using Cursor, make sure to maintain a global ignorelist to hold the agent back from accessing sensitive files:

bash
cat << 'EOF' > ~/.cursor/.cursorignore
**/.env
**/credentials.json
**/secrets.json
**/*.key
**/*.pem
**/id_rsa
secrets/
node_modules/
EOF

Source Code Analysis ​

For white-box pentests where we receive source code, we have an AI enhanced SAST tool: PentestAI.

How it works ​

This tool analyzes source code in stages:

  1. Discovery: This phase divides the source code into multiple sections. You can choose a model for that
  2. Planning: In this phase, agents analyze each section from phase 1 against a checklst of vulnerability types. You can choose a model for all the agents.
  3. Analysis: This is the actual analysis where agents search for vulnerabilities based on reported vuln types from phase 2. You can choose multiple models for all agents.
  4. Verification: An agent verifies each discovered vulnerability from phase 3. Choose one model for this step.
  5. Consolidation: Because there are likely duplicate findings, we deduplicate them. Choose a model for this phase as well.

Starting an audit ​

  1. To create an audit, set a project name and upload the source code (either ZIP or folder)
    • Make sure all files and subfolders are at the root level of the ZIP file—don't wrap everything in a single main folder.
      • Correct: archive.zip -> file1.txt, file2.txt, subfolder/
      • Incorrect: archive.zip -> my_project/ -> file1.txt, file2.txt, subfolder/
    • Delete unneeded directories with lots of files, such as node_modules
    • You can place further documentation into the root directory (if available).
  2. Optionally, add a system prompt to the AI.
  3. Start the sandbox and choose a model for the discovery phase

Start sandbox and choose the model

  1. Next, choose the model used for planning. When using selfhosted LLMS make sure to hit the checkbox to force agents to work through the whole checklist.

Force checklist and select LLM for phase 2

  1. Before proceeding to phase 3, select one model (you can use the same one as used for phase 2). The UI provides a multi select, however only test with multiple models if external one's are explicitly allowed.
  2. Choose one model for verification and afterwards consolidation