Skip to main content

Quickstart

Rossoctl can be deployed as a managed Kubernetes-based control plane, or locally on a laptop for testing identity and authorization before deploying to the cloud.

tip

This document describes rossoctl's Kubernetes deployment. Check back in August for the quickstart guide for local rossoctl without Kubernetes.

Prerequisites for local Kubernetes (Kind) install of Rossoctl​

For this Quickstart, we'll install on a laptop-hosted Kubernetes using kind.

For more install options, see the Installation Guide.

  • Docker Desktop, Rancher Desktop, or Podman (16GB RAM, 6 cores recommended)
  • Kind
  • (optional) Ollama for local LLM inference.

Install Rossoctl on Kubernetes​

Clone the repository:

git clone https://github.com/rossoctl/rossoctl.git
cd rossoctl

Check out the latest stable release (recommended). Find the current version at https://github.com/rossoctl/rossoctl/releases/latest.

git checkout v0.7.0-alpha.6

Copy and configure secrets (optional). Edit deployments/envs/.secret_values.yaml with your values.

cp deployments/envs/secret_values.yaml.example deployments/envs/.secret_values.yaml

Deploy to kind self-hosted Kubernetes cluster:

scripts/kind/setup-rossoctl.sh --with-ui --with-spire --with-agent-sandbox --with-builds

Access the Rossoctl Dashboard​

Show service URLs and credentials:

.github/scripts/local-setup/show-services.sh

Open the dashboard and log in with the credentials from the show-services.sh output:

open http://rossoctl-ui.localtest.me:8080

Install a self-hosted LLM​

note

You may skip this step and see Cloud Models if you are using a cloud-hosted LLM.

  1. Install Ollama: https://ollama.com/download

  2. Pull a model:

    ollama pull llama3.2:3b-instruct-fp16

  3. Start Ollama (listening on all interfaces):

    OLLAMA_HOST=0.0.0.0 ollama serve

Next step​

Run the weather agent.