Running the gateway

Starting it#

export SKYL_AUTH_TOKEN=$(openssl rand -hex 32)   # required
export ANTHROPIC_API_KEY=sk-ant-...
export OPENAI_API_KEY=sk-...

go run github.com/BAGOMBEKA-JOB-DEV/skyl/gateway/cmd/skyl-gateway

Providers are registered from whichever keys are present.

What it refuses to start without#

Both are returned as errors with readable messages rather than panics, because both are operator configuration problems:

gateway: an auth token is required; refusing to start an open relay to paid APIs
gateway: no providers registered; set at least one provider API key

A SKYL_DEFAULT_PROVIDER naming an unregistered provider is also a startup error, rather than a 404 discovered later.

With no credentials at all#

The sandbox stands in for a provider, so you can run the whole stack for free:

# Terminal 1
go run github.com/BAGOMBEKA-JOB-DEV/skyl/cmd/skyl-sandbox

# Terminal 2
export SKYL_AUTH_TOKEN=local-dev-token
export SKYL_COMPAT_BASE_URL=http://127.0.0.1:8099/compat/v1
export SKYL_COMPAT_API_KEY=sandbox-key
export SKYL_COMPAT_NAME=sandbox
go run github.com/BAGOMBEKA-JOB-DEV/skyl/gateway/cmd/skyl-gateway

Then:

curl -sS localhost:8080/v1/providers -H "Authorization: Bearer local-dev-token"

{"providers":["sandbox"]}

In a container#

The published image is gcr.io/distroless/static:nonroot with a statically linked binary: no shell, no package manager, configuration entirely from the environment, logs to stdout.

docker compose up --build

Verifying it works#

curl -sS localhost:8080/v1/chat \
-H "Authorization: Bearer $SKYL_AUTH_TOKEN" \
-H 'Content-Type: application/json' \
-d '{
  "provider": "openai",
  "model": "gpt-5.6",
  "max_tokens": 64,
  "messages": [{"role": "user", "text": "Hello"}]
}'

Note "text", not "content" — see the wire format.

Graceful shutdown#

On SIGTERM the server drains: /readyz starts failing so a load balancer pulls the instance, in-flight requests are allowed to finish, and only then does the process exit. That matters more here than in most services, because an in-flight request is a paid generation you have already been charged for.

Troubleshooting#