Skip to content

Ask one question

diffuse query is the one-shot form of chat. It discovers a model, routes through it, prints the answer, and exits. It is the right tool for scripts and pipelines.

bash
diffuse query --model Qwen/Qwen2.5-0.5B-Instruct \
  --prompt "Explain black holes in two sentences."

Options

FlagDefaultMeaning
--model <id>requiredthe model to query
--prompt <text>requiredthe prompt to send
--bootstrap <urls>built-in sentinelssentinels to discover the network
--max-tokens <n>80maximum tokens to generate

Examples

A longer answer:

bash
diffuse query --model Qwen/Qwen2.5-0.5B-Instruct \
  --prompt "Write a haiku about distributed systems." \
  --max-tokens 60

Against your own network:

bash
diffuse query --model Qwen/Qwen2.5-0.5B-Instruct \
  --prompt "Ping" \
  --bootstrap http://your-sentinel:9440

Errors you may see

  • Model not found on the network. No node serves that model. Run diffuse models to see what is live.
  • Model is incomplete. The model is present but some layer range is held by nobody. The error names the missing slices. See replication.

Next

Diffuse Enterprise is commercial software. Diffuse Open is AGPL-3.0.