Skip to content

diffuse-coordinator dataset import ​

Ingest a file the coordinator can read.

Synopsis ​

diffuse-coordinator dataset import [OPTIONS]

Options ​

flagvaluedefaultdescription
--config<CONFIG>$DIFFUSE_COORDINATOR_CONFIGConfiguration file. Its [admin] section says where to connect
--endpoint<ENDPOINT>$DIFFUSE_COORDINATOR_ENDPOINTCoordinator endpoint, e.g. https://coordinator.internal:7443
--ca-cert<CA_CERT>$DIFFUSE_CA_CERTThe deployment CA certificate (PEM)
--cert<CERT>$DIFFUSE_CERTThis process's certificate chain (PEM)
--key<KEY>$DIFFUSE_KEYThis process's private key (PEM)
--from<PATH>-The file, as a path on the coordinator
--as<DATASET_KEY>-Slug to file it under. Derived from the file name by default
--format<FORMAT>chatchat for training data, eval for a suite with expected answers
--classification<CLASSIFICATION>-Required. What this data is, in your organisation's own words
--retention-days<RETENTION_DAYS>0Delete it after this many days. Zero keeps it until removed

Notes ​

JSONL, one example per line. The coordinator records what you declared it is: it does not inspect your data to guess.

Examples ​

bash
$ diffuse-coordinator dataset import --from berichte.jsonl --as berichte --classification internal
berichte imported.
  2 412 examples, 3.1 MiB
  format    chat
  checksum  sha256:9f2c…

← diffuse-coordinator dataset · All commands

Diffuse Enterprise is commercial software. Diffuse Open is AGPL-3.0.