● Public preview · 2026
SciFlow is self-hostable workflow infrastructure for life-sciences labs. Stages are Python or R. Storage is S3. Compute is wherever you run Docker. Data lands, the right pipeline runs, and the result is a citable HTML lab notebook — version-controlled, reproducible, and yours.
02 — Provenance
Every SciFlow run captures every config, every random seed, every binary SHA. The notebook you publish is the version-controlled artifact, not a screenshot of one. Re-run it next year and you can see exactly what changed in the computational environment — or confirm nothing did.
03 — Mechanism
Most workflow tools assume a human clicks run. SciFlow assumes the trigger is a file landing in S3, a webhook from an instrument, a cron tick, or the completion of an upstream workflow. Describe the workflow in plain language and you get a stage graph back. Inspect any stage and you get the figures, the numbers, and a read of what happened — checked against domain-expert-authored thresholds for that method.
04 — Catalogue
Every stage is a typed, versioned operation against named file formats. Every package ships the same automation surface: cron, file-sensor, webhook, workflow-chain.
Eleven domains across the sequencing-to-structure arc — genomics (short-read, long-read, bacterial isolate), transcriptomics (bulk & single-cell), microbiome (shotgun metagenomics & amplicon), sequence & phylogenetics, functional annotation, epigenomics, and structural biology (molecular dynamics).
05 — AI, method-grounded
Every tested package's stages carry domain-expert-authored guidance on what a good result looks like — QC thresholds, mapping-rate norms, dispersion behavior, convergence criteria. When you ask a stage what it did or why, the answer is grounded in that documented guidance, not improvised. Attach your own reference PDFs to a project and the same assistant retrieves and reasons over them too.
"Which genes are differentially expressed between airway smooth muscle cells treated with steroids vs. control?"
read_qc · FASTQ quality & adapter checksalmon_quant · transcript quantificationbulk_de · DESeq2 differential expressiongo_enrichment · pathway enrichment on hitsType the question you're trying to answer. SciFlow proposes a stage graph from the catalogue, names the inputs it expects, and shows the trigger you'd wire it to. You can edit any node before it runs.
ANTHROPIC_API_KEY or a local Ollama endpoint — wire in
whichever you run.
QC metrics, mapping rates, p-value distributions, RMSD trajectories: read against domain-expert-authored thresholds for that method, so the explanation traces to a documented standard, not a guess.
06 — Architecture
Jobs run in Docker containers — that is the entire runtime contract. Beyond that, every component is something you own and operate. Your compute, your storage, your credentials, your data — end to end. Laptop today, homelab tomorrow, K8s when you outgrow it. The notebook URL stays valid the whole way.
Workers pull jobs from a queue. Add workers, you get throughput. Remove them, you don't. The control plane is small enough to run on the same laptop that runs the first job; the worker plane scales to whatever you point it at.
Structural-biology stages (NAMD, OpenMM, AlphaFold) target your GPU workers directly. No hosted GPU billing. No queue limits set by someone else's pricing tier. Plug into the SLURM allocation you already have.
Commercially-restricted tools — NAMD, KEGG, SignalP, TMHMM — run under your license, never ours. You accept the vendor's terms, install the binary or database on your own worker, and SciFlow runs the stage against it. The licensed software is never bundled into SciFlow, copied between tenants, or redistributed. Your compliance stays clean, and the obligation stays where it belongs — with the licensee.
07 — Landscape
Self-hostable platforms (KBase, Galaxy) wait for a human to click run. General-purpose orchestrators (Airflow, Dagster, Prefect) automate fine, but know nothing about a FASTQ. Hosted clouds (Terra, DNAnexus) automate and know biology — and meter every run on their billing surface. Pipeline engines (Nextflow, nf-core) execute a DAG beautifully but don't watch for events or capture the result. SciFlow runs the same shape of workflow on infrastructure you control: your laptop, your cluster, your VPC, or a managed deployment.
| Platform | Manual | Cron | File-sensor | Webhook | Chain | Bio catalogue | Self-host | Result provenance capture |
|---|---|---|---|---|---|---|---|---|
| KBase | ● | ○ | ○ | ○ | ○ | ● | ○ | ○ |
| Galaxy | ● | partial | ○ | partial | ○ | ● | ● | ○ |
| Terra (Broad) | ● | ● | GCS only | ● | ● | ● | ○ | ○ |
| Nextflow (+nf-core) | ● | ○ | ○ | ○ | ○ | ● | ● | ○ |
| Nextflow Tower | ● | ● | ○ | ○ | ○ | ● | paid | run metadata only |
| DNAnexus | ● | ● | ● | ● | paid | ● | ○ | ○ |
| Airflow / Dagster / Prefect | ● | ● | ● | ● | ● | ○ | ● | ○ |
| SciFlow | ● | ● | ● | ● | ● | ● | ● | ● |
08 — Published lab notebooks
Six packages have a published lab notebook from a real run on a real dataset — a read-only view of the actual workflow, parameters, logs, and outputs.
09 — Contact
If you've been waiting for the reproducibility layer to show up, it's here.