Overview
Data Hub automatically ingests, processes, and visualizes data generated by scientific instruments in the lab. Start here to install the watcher, manage access, and onboard instruments.
Data Hub is a platform for automatically ingesting, processing, and visualizing data generated by scientific instruments in the lab. It's self-hosted, so you can deploy it on your own infrastructure and keep your data private. And it's open source, so you can fork it and customize it to your needs.
Because Data Hub is self-hosted, your team runs the backend (a PostgreSQL database, the web app on Vercel, and AWS S3 plus Lambda) before anyone can sign in or install a watcher. The step-by-step setup guide lives in the data-hub developer docs.
How it works
- A Python service called the watcher monitors a directory on the instrument PC for new files (e.g.
*.csvfiles in theC:\Datadirectory with prefixRUN-). - Incoming files are grouped into runs based on your configured patterns (e.g.
Experiment-<date>-<time>.csvandExperiment-<date>-<time>.jsonget grouped into a run calledRUN-2026-07-06-12-00-00). - The web app makes instrument runs and files available in a dashboard, with optional automated preprocessing for supported instruments (e.g. Spectra-physics near-infrared (NIR) spectrometers).
Find your path
Data Hub serves three audiences. Jump to the section that fits what you're doing.
Quickstart
Lab operators: install the watcher and get your first files uploading.
Administration
Admins: confirm instruments, manage the watcher fleet, and issue access tokens.
Reference
Every CLI command, config field, and API endpoint in one place.
Self-hosting
Engineers: stand up the self-hosted backend: database, web app, and AWS infrastructure. Step-by-step guide in the data-hub developer docs.
Reading these docs with AI
Every page has a Copy Markdown button and a View Options menu at the top, plus an Ask AI widget. Use them to:
- Copy a page as clean Markdown to paste into an AI assistant.
- Open the raw Markdown (
/docs/<path>.md) or the whole-site dumps at/docs/llms.txtand/docs/llms-full.txt. - Ask a question in natural language and get an answer grounded in this documentation.