nf-bigbrother / Download Trends
Total downloads:
0
Description:
A Nextflow trace observer that records the physical execution graph of a run (one node per task instance, with an edge wherever one task's output file is another task's input) and writes it out incrementally, so you can watch the graph being built while the pipeline is still running.
Nextflow's own `-with-dag` gives you the abstract process/channel graph that's known before anything runs. `nf-bigbrother` records the graph of what actually ran. After each task it writes a JSON snapshot and a matching Graphviz `.dot`, so the graph is available at every point during the run, not just at the end.
Each JSON snapshot follows a WfCommons-style layout (schemaVersion 1.5):
- `workflow.specification` holds the tasks (id, name, parents/children, input/output files) and the files with their sizes.
- `workflow.execution` holds per-task runtime, CPU, I/O and memory counters plus the machines the tasks ran on.
Parents and children come from the files: if task A writes a file that task B reads, A is a parent of B.