Rust-native Bacula File Daemon plugin engineered for HPC workloads: parallel filesystems (Lustre, GPFS / IBM Spectrum Scale, BeeGFS, CephFS, WekaFS), billion-file namespaces, Slurm/PBS job-aware scheduling and AI/ML checkpoint-aware deduplication. Replaces the FD's single-threaded walker with a work-stealing parallel walker and adds namespace sharding to saturate the HPC fabric.
What it does
- Parallel namespace walker — Work-stealing rayon walker, one worker per Lustre MDT / GPFS NSD / BeeGFS metadata target — 10-100× the metadata throughput of the stock FD.
- Namespace sharding — Shard=N/M splits the namespace into N shards (hash-of-inode or subtree pinning); N concurrent Bacula jobs yield N outbound SD streams.
- Filesystem-native incrementals — Lustre ChangeLogs, GPFS mmapplypolicy, CephFS rstats+rctime, BeeGFS metadata-shard scan — "changed since" without billion stat() calls.
- Stripe-aware reader + restripe-on-restore — Reads Lustre OSTs in parallel via llapi_layout; persists original layout as a RestoreObject and recreates striping on restore.
Differentiators
| Feature | Bacula Community alone | Bacula Enterprise / Veeam | PodHeitor |
|---|---|---|---|
| Capability available on Bacula Community | No | Yes ($$) | Yes, no extra license |
| Implementation | — | Proprietary C++ / Perl | Memory-safe Rust |
| Native observability | Limited | Limited | Prometheus + live dashboard |
| Cost | Free (no support) | $$$$ | ≥ 50% cheaper than Enterprise/Veeam |
Compatibility
- Bacula Community 15.0.3+
- Filesystems paralelos: Lustre, GPFS / IBM Spectrum Scale, BeeGFS, CephFS, WekaFS
- Orquestradores: Slurm, PBS Pro, LSF (hooks JobComp)
- Backend Rust 1.95+ (cdylib + binário backend isolado por subprocesso)
Quick install
Build remoto (Rust 1.95+) gera libpodheitor_hpc_fd.so e podheitor-hpc-backend. Copie para /opt/bacula/plugins, reinicie bacula-fd e adicione o Plugin= ao FileSet com o parâmetro Shard apropriado.Ready to switch?
Bring your Bacula Enterprise, Veeam, Commvault or NetBackup renewal or contract proposal. We guarantee at least a 50% discount with more features.
Heitor Faria · [email protected] · +1 789 726-1749 · +55 61 98268-4220 (WhatsApp)