Blog
deisa-dask v0.7.1 : Bringing Computation Closer to the Simulation
Introduction deisa-dask connects MPI-based simulations to the Dask distributed runtime, allowing analysis callbacks to operate on simulation data without requiring the application to manage the Dask execution model. This integration relies on reconstructing global Dask arrays from data distributed across MPI ranks. That reconstruction depends on knowing where each rank’s local chunk belongs in the global array. Recent changes address several issues in this part of deisa-dask: a collective communication deadlock during bridge initialization, incorrect reconstruction of uneven chunk distributions, and the need to provide chunk positions explicitly even when the MPI communicator already contains enough information to derive them.
November 18, 2026
deisa-dask v0.7.0 : Bringing Computation Closer to the Simulation
We are pleased to announce deisa-dask 0.7.0, an important release introducing new capabilities for in-situ analytics in HPC simulations. This release focuses on an important challenge in simulation-analytics coupling: moving large amounts of simulation data to an analytics infrastructure can become expensive, even when the analysis itself is relatively simple. Many operations, such as computing sums, means, or variances, do not actually require the complete dataset to leave the simulation processes.
November 6, 2026
deisa-dask v0.6.3 : Fixing Per-Array MPI Communicators Creation Order
deisa-dask 0.6.3: Improved Reliability, Better MPI Support, and New Performance BenchmarksWe’re pleased to announce deisa-dask 0.6.3, a release focused on improving robustness and developer experience. While this release does not introduce major API changes, it significantly strengthens the runtime by improving callback execution, fixing several concurrency issues, expanding MPI compatibility, and introducing new benchmarking tools. More reliable callback execution One of the primary goals of this release was to make callback execution more predictable.
July 29, 2026
deisa-dask v0.6.2 : Fixing Per-Array MPI Communicators Creation Order
Fixing Array Sub-Communicator Creation in deisa-daskOne of the design goals of deisa-dask is to make distributed data exchange transparent, even when different MPI ranks publish different arrays. Internally, this requires the bridge to create a dedicated MPI sub-communicator for every global array. A small assumption in that setup process recently turned into a subtle bug. This update fixes it. The Problem When the bridge starts, each MPI rank advertises the arrays it owns. The bridge then gathers this information to build the global set of array names before creating one MPI sub-communicator per array.
July 9, 2026
deisa-dask v0.6.1 : Fixing Supporting for Per-Array MPI Communicators
Supporting Arrays That Don’t Live EverywhereWhen deisa-dask was first designed, it assumed that every distributed array involved the same set of MPI processes. That is true for many simulation codes, where each rank owns a piece of every field. Real applications, however, are often more heterogeneous. Some variables may only exist on a subset of MPI ranks. Others may be generated by a single process, or only by a particular computational component. Treating every array as if it were distributed across the entire communicator unnecessarily restricts these use cases.
July 8, 2026
deisa-dask v0.6.0 : Supporting Per-Array MPI Communicators
We’re excited to announce the latest update to deisa-dask. This release introduces a significant improvement to the deisa runtime: support for non-distributed arrays, making it easier to combine local and distributed data within the same in situ workflow. Alongside this new capability, we’ve also launched a dedicated documentation website with a step-by-step getting started guide, API reference, and project documentation. Supporting Arbitrary MPI Communicators Previous versions of deisa-dask assumed that every distributed array was partitioned across all MPI ranks participating in the simulation. While this matches many HPC applications, it is not always the most natural way to organize data.
July 6, 2026
deisa-dask v0.5.1
deisa-dask v0.5.1 is a patch release that introduces the following changes: In CI, unit tests now run in parallel using pytest-xdist When sending data using the Bridge, the chunk position is now read from arrays_metadata codemeta.json is added to the repository root to be referenced in the NumPEx software catalogue setup.py is replaced by pyproject.toml Bugfix: data could go missing (garbage collected by the scheduler) in certain cases
June 22, 2026