Missing zarr

[landmanbester]

I don't see zarr as a dependency anywhere but you do need it for this call

suricat-beams/suricat-beams/suricat/beams.py

Line 162 in b5a3127

xds.to_zarr(bds, mode="w")

This is what pip freeze shows in the latest singularity container

Singularity> pip freeze
WARNING: The directory '/var/cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you should use sudo's -H flag.
antlr4-python3-runtime==4.9.3
appdirs==1.4.4
astro-kittens==1.4.6
astro-pyxis==1.7.6
astro-tigger-lsm==1.8.0
astroplan==0.10.1
astropy==6.1.7
astropy-iers-data==0.2025.5.12.0.38.29
bokeh==3.7.3
click==8.1.8
cloudpickle==3.1.1
configparser==7.2.0
contourpy==1.3.2
cycler==0.12.1
dask==2024.10.0
dask-ms==0.2.23
dill==0.3.9
donfig==0.8.1.post1
fonttools==4.58.0
fsspec==2024.12.0
future==1.0.0
future-fstrings==1.2.0
importlib_metadata==8.7.0
Jinja2==3.1.6
katbeam==0.1
kittens==0.1.2
kiwisolver==1.4.8
locket==1.0.0
markdown-it-py==3.0.0
MarkupSafe==3.0.2
matplotlib==3.10.3
mdurl==0.1.2
meqtrees_cattery==1.7.9
msutils==1.2.0
munch==2.5.0
narwhals==1.39.0
numpy==2.2.5
omegaconf==2.3.0
owlcat==1.7.9
packaging==24.2
pandas==2.2.3
partd==1.4.2
pillow==11.2.1
psutil==5.9.8
purr==1.5.3
pydantic==1.10.21
pyerfa==2.0.1.5
Pygments==2.19.1
pyparsing==3.2.3
python-casacore==3.7.1
python-dateutil==2.9.0.post0
pytz==2025.2
PyYAML==6.0.2
regions==0.10
rich==13.9.4
scipy==1.15.3
six==1.17.0
stimela==2.1.post1
suricat-beams @ git+https://github.com/ratt-ru/suricat-beams.git@b5a3127aa43e2df946ae7bd60c5a50de72b9301f
toolz==1.0.0
tornado==6.4.2
typeguard==4.4.2
typing_extensions==4.13.2
tzdata==2025.2
uv==0.6.11
wget==3.2
xarray==2024.11.0
xarray-fits==0.2.5
xyzservices==2025.4.0
zipp==3.21.0

[o-smirnov]

Damn, how did I miss that. What's the dependency exactly, just zarr = '*'?

[landmanbester]

That should suffice but it's usually bundled with dask-ms[zarr]. I don't even see dask-ms in your pyproject.toml. Is there a default image you are using to build this on top of? Might be worth adding dask-ms[xarray,zarr,s3] to that if so

[landmanbester]

Damn, how did I miss that

Uh-uhm, tests?

[o-smirnov]

Tests? You're the integration test, and a damn good one. 🤣

This doesn't use dask-ms and I didn't want to put it into the default python-astro image though I'm open to arguments otherwise.

[landmanbester]

This doesn't use dask-ms and I didn't want to put it into the default python-astro image though I'm open to arguments otherwise.

Curious that it is pulled into the container in that case. pipdetree suggests it's pulled in by msutils

msutils==1.2.0
├── numpy [required: Any, installed: 2.2.5]
├── scipy [required: Any, installed: 1.15.3]
│   └── numpy [required: >=1.23.5,<2.5, installed: 2.2.5]
├── matplotlib [required: Any, installed: 3.10.3]
│   ├── contourpy [required: >=1.0.1, installed: 1.3.2]
│   │   └── numpy [required: >=1.23, installed: 2.2.5]
│   ├── cycler [required: >=0.10, installed: 0.12.1]
│   ├── fonttools [required: >=4.22.0, installed: 4.58.0]
│   ├── kiwisolver [required: >=1.3.1, installed: 1.4.8]
│   ├── numpy [required: >=1.23, installed: 2.2.5]
│   ├── packaging [required: >=20.0, installed: 24.2]
│   ├── pillow [required: >=8, installed: 11.2.1]
│   ├── pyparsing [required: >=2.3.1, installed: 3.2.3]
│   └── python-dateutil [required: >=2.7, installed: 2.9.0.post0]
│       └── six [required: >=1.5, installed: 1.17.0]
├── dask-ms [required: Any, installed: 0.2.23]
│   ├── appdirs [required: >=1.4.4,<2.0.0, installed: 1.4.4]
│   ├── dask [required: >=2023.1.1,<2024.11.0, installed: 2024.10.0]
│   │   ├── click [required: >=8.1, installed: 8.1.8]
│   │   ├── cloudpickle [required: >=3.0.0, installed: 3.1.1]
│   │   ├── fsspec [required: >=2021.09.0, installed: 2024.12.0]
│   │   ├── packaging [required: >=20.0, installed: 24.2]
│   │   ├── partd [required: >=1.4.0, installed: 1.4.2]
│   │   │   ├── locket [required: Any, installed: 1.0.0]
│   │   │   └── toolz [required: Any, installed: 1.0.0]
│   │   ├── PyYAML [required: >=5.3.1, installed: 6.0.2]
│   │   ├── toolz [required: >=0.10.0, installed: 1.0.0]
│   │   └── importlib_metadata [required: >=4.13.0, installed: 8.7.0]
│   │       └── zipp [required: >=3.20, installed: 3.21.0]
│   ├── donfig [required: >=0.8.0, installed: 0.8.1.post1]
│   │   └── PyYAML [required: Any, installed: 6.0.2]
│   ├── fsspec [required: >=2022.7.0, installed: 2024.12.0]
│   ├── numpy [required: >=2.0.0, installed: 2.2.5]
│   └── python-casacore [required: >=3.6.1,<4.0.0, installed: 3.7.1]
│       └── numpy [required: Any, installed: 2.2.5]
└── bokeh [required: Any, installed: 3.7.3]
    ├── Jinja2 [required: >=2.9, installed: 3.1.6]
    │   └── MarkupSafe [required: >=2.0, installed: 3.0.2]
    ├── contourpy [required: >=1.2, installed: 1.3.2]
    │   └── numpy [required: >=1.23, installed: 2.2.5]
    ├── narwhals [required: >=1.13, installed: 1.39.0]
    ├── numpy [required: >=1.16, installed: 2.2.5]
    ├── packaging [required: >=16.8, installed: 24.2]
    ├── pandas [required: >=1.2, installed: 2.2.3]
    │   ├── numpy [required: >=1.23.2, installed: 2.2.5]
    │   ├── python-dateutil [required: >=2.8.2, installed: 2.9.0.post0]
    │   │   └── six [required: >=1.5, installed: 1.17.0]
    │   ├── pytz [required: >=2020.1, installed: 2025.2]
    │   └── tzdata [required: >=2022.7, installed: 2025.2]
    ├── pillow [required: >=7.1.0, installed: 11.2.1]
    ├── PyYAML [required: >=3.10, installed: 6.0.2]
    ├── tornado [required: >=6.2, installed: 6.4.2]
    └── xyzservices [required: >=2021.09.1, installed: 2025.4.0]