[ci] Port anyscale image builds to Wanda pipeline

[andrew-anyscale]

Replace Docker-based anyscale image builds with Wanda-based approach.

Images are now built using Wanda configs and published using crane via push_anyscale_image script.

Pipeline changes:

• Add Wanda build steps for ray-anyscale (cpu/cuda), ray-llm-anyscale, and ray-ml-anyscale images
• Add wheel build dependencies (ray-core, ray-dashboard, ray-java, ray-wheel)
• Update publish steps to use push_anyscale_image with GCP/Azure auth

Topic: anyscale-image
Relative: push-anyscale-wanda
Signed-off-by: andrew andrew@anyscale.com

[andrew-anyscale]

Reviews in this chain:
└#60793 [ci] refactor push_ray_image shared functions to image_tags_lib
　└#60796 [ci] Add push_anyscale_image to push wanda anyscale images
　　└#59937 [ci] Port anyscale image builds to Wanda pipeline

[andrew-anyscale]

#	head	base	diff	date	summary
0	f963b425	f104bf59	diff	Jan 7 7:57 AM	8 files changed, 553 insertions(+), 24 deletions(-)
1	07109714	288cadb6	diff	Jan 7 7:58 AM	0 files changed
2	4cdb2dd9	46cc8625	diff	Jan 7 8:38 AM	2 files changed, 238 insertions(+), 5 deletions(-)
3	f65669a5	70df7561	rebase	Jan 7 11:29 AM	0 files changed
4	11418977	ae32d45a	rebase	Jan 7 12:21 PM	0 files changed
5	af3b600e	04cfd26a	rebase	Jan 7 17:29 PM	0 files changed
6	6bbeb9e4	55d1473f	rebase	Jan 7 17:31 PM	0 files changed
7	1f049e81	84d74797	diff	Jan 8 8:27 AM	2 files changed, 12 insertions(+), 12 deletions(-)
8	d43ccd7f	c275fe24	rebase	Jan 8 8:32 AM	0 files changed
9	8980d9ce	7c78fa2d	rebase	Jan 8 12:01 PM	0 files changed
10	4a143b7a	29cf5abd	rebase	Jan 8 12:51 PM	0 files changed
11	9243672a	d566c8a8	rebase	Jan 8 13:16 PM	0 files changed
12	8c684c8e	91900297	rebase	Jan 8 13:33 PM	0 files changed
13	826bac0f	73822f53	rebase	Jan 8 14:30 PM	0 files changed
14	ebdca80e	94805e95	rebase	Jan 9 8:45 AM	0 files changed
15	35249bf7	fc79d67d	rebase	Jan 9 10:01 AM	0 files changed
16	0e1bd8b1	db94f935	rebase	Jan 9 10:59 AM	0 files changed
17	5de31a90	05c06707	rebase	Jan 9 12:36 PM	0 files changed
18	a96c770e	a6718508	rebase	Jan 9 13:32 PM	0 files changed
19	47087a0b	51fe33a5	rebase	Jan 13 8:55 AM	0 files changed
20	5b7b8097	ed74c8c7	rebase	Jan 13 10:55 AM	0 files changed
21	827515b8	6242ab25	rebase	Jan 13 15:50 PM	0 files changed
22	c290dfca	a941fd54	rebase	Jan 13 15:50 PM	0 files changed
23	da45cd89	9db9513a	rebase	Jan 13 17:03 PM	0 files changed
24	79224a60	6d4a0beb	rebase	Jan 13 17:09 PM	0 files changed
25	3123fe23	dd5133b8	rebase	Jan 13 17:09 PM	0 files changed
26	a57ba933	ae00964a	rebase	Jan 13 17:12 PM	0 files changed
27	abd456d2	021b2e13	rebase	Jan 13 17:14 PM	0 files changed
28	2dc9e7bb	52b7b213	rebase	Jan 13 17:33 PM	0 files changed
29	5e859eea	8cfa977c	rebase	Jan 13 21:52 PM	0 files changed
30	dc8bd484	924d46f1	rebase	Jan 15 13:10 PM	0 files changed
31	fc711fb0	275827a2	rebase	Jan 15 13:13 PM	0 files changed
32	acdfe07a	04d68065	rebase	Jan 15 13:14 PM	0 files changed
33	50ffff8a	6e985e93	rebase	Jan 15 13:40 PM	0 files changed
34	b07e1394	17d793f4	rebase	Jan 15 13:47 PM	0 files changed
35	77436f88	716cc651	rebase	Jan 15 16:04 PM	0 files changed
36	71b04f1e	976be9fb	rebase	Jan 15 16:48 PM	0 files changed
37	ebae2c55	f4e1306c	diff	Jan 15 17:41 PM	5 files changed, 12 insertions(+), 8 deletions(-)
38	96eb30f9	73da8387	rebase	Jan 15 18:02 PM	0 files changed
39	21fb1ca1	c547d3f5	rebase	Jan 16 9:22 AM	0 files changed
40	ebe89619	1f64272b	rebase	Jan 16 13:28 PM	0 files changed
41	b300d537	a6bdfece	rebase	Jan 16 14:05 PM	0 files changed
42	cdc64549	6a668ed7	diff	Jan 20 10:30 AM	4 files changed, 12 insertions(+), 11 deletions(-)
43	76c20e1b	54ca98e5	rebase	Jan 20 11:57 AM	0 files changed
44	14ef5914	54ca98e5	diff	Jan 21 9:31 AM	1 file changed, 1 insertion(+)
45	c52a914b	7395a7db	rebase	Jan 22 11:14 AM	0 files changed
46	abfa8ae4	3a35fdb6	diff	Jan 23 8:54 AM	0 files changed
47	01e11758	1d0a962d	rebase	Jan 26 9:02 AM	0 files changed
48	dc05f898	1960a8e6	rebase	Jan 27 9:45 AM	0 files changed
49	a26a857e	6cfc4e79	rebase	Jan 27 9:48 AM	0 files changed
50	0078ae15	d1a8111b	rebase	Jan 27 9:50 AM	0 files changed
51	a32f66a4	d1a8111b	diff	Jan 27 10:30 AM	1 file changed, 4 insertions(+), 4 deletions(-)
52	6dd8afe4	d1a8111b	diff	Jan 27 10:34 AM	1 file changed, 4 insertions(+), 4 deletions(-)
53	0f670ad3	a4fe1e01	rebase	Jan 27 13:56 PM	0 files changed
54	6db377cc	8ed4a6d1	diff	Jan 29 16:22 PM	0 files changed
55	5680742f	2d70aa81	rebase	Jan 29 16:45 PM	0 files changed
56	d13645ee	869f34fb	rebase	Jan 29 16:47 PM	0 files changed
57	ec462b6f	536ab35d	rebase	Jan 29 17:00 PM	0 files changed
58	01cda557	2abbbc5e	rebase	Jan 29 17:51 PM	0 files changed
59	31e56883	45cd1ae4	rebase	Jan 29 18:33 PM	0 files changed
60	31bfca41	6ed02db2	rebase	Jan 29 21:00 PM	0 files changed
61	c3c66a7e	e4774330	rebase	Jan 29 21:03 PM	0 files changed
62	f29c01a9	ad559443	rebase	Jan 29 21:20 PM	0 files changed
63	bb496100	c663c716	rebase	Jan 30 8:58 AM	0 files changed
64	4925f4dc	5af6a2b9	rebase	Jan 30 9:07 AM	0 files changed
65	ecb1a4dc	907e1ec1	rebase	Jan 30 10:19 AM	0 files changed
66	6cbf9297	f2086dc7	rebase	Jan 30 10:41 AM	0 files changed
67	4d3a7202	b66d7595	rebase	Jan 30 10:46 AM	0 files changed
68	38349f2b	2fb5892f	rebase	Jan 30 10:58 AM	0 files changed
69	b0970de2	efba4b0f	rebase	Jan 30 10:59 AM	0 files changed
70	f9436df2	cba45eb4	rebase	Jan 30 12:22 PM	0 files changed
71	9f283393	ba9c8603	diff	Jan 30 13:28 PM	1 file changed, 14 insertions(+), 16 deletions(-)
72	8eb71d4c	fc730b06	rebase	Jan 30 13:31 PM	0 files changed
73	dcd26201	1609eac2	rebase	Jan 30 13:58 PM	0 files changed
74	dcd26201	1609eac2	diff	Jan 30 13:59 PM	0 files changed
75	e4ba419d	1609eac2	diff	Jan 30 14:01 PM	1 file changed, 7 insertions(+), 25 deletions(-)
76	bfbedb45	1609eac2	diff	Jan 30 14:04 PM	2 files changed, 12 insertions(+), 5 deletions(-)
77	3fc8d89f	7fe9ae2b	rebase	Jan 30 14:21 PM	0 files changed
78	2becfe0c	0ec84ea3	diff	Jan 30 15:13 PM	2 files changed, 21 insertions(+), 36 deletions(-)
79	bda71c76	0ec84ea3	diff	Jan 30 17:25 PM	2 files changed, 10 insertions(+), 6 deletions(-)
80	436f981d	ea2ca724	diff	Jan 30 17:26 PM	0 files changed
81	c3f92d33	338037a4	rebase	Feb 3 7:47 AM	0 files changed
82	c6d75f5c	4129c6eb	rebase	Feb 3 14:28 PM	0 files changed
83	bc74e0d4	356559a9	rebase	Feb 3 15:27 PM	0 files changed
84	fcda219f	ef0f4bb7	rebase	Feb 5 13:19 PM	0 files changed
85	0ec46b18	ed98abef	diff	Feb 5 16:51 PM	4 files changed, 592 insertions(+), 204 deletions(-)
86	73ffe554	cb233f58	diff	Feb 5 18:18 PM	2 files changed, 2 insertions(+), 4 deletions(-)

[gemini-code-assist]

Code Review

This pull request refactors the Anyscale image build process to use Wanda for building and a new Python script for pushing images to multiple registries. The changes include new Wanda configuration files, the push_anyscale_image.py script, and updates to the Buildkite pipeline. My review identifies a few critical issues that will break the build, including a missing file in a Bazel target and an incomplete matrix configuration in the pipeline. I've also provided several suggestions to improve maintainability by reducing code duplication and making parts of the new script less brittle.

[cursor]

Missing empty platform alias for ray-ml images

High Severity

The _get_image_tags() function doesn't accept image_type as a parameter and therefore cannot generate the empty platform alias tag for ray-ml images. The original docker_container.py code adds an empty platform tag ("") for ray-ml images when using GPU_PLATFORM, producing tags like 123456-py310 (without platform suffix). The new implementation only generates -cu121 and -gpu tags, missing this alias that release tests depend on.

 

[cursor]

Duplicated GPU_PLATFORM constant should be imported

Medium Severity

GPU_PLATFORM = "cu12.1.1-cudnn8" is duplicated here, but this constant already exists in ci/ray_ci/docker_container.py and is already imported by the sibling file push_ray_image.py. This should be imported from docker_container rather than redefined.

 

[cursor]

Cursor Bugbot has reviewed your changes and found 1 potential issue.

[cursor]

Missing empty platform alias tags for ray-ml images

High Severity

The _get_image_tags function is missing the empty platform alias logic that exists in the original AnyscaleDockerContainer and docker_tags_lib.py. For ray-ml images with GPU_PLATFORM, the old code generates three platform tags: -cu121, -gpu, and an empty suffix (just version-pyXX). The new code only generates -cu121 and -gpu. The test in test_anyscale_docker_container.py expects tags like 123456-py310 (no platform suffix) for ray-ml images, which will be missing with the new implementation.

 

[andrew-anyscale]

Moving to draft while I perform a refactor to reduce on overlap with push_ray_image

EDIT: done.