Merge Stackhpc work

[sjpb]

Rolled up merges for PRs below. Have been merged here first to provide a total diff against prod2312 branch before applying.

TODO

• Check state volume size is appropriate
• Check openhpc config doesn't clash - this has been moved around a bit
• Remove os_manila_mount* config (in unpushed commit)
• Update openhpc role branch, now RL9 support has merged to main
• Test in lab

PRs

#19

#20

Requires a volume with name ${var.cluster_name}-state to be manually created for prod and vtest environments.

• With ~165 hosts this should probably be ~300GB

#23

Run terraform apply; terraform will destroy the openstack_networking_floatingip_v2. The FIP will be released from the project and the fixed to floating IP associations will be lost - but terraform will not error on this.
Add the FIPs back into the project manually.
Run terraform apply again. The FIPs will be reassociated with the fixed IPs.

#24

This modifies galaxy-installed roles so ./dev/setup-env.sh must be run to pull them in.

#25

This modifies galaxy-installed roles so ./dev/setup-env.sh must be run to pull them in.

#26

IMPORTANT: The ansible/roles/opensearch/tasks/migrate-opendistro.yml migration playbook only runs automatically when migrating a live system. It won't work after a rebuild as there will be no opendistro unit file. So we should migrate data manually before running site.yml.