Skip to content

Disable EESSI tests in CI and make them debuggable #295

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Aug 4, 2023

Conversation

sjpb
Copy link
Collaborator

@sjpb sjpb commented Aug 2, 2023

EESSI tests are randomly failing in CI most of the time with

TASK [Run test job] ************************************************************
task path: /home/runner/work/ansible-slurm-appliance/ansible-slurm-appliance/ansible/ci/check_eessi.yml:30
fatal: [ci5747728207-login-0]: UNREACHABLE! => {
    "changed": false,
    "unreachable": true
}

MSG:

Data could not be sent to remote host "10.0.4.25". Make sure this host can be reached over ssh: 

The host is reachable, and nothing shows in logs to drop the connection. They work fine when run against a cluster manually.

This PR disables these tests in CI, and changes the test to run via sbatch so that test output is available (via Ansible output on success, or via ssh to the cluster if Ansible fails).

@sjpb sjpb closed this Aug 2, 2023
@sjpb sjpb reopened this Aug 2, 2023
@sjpb sjpb force-pushed the fix/eessi-tests branch from d734f53 to 307f5ba Compare August 3, 2023 07:11
@sjpb sjpb changed the title Prevent EESSI tests timing out in CI Disable EESSI tests in CI and make them debuggable Aug 3, 2023
@sjpb
Copy link
Collaborator Author

sjpb commented Aug 3, 2023

Note c91c8ed above passed CI twice, but it takes a long time (1h55,1h45).

@sjpb
Copy link
Collaborator Author

sjpb commented Aug 3, 2023

054d287 failed in EESII tests, as before

@sjpb sjpb marked this pull request as ready for review August 3, 2023 19:19
@sjpb sjpb requested a review from a team as a code owner August 3, 2023 19:19
@sjpb sjpb requested a review from sd109 August 3, 2023 19:20
Copy link
Member

@sd109 sd109 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for now, let me know if I can help with debugging the underlying issue later down the line.

@sjpb sjpb merged commit 8c035d7 into fix/jupyter Aug 4, 2023
@sjpb sjpb deleted the fix/eessi-tests branch August 4, 2023 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants