-
Notifications
You must be signed in to change notification settings - Fork 10.5k
[build-script] SKIP_TEST_BENCHMARK => SKIP_TEST_BENCHMARKS #16878
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[build-script] SKIP_TEST_BENCHMARK => SKIP_TEST_BENCHMARKS #16878
Conversation
@swift-ci smoke test |
Hmmm... I think I uncovered a bug. |
@@ -1398,7 +1398,7 @@ function calculate_targets_for_host() { | |||
[[ "${build_external_benchmark_this_target}" ]] && | |||
[[ "${is_in_build_list}" ]] ; then | |||
SWIFT_BENCHMARK_TARGETS+=("swift-benchmark-${stdlib_deployment_target}-external") | |||
if [[ $(not ${SKIP_TEST_BENCHMARK}) ]] ; then |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this would have been expanding to just not
, which is equivalent to false
, and then trying to substitute the result, which is if [[ "" ]]
, which is false
. @gparker42, does my shell analysis make sense?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't understand the relevance.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You're changing this code from always producing false
to actually trying to execute something. That's not your fault because the old code is very wrong, but it explains the failure.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry in my head, I had already gone beyond that. It is actually sort of funny, the reason that today we do not add something here is b/c of another hack in build-script that explicitly states that this typo is why we are doing a workaround... too bad we didn't just fix it = p.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You're going to have to fix this to get anything to work. LLVM not
takes a command name, not a value. (I think the right code here is if [[ ! "${SKIP_TEST_BENCHMARKS}" ]]
but I haven't tried it.)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is not invoking LLVM not
. This is invoking a bash function called not
defined in build-script-impl that has exactly what you described as its implementation. See:
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Beyond that do you have anything else?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh wow that's confusing. Then my earlier diagnosis of why things were failing was incorrect. Sorry for wasting your time!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You didn't waste my time! This is just confusing = p.
Specifically: 1. SKIP_TEST_BENCHMARK => SKIP_TEST_BENCHMARKS I looked for --skip-test-benchmark (notice no s) and SKIP_TEST_BENCHMARK. It seems like it is dead, especially since we have --skip-test-benchmarks. 2. Remove the code that works around SKIP_TEST_BENCHMARK typo.
75872ef
to
62adeb6
Compare
@swift-ci smoke test |
@swift-ci smoke benchmark |
@swift-ci smoke test |
@swift-ci smoke benchmark |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks reasonable to me, so long as the tests pass then it should be good to merge.
Build comment file:Optimized (O)Regression (7)
Improvement (10)
No Changes (421)
Hardware Overview
|
I looked for --skip-test-benchmark (notice no s) and SKIP_TEST_BENCHMARK. It
seems like it is dead, especially since we have --skip-test-benchmarks.