Skip to content

[build-script] SKIP_TEST_BENCHMARK => SKIP_TEST_BENCHMARKS #16878

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

gottesmm
Copy link
Contributor

I looked for --skip-test-benchmark (notice no s) and SKIP_TEST_BENCHMARK. It
seems like it is dead, especially since we have --skip-test-benchmarks.

@gottesmm gottesmm requested review from Rostepher and jrose-apple May 29, 2018 03:22
@gottesmm
Copy link
Contributor Author

@swift-ci smoke test

@gottesmm
Copy link
Contributor Author

Hmmm... I think I uncovered a bug.

@@ -1398,7 +1398,7 @@ function calculate_targets_for_host() {
[[ "${build_external_benchmark_this_target}" ]] &&
[[ "${is_in_build_list}" ]] ; then
SWIFT_BENCHMARK_TARGETS+=("swift-benchmark-${stdlib_deployment_target}-external")
if [[ $(not ${SKIP_TEST_BENCHMARK}) ]] ; then
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this would have been expanding to just not, which is equivalent to false, and then trying to substitute the result, which is if [[ "" ]], which is false. @gparker42, does my shell analysis make sense?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't understand the relevance.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're changing this code from always producing false to actually trying to execute something. That's not your fault because the old code is very wrong, but it explains the failure.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry in my head, I had already gone beyond that. It is actually sort of funny, the reason that today we do not add something here is b/c of another hack in build-script that explicitly states that this typo is why we are doing a workaround... too bad we didn't just fix it = p.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're going to have to fix this to get anything to work. LLVM not takes a command name, not a value. (I think the right code here is if [[ ! "${SKIP_TEST_BENCHMARKS}" ]] but I haven't tried it.)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not invoking LLVM not. This is invoking a bash function called not defined in build-script-impl that has exactly what you described as its implementation. See:

https://github.com/apple/swift/blob/9aca727949f1338cb04855bca32e540acf998cf0/utils/build-script-impl#L962

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Beyond that do you have anything else?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh wow that's confusing. Then my earlier diagnosis of why things were failing was incorrect. Sorry for wasting your time!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You didn't waste my time! This is just confusing = p.

Specifically:

1. SKIP_TEST_BENCHMARK => SKIP_TEST_BENCHMARKS

I looked for --skip-test-benchmark (notice no s) and SKIP_TEST_BENCHMARK. It
seems like it is dead, especially since we have --skip-test-benchmarks.

2. Remove the code that works around SKIP_TEST_BENCHMARK typo.
@gottesmm gottesmm force-pushed the pr-aaef324649673b4468c77d0457c627ecd9d7f743 branch from 75872ef to 62adeb6 Compare May 30, 2018 21:22
@gottesmm
Copy link
Contributor Author

@swift-ci smoke test

@gottesmm
Copy link
Contributor Author

@swift-ci smoke benchmark

@gottesmm
Copy link
Contributor Author

@swift-ci smoke test

@gottesmm
Copy link
Contributor Author

@swift-ci smoke benchmark

Copy link
Contributor

@Rostepher Rostepher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks reasonable to me, so long as the tests pass then it should be good to merge.

@swift-ci
Copy link
Contributor

Build comment file:

Optimized (O)

Regression (7)
TEST OLD NEW DELTA SPEEDUP
CharIndexing_utf16_unicodeScalars_Backwards 23610 27430 +16.2% 0.86x (?)
PopFrontUnsafePointer 8762 9549 +9.0% 0.92x (?)
ObjectiveCBridgeFromNSArrayAnyObject 24095 26017 +8.0% 0.93x
DataAppendDataSmallToSmall 5703 6132 +7.5% 0.93x (?)
DataCopyBytes 430 454 +5.6% 0.95x (?)
DataAppendArray 5270 5562 +5.5% 0.95x (?)
ObjectiveCBridgeStubFromArrayOfNSString 33116 34876 +5.3% 0.95x (?)
Improvement (10)
TEST OLD NEW DELTA SPEEDUP
DictionaryKeysContainsNative 42 32 -23.8% 1.31x (?)
DictionaryKeysContainsCocoa 50 40 -20.0% 1.25x (?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 5350 4606 -13.9% 1.16x (?)
DataAppendDataSmallToLarge 42162 37335 -11.4% 1.13x (?)
FloatingPointPrinting_Float_interpolated 44516 40079 -10.0% 1.11x
DataReplaceMediumBuffer 12178 11041 -9.3% 1.10x (?)
DataAppendDataMediumToMedium 7336 6781 -7.6% 1.08x
StringBuilderWithLongSubstring 1569 1455 -7.3% 1.08x (?)
DropLastAnySeqCntRange 14 13 -7.1% 1.08x
StringUTF16SubstringBuilder 6108 5675 -7.1% 1.08x (?)
No Changes (421)
TEST OLD NEW DELTA SPEEDUP
AngryPhonebook 4115 4113 -0.0% 1.00x (?)
AnyHashableWithAClass 86724 86794 +0.1% 1.00x (?)
Array2D 2857 2857 +0.0% 1.00x
ArrayAppend 1082 1081 -0.1% 1.00x (?)
ArrayAppendArrayOfInt 797 796 -0.1% 1.00x (?)
ArrayAppendAscii 3887 3942 +1.4% 0.99x (?)
ArrayAppendAsciiSubstring 24257 24237 -0.1% 1.00x (?)
ArrayAppendFromGeneric 798 800 +0.3% 1.00x (?)
ArrayAppendGenericStructs 1427 1425 -0.1% 1.00x (?)
ArrayAppendLatin1 41419 41451 +0.1% 1.00x (?)
ArrayAppendLatin1Substring 141739 141836 +0.1% 1.00x (?)
ArrayAppendLazyMap 1340 1339 -0.1% 1.00x (?)
ArrayAppendOptionals 1423 1426 +0.2% 1.00x (?)
ArrayAppendRepeatCol 1336 1337 +0.1% 1.00x (?)
ArrayAppendReserved 812 812 +0.0% 1.00x
ArrayAppendSequence 1126 1119 -0.6% 1.01x (?)
ArrayAppendStrings 6214 6228 +0.2% 1.00x (?)
ArrayAppendToFromGeneric 797 800 +0.4% 1.00x (?)
ArrayAppendToGeneric 796 798 +0.3% 1.00x (?)
ArrayAppendUTF16 41310 41435 +0.3% 1.00x
ArrayAppendUTF16Substring 139785 139931 +0.1% 1.00x (?)
ArrayInClass 86 86 +0.0% 1.00x
ArrayLiteral 0 0 +0.0% 1.00x
ArrayOfGenericPOD2 151 152 +0.7% 0.99x
ArrayOfGenericRef 4411 4435 +0.5% 0.99x (?)
ArrayOfPOD 184 184 +0.0% 1.00x
ArrayOfRef 4388 4394 +0.1% 1.00x (?)
ArrayPlusEqualArrayOfInt 798 794 -0.5% 1.01x (?)
ArrayPlusEqualFiveElementCollection 5451 5453 +0.0% 1.00x (?)
ArrayPlusEqualSingleElementCollection 1084 1080 -0.4% 1.00x
ArrayPlusEqualThreeElements 1662 1656 -0.4% 1.00x (?)
ArraySubscript 1522 1520 -0.1% 1.00x (?)
ArrayValueProp 8 8 +0.0% 1.00x
ArrayValueProp2 8 8 +0.0% 1.00x
ArrayValueProp3 8 8 +0.0% 1.00x
ArrayValueProp4 8 8 +0.0% 1.00x
BinaryFloatingPointPropertiesBinade 31 31 +0.0% 1.00x
BinaryFloatingPointPropertiesNextUp 28 28 +0.0% 1.00x
BinaryFloatingPointPropertiesUlp 37 37 +0.0% 1.00x
BitCount 209 211 +1.0% 0.99x
ByteSwap 105 105 +0.0% 1.00x
COWArrayGuaranteedParameterOverhead 10266 9893 -3.6% 1.04x (?)
COWTree 5320 5259 -1.1% 1.01x (?)
CSVParsing 662222 657772 -0.7% 1.01x (?)
CSVParsingAlt 800402 809870 +1.2% 0.99x
CSVParsingAltIndices 343186 342201 -0.3% 1.00x (?)
CStringLongAscii 4208 4210 +0.0% 1.00x (?)
CStringLongNonAscii 2440 2439 -0.0% 1.00x (?)
CStringShortAscii 3364 3354 -0.3% 1.00x (?)
Calculator 317 316 -0.3% 1.00x
CaptureProp 4108 4117 +0.2% 1.00x (?)
ChainedFilterMap 1246 1248 +0.2% 1.00x (?)
CharIndexing_ascii_unicodeScalars 17300 17741 +2.5% 0.98x (?)
CharIndexing_ascii_unicodeScalars_Backwards 17169 16764 -2.4% 1.02x (?)
CharIndexing_chinese_unicodeScalars 12891 13003 +0.9% 0.99x (?)
CharIndexing_chinese_unicodeScalars_Backwards 12375 12329 -0.4% 1.00x (?)
CharIndexing_japanese_unicodeScalars 20329 20306 -0.1% 1.00x
CharIndexing_japanese_unicodeScalars_Backwards 19516 19508 -0.0% 1.00x (?)
CharIndexing_korean_unicodeScalars 16439 16515 +0.5% 1.00x (?)
CharIndexing_korean_unicodeScalars_Backwards 15775 15886 +0.7% 0.99x (?)
CharIndexing_punctuatedJapanese_unicodeScalars 3062 3065 +0.1% 1.00x
CharIndexing_punctuatedJapanese_unicodeScalars_Backwards 2967 2966 -0.0% 1.00x (?)
CharIndexing_punctuated_unicodeScalars 3832 3831 -0.0% 1.00x (?)
CharIndexing_punctuated_unicodeScalars_Backwards 3702 3782 +2.2% 0.98x (?)
CharIndexing_russian_unicodeScalars 14244 14131 -0.8% 1.01x (?)
CharIndexing_russian_unicodeScalars_Backwards 13675 13928 +1.9% 0.98x (?)
CharIndexing_tweet_unicodeScalars 32750 32724 -0.1% 1.00x (?)
CharIndexing_tweet_unicodeScalars_Backwards 34499 33494 -2.9% 1.03x (?)
CharIndexing_utf16_unicodeScalars 23620 23953 +1.4% 0.99x (?)
CharIteration_ascii_unicodeScalars 21452 21463 +0.1% 1.00x (?)
CharIteration_ascii_unicodeScalars_Backwards 14982 14986 +0.0% 1.00x (?)
CharIteration_chinese_unicodeScalars 16236 16226 -0.1% 1.00x (?)
CharIteration_chinese_unicodeScalars_Backwards 11342 11343 +0.0% 1.00x (?)
CharIteration_japanese_unicodeScalars 25692 25686 -0.0% 1.00x (?)
CharIteration_japanese_unicodeScalars_Backwards 17945 17921 -0.1% 1.00x
CharIteration_korean_unicodeScalars 20829 20816 -0.1% 1.00x (?)
CharIteration_korean_unicodeScalars_Backwards 14530 14518 -0.1% 1.00x
CharIteration_punctuatedJapanese_unicodeScalars 3824 3824 +0.0% 1.00x
CharIteration_punctuatedJapanese_unicodeScalars_Backwards 2720 2719 -0.0% 1.00x (?)
CharIteration_punctuated_unicodeScalars 4802 4825 +0.5% 1.00x
CharIteration_punctuated_unicodeScalars_Backwards 3400 3399 -0.0% 1.00x (?)
CharIteration_russian_unicodeScalars 17887 17870 -0.1% 1.00x (?)
CharIteration_russian_unicodeScalars_Backwards 12488 12481 -0.1% 1.00x (?)
CharIteration_tweet_unicodeScalars 42456 42408 -0.1% 1.00x (?)
CharIteration_tweet_unicodeScalars_Backwards 29641 29651 +0.0% 1.00x (?)
CharIteration_utf16_unicodeScalars 28225 28213 -0.0% 1.00x (?)
CharIteration_utf16_unicodeScalars_Backwards 18688 18708 +0.1% 1.00x (?)
CharacterLiteralsLarge 5930 6015 +1.4% 0.99x (?)
CharacterLiteralsSmall 217 217 +0.0% 1.00x
CharacterPropertiesFetch 4622 4663 +0.9% 0.99x (?)
CharacterPropertiesPrecomputed 1109 1112 +0.3% 1.00x (?)
CharacterPropertiesStashed 1467 1446 -1.4% 1.01x (?)
CharacterPropertiesStashedMemo 1563 1560 -0.2% 1.00x (?)
Chars 1218 1217 -0.1% 1.00x (?)
ClassArrayGetter 15 15 +0.0% 1.00x
Combos 494 492 -0.4% 1.00x (?)
DataAccessBytes 1146 1148 +0.2% 1.00x (?)
DataAppendBytes 4913 4853 -1.2% 1.01x (?)
DataAppendDataLargeToLarge 67998 67152 -1.2% 1.01x (?)
DataAppendDataLargeToMedium 35463 35332 -0.4% 1.00x (?)
DataAppendDataLargeToSmall 34663 34663 +0.0% 1.00x
DataAppendDataMediumToLarge 38509 38930 +1.1% 0.99x (?)
DataAppendDataMediumToSmall 6196 6141 -0.9% 1.01x (?)
DataAppendDataSmallToMedium 6368 6391 +0.4% 1.00x (?)
DataAppendSequence 7291906 7507906 +3.0% 0.97x (?)
DataCount 37 37 +0.0% 1.00x
DataMutateBytes 3914 3884 -0.8% 1.01x (?)
DataReplaceLarge 38181 37374 -2.1% 1.02x (?)
DataReplaceLargeBuffer 57191 57679 +0.9% 0.99x (?)
DataReplaceMedium 7879 7881 +0.0% 1.00x (?)
DataReplaceSmall 5645 5651 +0.1% 1.00x (?)
DataReplaceSmallBuffer 8587 8879 +3.4% 0.97x (?)
DataReset 2824 2802 -0.8% 1.01x (?)
DataSetCount 562 553 -1.6% 1.02x (?)
DataSubscript 220 220 +0.0% 1.00x
DictOfArraysToArrayOfDicts 802 799 -0.4% 1.00x (?)
Dictionary 522 522 +0.0% 1.00x
Dictionary2 636 637 +0.2% 1.00x (?)
Dictionary2OfObjects 2091 2089 -0.1% 1.00x (?)
Dictionary3 231 231 +0.0% 1.00x
Dictionary3OfObjects 736 736 +0.0% 1.00x
Dictionary4 343 344 +0.3% 1.00x (?)
Dictionary4Legacy 724 725 +0.1% 1.00x (?)
Dictionary4OfObjects 456 456 +0.0% 1.00x
Dictionary4OfObjectsLegacy 943 938 -0.5% 1.01x (?)
DictionaryBridge 1219 1179 -3.3% 1.03x (?)
DictionaryCopy 108369 108385 +0.0% 1.00x (?)
DictionaryFilter 106917 106923 +0.0% 1.00x (?)
DictionaryGroup 217 216 -0.5% 1.00x
DictionaryGroupOfObjects 2135 2135 +0.0% 1.00x
DictionaryLiteral 1916 1950 +1.8% 0.98x (?)
DictionaryOfObjects 2382 2375 -0.3% 1.00x (?)
DictionaryRemove 4507 4505 -0.0% 1.00x (?)
DictionaryRemoveOfObjects 26193 26330 +0.5% 0.99x
DictionarySubscriptDefaultMutation 282 282 +0.0% 1.00x
DictionarySubscriptDefaultMutationArray 620 620 +0.0% 1.00x
DictionarySubscriptDefaultMutationArrayOfObjects 4078 4081 +0.1% 1.00x (?)
DictionarySubscriptDefaultMutationOfObjects 1727 1723 -0.2% 1.00x (?)
DictionarySwap 1114 1113 -0.1% 1.00x
DictionarySwapAt 6801 6884 +1.2% 0.99x (?)
DictionarySwapAtOfObjects 52946 52400 -1.0% 1.01x (?)
DictionarySwapOfObjects 8795 8948 +1.7% 0.98x (?)
DoubleWidthDivision 0 0 +0.0% 1.00x
DropFirstAnyCollection 84 84 +0.0% 1.00x
DropFirstAnyCollectionLazy 69391 69629 +0.3% 1.00x (?)
DropFirstAnySeqCRangeIter 26958 26979 +0.1% 1.00x (?)
DropFirstAnySeqCRangeIterLazy 26916 26948 +0.1% 1.00x (?)
DropFirstAnySeqCntRange 41 42 +2.4% 0.98x
DropFirstAnySeqCntRangeLazy 42 42 +0.0% 1.00x
DropFirstAnySequence 4944 4974 +0.6% 0.99x (?)
DropFirstAnySequenceLazy 4951 4971 +0.4% 1.00x (?)
DropFirstArray 35 35 +0.0% 1.00x
DropFirstArrayLazy 35 35 +0.0% 1.00x
DropFirstCountableRange 35 35 +0.0% 1.00x
DropFirstCountableRangeLazy 35 35 +0.0% 1.00x
DropFirstSequence 2681 2683 +0.1% 1.00x (?)
DropFirstSequenceLazy 2775 2776 +0.0% 1.00x (?)
DropLastAnyCollection 31 30 -3.2% 1.03x
DropLastAnyCollectionLazy 22900 22866 -0.1% 1.00x (?)
DropLastAnySeqCRangeIter 3526 3540 +0.4% 1.00x (?)
DropLastAnySeqCRangeIterLazy 3534 3540 +0.2% 1.00x (?)
DropLastAnySeqCntRangeLazy 14 14 +0.0% 1.00x
DropLastAnySequence 4970 4958 -0.2% 1.00x (?)
DropLastAnySequenceLazy 5034 5019 -0.3% 1.00x (?)
DropLastCountableRange 11 11 +0.0% 1.00x
DropLastCountableRangeLazy 11 11 +0.0% 1.00x
DropLastSequence 666 667 +0.2% 1.00x (?)
DropLastSequenceLazy 665 671 +0.9% 0.99x
DropWhileAnyCollection 107 107 +0.0% 1.00x
DropWhileAnyCollectionLazy 125 125 +0.0% 1.00x
DropWhileAnySeqCRangeIter 21106 21327 +1.0% 0.99x (?)
DropWhileAnySeqCRangeIterLazy 125 125 +0.0% 1.00x
DropWhileAnySeqCntRange 52 51 -1.9% 1.02x
DropWhileAnySeqCntRangeLazy 125 125 +0.0% 1.00x
DropWhileAnySequence 4868 4868 +0.0% 1.00x
DropWhileAnySequenceLazy 1856 1857 +0.1% 1.00x (?)
DropWhileArrayLazy 88 88 +0.0% 1.00x
DropWhileCountableRange 36 36 +0.0% 1.00x
DropWhileCountableRangeLazy 105 105 +0.0% 1.00x
DropWhileSequence 2213 2213 +0.0% 1.00x
DropWhileSequenceLazy 88 88 +0.0% 1.00x
EqualStringSubstring 49 49 +0.0% 1.00x
EqualSubstringString 49 49 +0.0% 1.00x
EqualSubstringSubstring 49 49 +0.0% 1.00x
EqualSubstringSubstringGenericEquatable 49 49 +0.0% 1.00x
ErrorHandling 1185 1182 -0.3% 1.00x (?)
ExclusivityGlobal 5 5 +0.0% 1.00x
ExclusivityIndependent 2 2 +0.0% 1.00x
FatCompactMap 200063 199592 -0.2% 1.00x
FilterEvenUsingReduce 1312 1321 +0.7% 0.99x (?)
FilterEvenUsingReduceInto 149 150 +0.7% 0.99x (?)
FloatingPointPrinting_Double_description_small 23521 23504 -0.1% 1.00x (?)
FloatingPointPrinting_Double_description_uniform 23093 23142 +0.2% 1.00x (?)
FloatingPointPrinting_Double_interpolated 64960 66052 +1.7% 0.98x (?)
FloatingPointPrinting_Float80_description_small 30386 30448 +0.2% 1.00x (?)
FloatingPointPrinting_Float80_description_uniform 29543 29542 -0.0% 1.00x (?)
FloatingPointPrinting_Float80_interpolated 69273 69109 -0.2% 1.00x (?)
FloatingPointPrinting_Float_description_small 5442 5444 +0.0% 1.00x (?)
FloatingPointPrinting_Float_description_uniform 5386 5383 -0.1% 1.00x (?)
FrequenciesUsingReduce 5045 5049 +0.1% 1.00x (?)
FrequenciesUsingReduceInto 1540 1545 +0.3% 1.00x (?)
Hanoi 2162 2169 +0.3% 1.00x (?)
HashTest 964 970 +0.6% 0.99x
Histogram 697 698 +0.1% 1.00x
Integrate 335 335 +0.0% 1.00x
IterateData 1666 1665 -0.1% 1.00x (?)
Join 169 169 +0.0% 1.00x
LazilyFilteredArrayContains 36286 36278 -0.0% 1.00x (?)
LazilyFilteredArrays 67324 64874 -3.6% 1.04x (?)
LazilyFilteredRange 3770 3727 -1.1% 1.01x
LessSubstringSubstring 49 49 +0.0% 1.00x
LessSubstringSubstringGenericComparable 49 49 +0.0% 1.00x
LinkedList 7578 7585 +0.1% 1.00x (?)
LuhnAlgoEager 441 443 +0.5% 1.00x
LuhnAlgoLazy 442 449 +1.6% 0.98x
MapReduce 400 398 -0.5% 1.01x
MapReduceAnyCollection 429 430 +0.2% 1.00x (?)
MapReduceAnyCollectionShort 2236 2230 -0.3% 1.00x
MapReduceClass 3027 3027 +0.0% 1.00x
MapReduceClassShort 4711 4649 -1.3% 1.01x (?)
MapReduceLazyCollection 13 13 +0.0% 1.00x
MapReduceLazyCollectionShort 34 34 +0.0% 1.00x
MapReduceLazySequence 86 86 +0.0% 1.00x
MapReduceSequence 462 462 +0.0% 1.00x
MapReduceShort 1987 1984 -0.2% 1.00x (?)
MapReduceShortString 21 21 +0.0% 1.00x
MapReduceString 49 49 +0.0% 1.00x
Memset 221 219 -0.9% 1.01x (?)
MonteCarloE 10309 10307 -0.0% 1.00x (?)
MonteCarloPi 42693 42748 +0.1% 1.00x (?)
NSDictionaryCastToSwift 6785 6739 -0.7% 1.01x (?)
NSError 171 170 -0.6% 1.01x (?)
NSStringConversion 711 708 -0.4% 1.00x
NibbleSort 3668 3668 +0.0% 1.00x
NopDeinit 30170 30162 -0.0% 1.00x (?)
ObjectAllocation 133 134 +0.8% 0.99x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 46253 46386 +0.3% 1.00x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 44700 46088 +3.1% 0.97x (?)
ObjectiveCBridgeFromNSDictionaryAnyObject 115509 111648 -3.3% 1.03x (?)
ObjectiveCBridgeFromNSSetAnyObject 50058 51187 +2.3% 0.98x (?)
ObjectiveCBridgeFromNSSetAnyObjectForced 5549 5715 +3.0% 0.97x (?)
ObjectiveCBridgeFromNSSetAnyObjectToString 65332 65660 +0.5% 1.00x (?)
ObjectiveCBridgeFromNSString 1193 1190 -0.3% 1.00x
ObjectiveCBridgeFromNSStringForced 2703 2688 -0.6% 1.01x (?)
ObjectiveCBridgeStubDataAppend 6474 6449 -0.4% 1.00x (?)
ObjectiveCBridgeStubDateMutation 401 401 +0.0% 1.00x
ObjectiveCBridgeStubFromNSDate 6166 6173 +0.1% 1.00x (?)
ObjectiveCBridgeStubFromNSString 1031 1032 +0.1% 1.00x (?)
ObjectiveCBridgeStubFromNSStringRef 161 161 +0.0% 1.00x
ObjectiveCBridgeStubNSDataAppend 2535 2649 +4.5% 0.96x (?)
ObjectiveCBridgeStubNSDateMutationRef 13253 13449 +1.5% 0.99x (?)
ObjectiveCBridgeStubToArrayOfNSString 40383 38946 -3.6% 1.04x (?)
ObjectiveCBridgeStubToNSDate 15159 15802 +4.2% 0.96x (?)
ObjectiveCBridgeStubToNSDateRef 3473 3399 -2.1% 1.02x (?)
ObjectiveCBridgeStubToNSString 2380 2382 +0.1% 1.00x (?)
ObjectiveCBridgeStubToNSStringRef 116 116 +0.0% 1.00x
ObjectiveCBridgeStubURLAppendPath 297009 304586 +2.6% 0.98x (?)
ObjectiveCBridgeStubURLAppendPathRef 298857 293618 -1.8% 1.02x (?)
ObjectiveCBridgeToNSArray 14729 15218 +3.3% 0.97x (?)
ObjectiveCBridgeToNSDictionary 26617 26877 +1.0% 0.99x (?)
ObjectiveCBridgeToNSSet 16608 17344 +4.4% 0.96x (?)
ObjectiveCBridgeToNSString 484 485 +0.2% 1.00x (?)
ObserverClosure 2152 2152 +0.0% 1.00x
ObserverForwarderStruct 1235 1220 -1.2% 1.01x (?)
ObserverPartiallyAppliedMethod 3733 3743 +0.3% 1.00x (?)
ObserverUnappliedMethod 2506 2510 +0.2% 1.00x (?)
OpaqueConsumingUsers 4181 4181 +0.0% 1.00x
OpenClose 65 65 +0.0% 1.00x
PartialApplyDynamicType 0 0 +0.0% 1.00x
Phonebook 6826 6824 -0.0% 1.00x (?)
PointerArithmetics 31494 31504 +0.0% 1.00x (?)
PolymorphicCalls 25 25 +0.0% 1.00x
PopFrontArray 1993 2002 +0.5% 1.00x
PopFrontArrayGeneric 1977 2007 +1.5% 0.99x (?)
PrefixAnyCollection 84 84 +0.0% 1.00x
PrefixAnyCollectionLazy 70155 69893 -0.4% 1.00x (?)
PrefixAnySeqCRangeIter 21021 20906 -0.5% 1.01x
PrefixAnySeqCRangeIterLazy 20934 21039 +0.5% 1.00x
PrefixAnySeqCntRange 28 29 +3.6% 0.97x
PrefixAnySeqCntRangeLazy 29 29 +0.0% 1.00x
PrefixAnySequence 4335 4331 -0.1% 1.00x (?)
PrefixAnySequenceLazy 4315 4320 +0.1% 1.00x (?)
PrefixArray 35 35 +0.0% 1.00x
PrefixArrayLazy 35 35 +0.0% 1.00x
PrefixCountableRange 35 35 +0.0% 1.00x
PrefixCountableRangeLazy 35 35 +0.0% 1.00x
PrefixSequence 2215 2216 +0.0% 1.00x (?)
PrefixSequenceLazy 2275 2278 +0.1% 1.00x
PrefixWhileAnyCollection 154 154 +0.0% 1.00x
PrefixWhileAnyCollectionLazy 90 90 +0.0% 1.00x
PrefixWhileAnySeqCRangeIter 8676 8699 +0.3% 1.00x (?)
PrefixWhileAnySeqCRangeIterLazy 72 72 +0.0% 1.00x
PrefixWhileAnySeqCntRange 60 60 +0.0% 1.00x
PrefixWhileAnySeqCntRangeLazy 90 90 +0.0% 1.00x
PrefixWhileAnySequence 9830 9823 -0.1% 1.00x (?)
PrefixWhileAnySequenceLazy 1393 1394 +0.1% 1.00x
PrefixWhileArray 88 88 +0.0% 1.00x
PrefixWhileArrayLazy 70 70 +0.0% 1.00x
PrefixWhileCountableRange 36 36 +0.0% 1.00x
PrefixWhileCountableRangeLazy 35 35 +0.0% 1.00x
PrefixWhileSequence 363 364 +0.3% 1.00x (?)
PrefixWhileSequenceLazy 52 52 +0.0% 1.00x
Prims 921 922 +0.1% 1.00x (?)
PrimsSplit 929 938 +1.0% 0.99x
QueueConcrete 1150 1147 -0.3% 1.00x (?)
QueueGeneric 1152 1152 +0.0% 1.00x
RC4 166 167 +0.6% 0.99x (?)
RGBHistogram 3262 3271 +0.3% 1.00x (?)
RGBHistogramOfObjects 23848 23879 +0.1% 1.00x
RandomDoubleDef 29452 28085 -4.6% 1.05x (?)
RandomDoubleLCG 4412 4411 -0.0% 1.00x (?)
RandomIntegersDef 28148 28144 -0.0% 1.00x (?)
RandomIntegersLCG 2293 2293 +0.0% 1.00x
RandomShuffleDef 837238 838006 +0.1% 1.00x (?)
RandomShuffleLCG 155661 155737 +0.0% 1.00x (?)
RangeAssignment 342 343 +0.3% 1.00x (?)
RangeIterationSigned 200 200 +0.0% 1.00x
RangeReplaceableCollectionPlusDefault 1016 1014 -0.2% 1.00x (?)
RecursiveOwnedParameter 115 115 +0.0% 1.00x
RemoveWhereFilterInts 46 47 +2.2% 0.98x
RemoveWhereFilterString 252 252 +0.0% 1.00x
RemoveWhereFilterStrings 438 437 -0.2% 1.00x
RemoveWhereMoveInts 15 15 +0.0% 1.00x
RemoveWhereMoveStrings 708 709 +0.1% 1.00x (?)
RemoveWhereQuadraticInts 1296 1297 +0.1% 1.00x (?)
RemoveWhereQuadraticString 378 380 +0.5% 0.99x (?)
RemoveWhereQuadraticStrings 2768 2767 -0.0% 1.00x (?)
RemoveWhereSwapInts 19 20 +5.3% 0.95x
RemoveWhereSwapStrings 859 859 +0.0% 1.00x
ReversedArray 57 57 +0.0% 1.00x
ReversedBidirectional 17109 16606 -2.9% 1.03x
ReversedDictionary 270 270 +0.0% 1.00x
RomanNumbers 82194 82144 -0.1% 1.00x (?)
SequenceAlgosAnySequence 15410 15380 -0.2% 1.00x (?)
SequenceAlgosArray 1579 1578 -0.1% 1.00x (?)
SequenceAlgosContiguousArray 1586 1577 -0.6% 1.01x
SequenceAlgosList 1359 1359 +0.0% 1.00x
SequenceAlgosRange 2576 2576 +0.0% 1.00x
SequenceAlgosUnfoldSequence 1102 1102 +0.0% 1.00x
SetExclusiveOr 5176 5170 -0.1% 1.00x (?)
SetExclusiveOr_OfObjects 11889 11812 -0.6% 1.01x (?)
SetIntersect 700 702 +0.3% 1.00x (?)
SetIntersect_OfObjects 1750 1756 +0.3% 1.00x (?)
SetIsSubsetOf 366 366 +0.0% 1.00x
SetIsSubsetOf_OfObjects 457 457 +0.0% 1.00x
SetUnion 4409 4421 +0.3% 1.00x (?)
SetUnion_OfObjects 10216 10141 -0.7% 1.01x
SevenBoom 872 871 -0.1% 1.00x (?)
Sim2DArray 663 664 +0.2% 1.00x (?)
SortLargeExistentials 5500 5505 +0.1% 1.00x (?)
SortLettersInPlace 1000 1004 +0.4% 1.00x (?)
SortSortedStrings 868 870 +0.2% 1.00x
SortStrings 1798 1792 -0.3% 1.00x
SortStringsUnicode 2610 2614 +0.2% 1.00x (?)
StackPromo 25236 25245 +0.0% 1.00x (?)
StaticArray 10 10 +0.0% 1.00x
StrComplexWalk 1777 1778 +0.1% 1.00x (?)
StrToInt 3198 3198 +0.0% 1.00x
StringAdder 577 576 -0.2% 1.00x
StringBuilder 559 559 +0.0% 1.00x
StringBuilderLong 1266 1254 -0.9% 1.01x (?)
StringBuilderSmallReservingCapacity 579 579 +0.0% 1.00x
StringComparison_abnormal 783 782 -0.1% 1.00x (?)
StringComparison_ascii 1038 1034 -0.4% 1.00x
StringComparison_emoji 833 834 +0.1% 1.00x
StringComparison_fastPrenormal 877 876 -0.1% 1.00x
StringComparison_latin1 687 687 +0.0% 1.00x
StringComparison_longSharedPrefix 958 956 -0.2% 1.00x
StringComparison_nonBMPSlowestPrenormal 1613 1619 +0.4% 1.00x
StringComparison_slowerPrenormal 1748 1748 +0.0% 1.00x
StringComparison_zalgo 126735 127339 +0.5% 1.00x (?)
StringEdits 184657 176875 -4.2% 1.04x (?)
StringEnumRawValueInitialization 854 854 +0.0% 1.00x
StringEqualPointerComparison 304 305 +0.3% 1.00x
StringFromLongWholeSubstring 22 22 +0.0% 1.00x
StringFromLongWholeSubstringGeneric 21 21 +0.0% 1.00x
StringHasPrefixAscii 2232 2233 +0.0% 1.00x (?)
StringHasPrefixUnicode 101358 101011 -0.3% 1.00x (?)
StringHasSuffixAscii 2319 2319 +0.0% 1.00x
StringHasSuffixUnicode 101201 101347 +0.1% 1.00x (?)
StringInterpolation 9691 9717 +0.3% 1.00x (?)
StringInterpolationManySmallSegments 19060 19050 -0.1% 1.00x (?)
StringInterpolationSmall 4230 4229 -0.0% 1.00x (?)
StringMatch 12764 12762 -0.0% 1.00x (?)
StringRemoveDupes 502 502 +0.0% 1.00x
StringUTF16Builder 2692 2670 -0.8% 1.01x (?)
StringWalk 1443 1443 +0.0% 1.00x
StringWithCString 44927 44914 -0.0% 1.00x (?)
StringWordBuilder 2257 2248 -0.4% 1.00x (?)
StringWordBuilderReservingCapacity 1833 1834 +0.1% 1.00x (?)
SubstringComparable 13 13 +0.0% 1.00x
SubstringEqualString 619 614 -0.8% 1.01x (?)
SubstringEquatable 1410 1411 +0.1% 1.00x (?)
SubstringFromLongString 10 10 +0.0% 1.00x
SubstringFromLongStringGeneric 75 75 +0.0% 1.00x
SuffixAnyCollection 31 31 +0.0% 1.00x
SuffixAnyCollectionLazy 23056 23122 +0.3% 1.00x (?)
SuffixAnySeqCRangeIter 3740 3749 +0.2% 1.00x (?)
SuffixAnySeqCRangeIterLazy 3751 3753 +0.1% 1.00x (?)
SuffixAnySeqCntRange 21 21 +0.0% 1.00x
SuffixAnySeqCntRangeLazy 21 21 +0.0% 1.00x
SuffixAnySequence 4970 4962 -0.2% 1.00x (?)
SuffixAnySequenceLazy 5009 5036 +0.5% 0.99x (?)
SuffixCountableRange 11 11 +0.0% 1.00x
SuffixCountableRangeLazy 11 11 +0.0% 1.00x
SuffixSequence 3654 3660 +0.2% 1.00x (?)
SuffixSequenceLazy 3668 3673 +0.1% 1.00x (?)
SumUsingReduce 102 102 +0.0% 1.00x
SumUsingReduceInto 97 97 +0.0% 1.00x
SuperChars 15720 15715 -0.0% 1.00x (?)
TwoSum 1505 1496 -0.6% 1.01x (?)
TypeFlood 0 0 +0.0% 1.00x
UTF8Decode 298 297 -0.3% 1.00x (?)
Walsh 433 434 +0.2% 1.00x (?)
WordCountHistogramASCII 8066 8061 -0.1% 1.00x (?)
WordCountHistogramUTF16 15482 15396 -0.6% 1.01x (?)
WordCountUniqueASCII 2072 2074 +0.1% 1.00x (?)
WordCountUniqueUTF16 8215 8227 +0.1% 1.00x (?)
WordSplitASCII 7091 6915 -2.5% 1.03x
WordSplitUTF16 8675 8813 +1.6% 0.98x (?)
XorLoop 398 402 +1.0% 0.99x
Hardware Overview
  Model Name: Mac Pro
  Model Identifier: MacPro6,1
  Processor Name: 12-Core Intel Xeon E5
  Processor Speed: 2.7 GHz
  Number of Processors: 1
  Total Number of Cores: 12
  L2 Cache (per Core): 256 KB
  L3 Cache: 30 MB
  Memory: 64 GB

@gottesmm gottesmm merged commit c3f71d6 into swiftlang:master May 30, 2018
@gottesmm gottesmm deleted the pr-aaef324649673b4468c77d0457c627ecd9d7f743 branch May 30, 2018 23:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants