Skip to content

Revert "Try disabling CSV benchmarks to see if that unsticks PR benchmark runs" #14241

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Feb 1, 2018
Merged

Revert "Try disabling CSV benchmarks to see if that unsticks PR benchmark runs" #14241

merged 1 commit into from
Feb 1, 2018

Conversation

milseman
Copy link
Member

Reverts #14220

Trying to determine why this is stalling benchmarks. Might be poor choice of loop iteration scales, as it worked fine for smoke benchmark but not full.

@milseman
Copy link
Member Author

@swift-ci please smoke benchmark

^^^ Expecting this to work just fine

@jrose-apple
Copy link
Contributor

No no no, this is the one that's causing hangs. Please work on this locally.

@milseman
Copy link
Member Author

It doesn't hang locally for me, that's the thing. What is different about the bot's configuration?

@airspeedswift
Copy link
Member

As another data point, it does hang locally on my machine.

@jrose-apple
Copy link
Contributor

Optimized vs. non-optimized stdlib?

@lancep
Copy link
Contributor

lancep commented Feb 1, 2018

The hang is resolved by #14314 (review)

@lancep
Copy link
Contributor

lancep commented Feb 1, 2018

@swift-ci please smoke benchmark

@swift-ci
Copy link
Contributor

swift-ci commented Feb 1, 2018

Build comment file:

Optimized (O)

Regression (7)
TEST OLD NEW DELTA SPEEDUP
PrefixWhileCountableRange 46 53 +15.2% 0.87x
ObjectiveCBridgeStubFromArrayOfNSString 29910 33298 +11.3% 0.90x (?)
NopDeinit 21573 23490 +8.9% 0.92x
DictionaryGroup 135 144 +6.7% 0.94x (?)
ObjectiveCBridgeStubToNSDate 15003 15915 +6.1% 0.94x
ObjectiveCBridgeStubNSDataAppend 2512 2658 +5.8% 0.95x
NibbleSort 3964 4173 +5.3% 0.95x
Improvement (17)
TEST OLD NEW DELTA SPEEDUP
Sim2DArray 600 412 -31.3% 1.46x
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 42597 33806 -20.6% 1.26x
PrefixWhileArray 105 88 -16.2% 1.19x
RangeIterationSigned 200 171 -14.5% 1.17x
MapReduceLazyCollectionShort 38 34 -10.5% 1.12x
LazilyFilteredRange 4204 3827 -9.0% 1.10x
SuffixCountableRangeLazy 12 11 -8.3% 1.09x
DropLastCountableRangeLazy 12 11 -8.3% 1.09x
PointerArithmetics 34368 31515 -8.3% 1.09x
DictionaryRemove 2987 2756 -7.7% 1.08x
DropLastSequence 712 658 -7.6% 1.08x
DropLastSequenceLazy 711 658 -7.5% 1.08x
MapReduceAnyCollection 430 399 -7.2% 1.08x
ObjectiveCBridgeFromNSArrayAnyObjectToString 43296 40283 -7.0% 1.07x (?)
WordCountUniqueUTF16 24208 22668 -6.4% 1.07x (?)
PrefixAnyCollectionLazy 69952 65644 -6.2% 1.07x (?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 5017 4736 -5.6% 1.06x (?)
No Changes (331)
TEST OLD NEW DELTA SPEEDUP
AngryPhonebook 3606 3654 +1.3% 0.99x
AnyHashableWithAClass 69401 69769 +0.5% 0.99x
Array2D 2553 2557 +0.2% 1.00x (?)
ArrayAppend 1022 1021 -0.1% 1.00x (?)
ArrayAppendArrayOfInt 799 791 -1.0% 1.01x (?)
ArrayAppendAscii 13709 13656 -0.4% 1.00x
ArrayAppendFromGeneric 784 798 +1.8% 0.98x (?)
ArrayAppendGenericStructs 1430 1430 +0.0% 1.00x
ArrayAppendLatin1 38125 38686 +1.5% 0.99x
ArrayAppendLazyMap 1342 1343 +0.1% 1.00x (?)
ArrayAppendOptionals 1455 1431 -1.6% 1.02x (?)
ArrayAppendRepeatCol 1341 1340 -0.1% 1.00x (?)
ArrayAppendReserved 756 756 +0.0% 1.00x
ArrayAppendSequence 1134 1135 +0.1% 1.00x (?)
ArrayAppendStrings 15229 15179 -0.3% 1.00x
ArrayAppendToFromGeneric 800 800 +0.0% 1.00x
ArrayAppendToGeneric 800 800 +0.0% 1.00x
ArrayAppendUTF16 37378 38672 +3.5% 0.97x
ArrayInClass 85 85 +0.0% 1.00x
ArrayLiteral 0 0 +0.0% 1.00x
ArrayOfGenericPOD2 151 150 -0.7% 1.01x (?)
ArrayOfGenericRef 4443 4380 -1.4% 1.01x
ArrayOfPOD 183 183 +0.0% 1.00x
ArrayOfRef 4383 4384 +0.0% 1.00x (?)
ArrayPlusEqualArrayOfInt 799 800 +0.1% 1.00x (?)
ArrayPlusEqualFiveElementCollection 5536 5507 -0.5% 1.01x
ArrayPlusEqualSingleElementCollection 1021 1022 +0.1% 1.00x (?)
ArrayPlusEqualThreeElements 1673 1665 -0.5% 1.00x
ArraySubscript 1559 1552 -0.4% 1.00x (?)
ArrayValueProp 8 8 +0.0% 1.00x
ArrayValueProp2 8 8 +0.0% 1.00x
ArrayValueProp3 8 8 +0.0% 1.00x
ArrayValueProp4 8 8 +0.0% 1.00x
BinaryFloatingPointConversionFromBinaryInteger 46 46 +0.0% 1.00x
BitCount 202 211 +4.5% 0.96x
ByteSwap 101 98 -3.0% 1.03x
COWTree 3583 3749 +4.6% 0.96x (?)
CStringLongAscii 4938 4945 +0.1% 1.00x (?)
CStringLongNonAscii 2210 2190 -0.9% 1.01x
CStringShortAscii 4739 4731 -0.2% 1.00x (?)
Calculator 442 428 -3.2% 1.03x
CaptureProp 9194 9457 +2.9% 0.97x
CharIndexing_ascii_unicodeScalars 15883 15352 -3.3% 1.03x
CharIndexing_ascii_unicodeScalars_Backwards 14387 14979 +4.1% 0.96x
CharIndexing_chinese_unicodeScalars 12036 11620 -3.5% 1.04x
CharIndexing_chinese_unicodeScalars_Backwards 10910 11357 +4.1% 0.96x
CharIndexing_japanese_unicodeScalars 19002 18370 -3.3% 1.03x
CharIndexing_japanese_unicodeScalars_Backwards 17222 17935 +4.1% 0.96x
CharIndexing_korean_unicodeScalars 15412 14888 -3.4% 1.04x
CharIndexing_korean_unicodeScalars_Backwards 13960 14520 +4.0% 0.96x
CharIndexing_punctuatedJapanese_unicodeScalars 2890 2792 -3.4% 1.04x
CharIndexing_punctuatedJapanese_unicodeScalars_Backwards 2634 2728 +3.6% 0.97x
CharIndexing_punctuated_unicodeScalars 3604 3488 -3.2% 1.03x
CharIndexing_punctuated_unicodeScalars_Backwards 3287 3407 +3.7% 0.96x
CharIndexing_russian_unicodeScalars 13241 12783 -3.5% 1.04x
CharIndexing_russian_unicodeScalars_Backwards 12008 12500 +4.1% 0.96x
CharIndexing_tweet_unicodeScalars 31542 30256 -4.1% 1.04x
CharIndexing_tweet_unicodeScalars_Backwards 28544 29469 +3.2% 0.97x
CharIndexing_utf16_unicodeScalars 20771 20667 -0.5% 1.01x
CharIndexing_utf16_unicodeScalars_Backwards 21320 21562 +1.1% 0.99x
CharIteration_ascii_unicodeScalars 20733 21480 +3.6% 0.97x
CharIteration_ascii_unicodeScalars_Backwards 14069 13512 -4.0% 1.04x
CharIteration_chinese_unicodeScalars 15739 16256 +3.3% 0.97x
CharIteration_chinese_unicodeScalars_Backwards 10666 10225 -4.1% 1.04x
CharIteration_japanese_unicodeScalars 24915 25717 +3.2% 0.97x
CharIteration_japanese_unicodeScalars_Backwards 16830 16157 -4.0% 1.04x
CharIteration_korean_unicodeScalars 20085 20814 +3.6% 0.96x
CharIteration_korean_unicodeScalars_Backwards 13658 13102 -4.1% 1.04x
CharIteration_punctuatedJapanese_unicodeScalars 3707 3829 +3.3% 0.97x
CharIteration_punctuatedJapanese_unicodeScalars_Backwards 2584 2491 -3.6% 1.04x
CharIteration_punctuated_unicodeScalars 4670 4813 +3.1% 0.97x
CharIteration_punctuated_unicodeScalars_Backwards 3220 3102 -3.7% 1.04x
CharIteration_russian_unicodeScalars 17286 17856 +3.3% 0.97x
CharIteration_russian_unicodeScalars_Backwards 11734 11269 -4.0% 1.04x
CharIteration_tweet_unicodeScalars 40868 42344 +3.6% 0.97x
CharIteration_tweet_unicodeScalars_Backwards 27476 26650 -3.0% 1.03x
CharIteration_utf16_unicodeScalars 27334 27630 +1.1% 0.99x
CharIteration_utf16_unicodeScalars_Backwards 16959 17024 +0.4% 1.00x (?)
CharacterLiteralsLarge 6073 6020 -0.9% 1.01x (?)
CharacterLiteralsSmall 411 411 +0.0% 1.00x
CharacterPropertiesFetch 4664 4646 -0.4% 1.00x (?)
CharacterPropertiesPrecomputed 1057 1057 +0.0% 1.00x
CharacterPropertiesStashed 1682 1632 -3.0% 1.03x
CharacterPropertiesStashedMemo 1623 1603 -1.2% 1.01x
Chars 968 970 +0.2% 1.00x
ClassArrayGetter 15 15 +0.0% 1.00x
Combos 455 456 +0.2% 1.00x (?)
DictOfArraysToArrayOfDicts 795 804 +1.1% 0.99x
Dictionary 508 505 -0.6% 1.01x (?)
Dictionary2 1614 1608 -0.4% 1.00x
Dictionary2OfObjects 2972 2958 -0.5% 1.00x (?)
Dictionary3 238 241 +1.3% 0.99x
Dictionary3OfObjects 675 676 +0.1% 1.00x (?)
DictionaryBridge 2157 2081 -3.5% 1.04x (?)
DictionaryGroupOfObjects 1917 1919 +0.1% 1.00x (?)
DictionaryLiteral 1621 1610 -0.7% 1.01x (?)
DictionaryOfObjects 2186 2174 -0.5% 1.01x (?)
DictionaryRemoveOfObjects 23560 23624 +0.3% 1.00x
DictionarySubscriptDefaultMutation 145 144 -0.7% 1.01x
DictionarySubscriptDefaultMutationArray 494 492 -0.4% 1.00x
DictionarySubscriptDefaultMutationArrayOfObjects 3820 3792 -0.7% 1.01x
DictionarySubscriptDefaultMutationOfObjects 1381 1387 +0.4% 1.00x
DictionarySwap 471 471 +0.0% 1.00x
DictionarySwapOfObjects 7623 7673 +0.7% 0.99x (?)
DoubleWidthDivision 240 237 -1.2% 1.01x
DropFirstAnyCollection 76 76 +0.0% 1.00x
DropFirstAnyCollectionLazy 65733 65610 -0.2% 1.00x (?)
DropFirstAnySeqCRangeIter 19061 19038 -0.1% 1.00x (?)
DropFirstAnySeqCRangeIterLazy 19049 19029 -0.1% 1.00x (?)
DropFirstAnySeqCntRange 71 71 +0.0% 1.00x
DropFirstAnySeqCntRangeLazy 71 71 +0.0% 1.00x
DropFirstAnySequence 4423 4442 +0.4% 1.00x (?)
DropFirstAnySequenceLazy 4453 4446 -0.2% 1.00x
DropFirstArray 35 35 +0.0% 1.00x
DropFirstArrayLazy 35 35 +0.0% 1.00x
DropFirstCountableRange 35 35 +0.0% 1.00x
DropFirstCountableRangeLazy 35 35 +0.0% 1.00x
DropFirstSequence 2700 2699 -0.0% 1.00x (?)
DropFirstSequenceLazy 2794 2787 -0.3% 1.00x
DropLastAnyCollection 28 28 +0.0% 1.00x
DropLastAnyCollectionLazy 22362 22696 +1.5% 0.99x (?)
DropLastAnySeqCRangeIter 3520 3501 -0.5% 1.01x
DropLastAnySeqCRangeIterLazy 3515 3501 -0.4% 1.00x
DropLastAnySeqCntRange 23 23 +0.0% 1.00x
DropLastAnySeqCntRangeLazy 23 23 +0.0% 1.00x
DropLastAnySequence 5100 5114 +0.3% 1.00x (?)
DropLastAnySequenceLazy 5182 5239 +1.1% 0.99x
DropLastCountableRange 11 11 +0.0% 1.00x
DropWhileAnyCollection 100 100 +0.0% 1.00x
DropWhileAnyCollectionLazy 148 148 +0.0% 1.00x
DropWhileAnySeqCRangeIter 15602 15590 -0.1% 1.00x (?)
DropWhileAnySeqCRangeIterLazy 147 147 +0.0% 1.00x
DropWhileAnySeqCntRange 95 95 +0.0% 1.00x
DropWhileAnySeqCntRangeLazy 147 147 +0.0% 1.00x
DropWhileAnySequence 4797 4781 -0.3% 1.00x
DropWhileAnySequenceLazy 1855 1856 +0.1% 1.00x (?)
DropWhileArrayLazy 129 129 +0.0% 1.00x
DropWhileCountableRange 36 36 +0.0% 1.00x
DropWhileCountableRangeLazy 111 111 +0.0% 1.00x
DropWhileSequence 1340 1340 +0.0% 1.00x
DropWhileSequenceLazy 88 88 +0.0% 1.00x
EqualStringSubstring 432 432 +0.0% 1.00x
EqualSubstringString 432 433 +0.2% 1.00x
EqualSubstringSubstring 433 433 +0.0% 1.00x
EqualSubstringSubstringGenericEquatable 433 433 +0.0% 1.00x
ErrorHandling 2352 2378 +1.1% 0.99x (?)
ExclusivityGlobal 5 5 +0.0% 1.00x
ExclusivityIndependent 2 2 +0.0% 1.00x
FilterEvenUsingReduce 1321 1310 -0.8% 1.01x (?)
FilterEvenUsingReduceInto 147 148 +0.7% 0.99x (?)
FrequenciesUsingReduce 6668 6799 +2.0% 0.98x (?)
FrequenciesUsingReduceInto 3181 3191 +0.3% 1.00x (?)
Hanoi 3546 3524 -0.6% 1.01x (?)
HashTest 1783 1784 +0.1% 1.00x (?)
Histogram 322 322 +0.0% 1.00x
Integrate 217 217 +0.0% 1.00x
IterateData 1379 1379 +0.0% 1.00x
Join 372 370 -0.5% 1.01x
LazilyFilteredArrayContains 38676 37866 -2.1% 1.02x
LazilyFilteredArrays 66747 66839 +0.1% 1.00x (?)
LessSubstringSubstring 434 433 -0.2% 1.00x (?)
LessSubstringSubstringGenericComparable 433 433 +0.0% 1.00x
LinkedList 7579 7553 -0.3% 1.00x
LuhnAlgoEager 594 590 -0.7% 1.01x (?)
LuhnAlgoLazy 597 594 -0.5% 1.01x (?)
MapReduce 427 428 +0.2% 1.00x (?)
MapReduceAnyCollectionShort 2045 2072 +1.3% 0.99x (?)
MapReduceClass 3056 3046 -0.3% 1.00x (?)
MapReduceClassShort 4614 4591 -0.5% 1.01x
MapReduceLazyCollection 13 13 +0.0% 1.00x
MapReduceLazySequence 86 86 +0.0% 1.00x
MapReduceSequence 451 460 +2.0% 0.98x (?)
MapReduceShort 2019 2044 +1.2% 0.99x
MapReduceShortString 22 22 +0.0% 1.00x
MapReduceString 83 84 +1.2% 0.99x
Memset 222 220 -0.9% 1.01x (?)
MonteCarloE 11761 11707 -0.5% 1.00x
MonteCarloPi 42861 42678 -0.4% 1.00x
NSDictionaryCastToSwift 5498 5455 -0.8% 1.01x (?)
NSError 306 305 -0.3% 1.00x (?)
NSStringConversion 317 317 +0.0% 1.00x
ObjectAllocation 183 185 +1.1% 0.99x
ObjectiveCBridgeFromNSArrayAnyObject 19833 20663 +4.2% 0.96x (?)
ObjectiveCBridgeFromNSDictionaryAnyObject 123415 125042 +1.3% 0.99x (?)
ObjectiveCBridgeFromNSSetAnyObject 59277 59930 +1.1% 0.99x (?)
ObjectiveCBridgeFromNSSetAnyObjectForced 4451 4456 +0.1% 1.00x (?)
ObjectiveCBridgeFromNSSetAnyObjectToString 70990 74262 +4.6% 0.96x (?)
ObjectiveCBridgeFromNSString 1318 1304 -1.1% 1.01x
ObjectiveCBridgeFromNSStringForced 2393 2387 -0.3% 1.00x (?)
ObjectiveCBridgeStubDataAppend 3892 3942 +1.3% 0.99x
ObjectiveCBridgeStubDateMutation 257 257 +0.0% 1.00x
ObjectiveCBridgeStubFromNSDate 4159 4133 -0.6% 1.01x
ObjectiveCBridgeStubFromNSString 846 844 -0.2% 1.00x (?)
ObjectiveCBridgeStubFromNSStringRef 159 159 +0.0% 1.00x
ObjectiveCBridgeStubNSDateMutationRef 13408 12905 -3.8% 1.04x
ObjectiveCBridgeStubToArrayOfNSString 29679 29438 -0.8% 1.01x (?)
ObjectiveCBridgeStubToNSDateRef 3457 3419 -1.1% 1.01x (?)
ObjectiveCBridgeStubToNSString 1540 1549 +0.6% 0.99x (?)
ObjectiveCBridgeStubToNSStringRef 113 115 +1.8% 0.98x
ObjectiveCBridgeStubURLAppendPath 334475 332950 -0.5% 1.00x (?)
ObjectiveCBridgeStubURLAppendPathRef 344827 342097 -0.8% 1.01x (?)
ObjectiveCBridgeToNSArray 30222 30199 -0.1% 1.00x (?)
ObjectiveCBridgeToNSDictionary 55174 56322 +2.1% 0.98x (?)
ObjectiveCBridgeToNSSet 47202 47178 -0.1% 1.00x (?)
ObjectiveCBridgeToNSString 1312 1311 -0.1% 1.00x (?)
ObserverClosure 2149 2141 -0.4% 1.00x (?)
ObserverForwarderStruct 999 1000 +0.1% 1.00x (?)
ObserverPartiallyAppliedMethod 3727 3700 -0.7% 1.01x (?)
ObserverUnappliedMethod 2373 2375 +0.1% 1.00x (?)
OpenClose 260 254 -2.3% 1.02x
PartialApplyDynamicType 0 0 +0.0% 1.00x
Phonebook 4087 4055 -0.8% 1.01x
PolymorphicCalls 25 25 +0.0% 1.00x
PopFrontArray 1875 1948 +3.9% 0.96x
PopFrontArrayGeneric 1964 1963 -0.1% 1.00x (?)
PopFrontUnsafePointer 9541 9381 -1.7% 1.02x (?)
PrefixAnyCollection 76 76 +0.0% 1.00x
PrefixAnySeqCRangeIter 14845 14848 +0.0% 1.00x (?)
PrefixAnySeqCRangeIterLazy 14865 14840 -0.2% 1.00x (?)
PrefixAnySeqCntRange 71 71 +0.0% 1.00x
PrefixAnySeqCntRangeLazy 71 71 +0.0% 1.00x
PrefixAnySequence 3814 3834 +0.5% 0.99x
PrefixAnySequenceLazy 3819 3813 -0.2% 1.00x (?)
PrefixArray 35 35 +0.0% 1.00x
PrefixArrayLazy 35 35 +0.0% 1.00x
PrefixCountableRange 35 35 +0.0% 1.00x
PrefixCountableRangeLazy 35 35 +0.0% 1.00x
PrefixSequence 1327 1326 -0.1% 1.00x
PrefixSequenceLazy 1413 1415 +0.1% 1.00x
PrefixWhileAnyCollection 147 147 +0.0% 1.00x
PrefixWhileAnyCollectionLazy 106 106 +0.0% 1.00x
PrefixWhileAnySeqCRangeIter 9353 9338 -0.2% 1.00x
PrefixWhileAnySeqCRangeIterLazy 106 106 +0.0% 1.00x
PrefixWhileAnySeqCntRange 142 142 +0.0% 1.00x
PrefixWhileAnySeqCntRangeLazy 106 106 +0.0% 1.00x
PrefixWhileAnySequence 10397 10401 +0.0% 1.00x (?)
PrefixWhileAnySequenceLazy 1392 1391 -0.1% 1.00x (?)
PrefixWhileArrayLazy 70 70 +0.0% 1.00x
PrefixWhileCountableRangeLazy 35 35 +0.0% 1.00x
PrefixWhileSequence 374 374 +0.0% 1.00x
PrefixWhileSequenceLazy 52 52 +0.0% 1.00x
Prims 756 751 -0.7% 1.01x (?)
PrimsSplit 757 764 +0.9% 0.99x (?)
RC4 164 165 +0.6% 0.99x
RGBHistogram 3037 3027 -0.3% 1.00x (?)
RGBHistogramOfObjects 23904 23872 -0.1% 1.00x (?)
RangeAssignment 366 368 +0.5% 0.99x (?)
RangeIterationSigned64 200 200 +0.0% 1.00x
RangeIterationUnsigned 200 200 +0.0% 1.00x
RangeReplaceableCollectionPlusDefault 975 999 +2.5% 0.98x
RecursiveOwnedParameter 2326 2348 +0.9% 0.99x
ReversedArray 57 57 +0.0% 1.00x
ReversedBidirectional 15392 15395 +0.0% 1.00x (?)
ReversedDictionary 126 129 +2.4% 0.98x (?)
RomanNumbers 109286 110498 +1.1% 0.99x (?)
SetExclusiveOr 3452 3411 -1.2% 1.01x
SetExclusiveOr_OfObjects 8807 8880 +0.8% 0.99x
SetIntersect 332 332 +0.0% 1.00x
SetIntersect_OfObjects 1768 1759 -0.5% 1.01x
SetIsSubsetOf 299 300 +0.3% 1.00x
SetIsSubsetOf_OfObjects 366 366 +0.0% 1.00x
SetUnion 3166 3162 -0.1% 1.00x (?)
SetUnion_OfObjects 7268 7379 +1.5% 0.98x
SevenBoom 1537 1535 -0.1% 1.00x (?)
SortLargeExistentials 7082 7062 -0.3% 1.00x
SortLettersInPlace 1160 1166 +0.5% 0.99x (?)
SortSortedStrings 1145 1188 +3.8% 0.96x
SortStrings 2020 2067 +2.3% 0.98x
SortStringsUnicode 15563 15536 -0.2% 1.00x (?)
StackPromo 22224 22236 +0.1% 1.00x (?)
StaticArray 6 6 +0.0% 1.00x
StrComplexWalk 1564 1568 +0.3% 1.00x
StrToInt 2108 2147 +1.9% 0.98x
StringAdder 4256 4294 +0.9% 0.99x
StringBuilder 1450 1455 +0.3% 1.00x (?)
StringBuilderLong 1068 1087 +1.8% 0.98x (?)
StringComparison_abnormal 862 858 -0.5% 1.00x
StringComparison_ascii 976 961 -1.5% 1.02x
StringComparison_emoji 2564 2555 -0.4% 1.00x
StringComparison_fastPrenormal 8713 8722 +0.1% 1.00x (?)
StringComparison_latin1 5987 5988 +0.0% 1.00x (?)
StringComparison_longSharedPrefix 11525 11519 -0.1% 1.00x (?)
StringComparison_nonBMPSlowestPrenormal 4698 4689 -0.2% 1.00x (?)
StringComparison_slowerPrenormal 4178 4173 -0.1% 1.00x (?)
StringComparison_zalgo 1729 1729 +0.0% 1.00x
StringEdits 120404 116768 -3.0% 1.03x (?)
StringEnumRawValueInitialization 983 976 -0.7% 1.01x
StringEqualPointerComparison 286 286 +0.0% 1.00x
StringFromLongWholeSubstring 21 21 +0.0% 1.00x
StringFromLongWholeSubstringGeneric 10 10 +0.0% 1.00x
StringHasPrefixAscii 1604 1547 -3.6% 1.04x
StringHasPrefixUnicode 28479 28440 -0.1% 1.00x (?)
StringHasSuffixAscii 1720 1690 -1.7% 1.02x
StringHasSuffixUnicode 85596 85384 -0.2% 1.00x (?)
StringInterpolation 9302 9302 +0.0% 1.00x
StringMatch 7310 7552 +3.3% 0.97x
StringRemoveDupes 1024 1017 -0.7% 1.01x
StringUTF16Builder 2430 2408 -0.9% 1.01x (?)
StringWalk 1473 1509 +2.4% 0.98x
StringWithCString 45271 45227 -0.1% 1.00x (?)
StringWordBuilder 1852 1813 -2.1% 1.02x
StringWordBuilderReservingCapacity 1379 1361 -1.3% 1.01x
SubstringComparable 2054 2070 +0.8% 0.99x (?)
SubstringEqualString 2122 2123 +0.0% 1.00x (?)
SubstringEquatable 3213 3206 -0.2% 1.00x (?)
SubstringFromLongString 10 10 +0.0% 1.00x
SubstringFromLongStringGeneric 70 69 -1.4% 1.01x
SuffixAnyCollection 28 28 +0.0% 1.00x
SuffixAnyCollectionLazy 22245 21905 -1.5% 1.02x (?)
SuffixAnySeqCRangeIter 3810 3799 -0.3% 1.00x (?)
SuffixAnySeqCRangeIterLazy 3809 3808 -0.0% 1.00x (?)
SuffixAnySeqCntRange 23 23 +0.0% 1.00x
SuffixAnySeqCntRangeLazy 23 23 +0.0% 1.00x
SuffixAnySequence 5107 5096 -0.2% 1.00x (?)
SuffixAnySequenceLazy 5180 5210 +0.6% 0.99x
SuffixCountableRange 11 11 +0.0% 1.00x
SuffixSequence 3783 3754 -0.8% 1.01x (?)
SuffixSequenceLazy 3783 3732 -1.3% 1.01x
SumUsingReduce 97 102 +5.2% 0.95x
SumUsingReduceInto 97 102 +5.2% 0.95x
SuperChars 43117 42845 -0.6% 1.01x (?)
TwoSum 995 998 +0.3% 1.00x (?)
TypeFlood 0 0 +0.0% 1.00x
UTF8Decode 319 313 -1.9% 1.02x
Walsh 417 425 +1.9% 0.98x
WordCountHistogramASCII 8260 8141 -1.4% 1.01x
WordCountHistogramUTF16 54238 54510 +0.5% 1.00x (?)
WordCountUniqueASCII 1751 1820 +3.9% 0.96x
WordSplitASCII 21361 20890 -2.2% 1.02x (?)
WordSplitUTF16 22227 22053 -0.8% 1.01x (?)
XorLoop 395 394 -0.3% 1.00x (?)
Added (3)
TEST MIN MAX MEAN MAX_RSS
CSVParsing 858398 863784 861426 334307328
CSVParsingAlt 725903 734028 729523 334224043
CSVParsingAltIndices 359801 360282 360056 339227989

Unoptimized (Onone)

Regression (11)
TEST OLD NEW DELTA SPEEDUP
PointerArithmetics 117407 148483 +26.5% 0.79x
ObjectiveCBridgeFromNSString 3204 3855 +20.3% 0.83x (?)
ObjectiveCBridgeStubFromArrayOfNSString 28207 33321 +18.1% 0.85x (?)
ObjectiveCBridgeStubToNSDateRef 3493 4028 +15.3% 0.87x
StringUTF16Builder 7851 8560 +9.0% 0.92x (?)
CharIndexing_japanese_unicodeScalars 426567 464416 +8.9% 0.92x (?)
CharIndexing_korean_unicodeScalars 347847 371856 +6.9% 0.94x (?)
CharIndexing_utf16_unicodeScalars 308333 329277 +6.8% 0.94x (?)
CharIteration_utf16_unicodeScalars_Backwards 267931 285928 +6.7% 0.94x (?)
CharIndexing_japanese_unicodeScalars_Backwards 495317 527571 +6.5% 0.94x (?)
CharIndexing_russian_unicodeScalars_Backwards 343979 365081 +6.1% 0.94x (?)
Improvement (22)
TEST OLD NEW DELTA SPEEDUP
CharIteration_utf16_unicodeScalars 153277 128864 -15.9% 1.19x
XorLoop 27810 23397 -15.9% 1.19x
CharIndexing_punctuatedJapanese_unicodeScalars_Backwards 80950 72191 -10.8% 1.12x
ObjectiveCBridgeFromNSArrayAnyObjectForced 9473 8567 -9.6% 1.11x (?)
CharIteration_ascii_unicodeScalars_Backwards 354041 320860 -9.4% 1.10x (?)
CharIteration_russian_unicodeScalars_Backwards 294154 266884 -9.3% 1.10x
CharIndexing_korean_unicodeScalars_Backwards 433328 399482 -7.8% 1.08x (?)
ObjectiveCBridgeFromNSSetAnyObjectForced 7296 6752 -7.5% 1.08x (?)
CharIndexing_tweet_unicodeScalars 753863 699120 -7.3% 1.08x (?)
CharIndexing_punctuated_unicodeScalars_Backwards 96687 90025 -6.9% 1.07x (?)
CharIndexing_ascii_unicodeScalars_Backwards 441520 411221 -6.9% 1.07x (?)
CharIndexing_punctuatedJapanese_unicodeScalars 67829 63636 -6.2% 1.07x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 44257 41578 -6.1% 1.06x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 40860 38504 -5.8% 1.06x (?)
BinaryFloatingPointConversionFromBinaryInteger 6217 5861 -5.7% 1.06x
SumUsingReduce 180328 170068 -5.7% 1.06x
PrefixWhileArrayLazy 12731 12020 -5.6% 1.06x
CharIteration_tweet_unicodeScalars_Backwards 682889 645597 -5.5% 1.06x (?)
CharIndexing_chinese_unicodeScalars_Backwards 331297 313406 -5.4% 1.06x (?)
SumUsingReduceInto 175059 165672 -5.4% 1.06x
StringInterpolation 14828 14049 -5.3% 1.06x
DropLastAnyCollectionLazy 36159 34265 -5.2% 1.06x (?)
No Changes (322)
TEST OLD NEW DELTA SPEEDUP
AngryPhonebook 5138 5126 -0.2% 1.00x (?)
AnyHashableWithAClass 87077 86633 -0.5% 1.01x
Array2D 632476 632410 -0.0% 1.00x (?)
ArrayAppend 4785 4784 -0.0% 1.00x (?)
ArrayAppendArrayOfInt 859 859 +0.0% 1.00x
ArrayAppendAscii 40384 40244 -0.3% 1.00x
ArrayAppendFromGeneric 867 865 -0.2% 1.00x (?)
ArrayAppendGenericStructs 1497 1494 -0.2% 1.00x (?)
ArrayAppendLatin1 63792 63741 -0.1% 1.00x (?)
ArrayAppendLazyMap 167998 167977 -0.0% 1.00x (?)
ArrayAppendOptionals 1498 1500 +0.1% 1.00x (?)
ArrayAppendRepeatCol 171354 170976 -0.2% 1.00x (?)
ArrayAppendReserved 4395 4398 +0.1% 1.00x (?)
ArrayAppendSequence 146710 148498 +1.2% 0.99x
ArrayAppendStrings 15414 15433 +0.1% 1.00x (?)
ArrayAppendToFromGeneric 863 862 -0.1% 1.00x (?)
ArrayAppendToGeneric 868 867 -0.1% 1.00x (?)
ArrayAppendUTF16 63188 63067 -0.2% 1.00x (?)
ArrayInClass 6339 6204 -2.1% 1.02x
ArrayLiteral 1784 1784 +0.0% 1.00x
ArrayOfGenericPOD2 1131 1152 +1.9% 0.98x
ArrayOfGenericRef 10065 10092 +0.3% 1.00x (?)
ArrayOfPOD 756 758 +0.3% 1.00x
ArrayOfRef 9318 9294 -0.3% 1.00x (?)
ArrayPlusEqualArrayOfInt 842 850 +1.0% 0.99x (?)
ArrayPlusEqualFiveElementCollection 231867 233167 +0.6% 0.99x (?)
ArrayPlusEqualSingleElementCollection 228767 233830 +2.2% 0.98x (?)
ArrayPlusEqualThreeElements 9028 9000 -0.3% 1.00x (?)
ArraySubscript 81960 81808 -0.2% 1.00x (?)
ArrayValueProp 3644 3687 +1.2% 0.99x (?)
ArrayValueProp2 16270 16066 -1.3% 1.01x (?)
ArrayValueProp3 4117 4129 +0.3% 1.00x
ArrayValueProp4 4069 4046 -0.6% 1.01x
BitCount 2102 2100 -0.1% 1.00x (?)
ByteSwap 3919 3920 +0.0% 1.00x
COWTree 11102 11080 -0.2% 1.00x (?)
CStringLongAscii 4778 4767 -0.2% 1.00x (?)
CStringLongNonAscii 2188 2217 +1.3% 0.99x (?)
CStringShortAscii 8120 8374 +3.1% 0.97x (?)
Calculator 1593 1602 +0.6% 0.99x
CaptureProp 339953 339394 -0.2% 1.00x (?)
CharIndexing_ascii_unicodeScalars 353682 353096 -0.2% 1.00x (?)
CharIndexing_chinese_unicodeScalars 279969 271827 -2.9% 1.03x (?)
CharIndexing_punctuated_unicodeScalars 79492 78441 -1.3% 1.01x (?)
CharIndexing_russian_unicodeScalars 296635 301060 +1.5% 0.99x (?)
CharIndexing_tweet_unicodeScalars_Backwards 818015 817187 -0.1% 1.00x (?)
CharIndexing_utf16_unicodeScalars_Backwards 343837 348717 +1.4% 0.99x (?)
CharIteration_ascii_unicodeScalars 153288 153635 +0.2% 1.00x (?)
CharIteration_chinese_unicodeScalars 116264 116303 +0.0% 1.00x (?)
CharIteration_chinese_unicodeScalars_Backwards 248216 255526 +2.9% 0.97x (?)
CharIteration_japanese_unicodeScalars 183747 183518 -0.1% 1.00x (?)
CharIteration_japanese_unicodeScalars_Backwards 442582 449021 +1.5% 0.99x (?)
CharIteration_korean_unicodeScalars 149189 148285 -0.6% 1.01x (?)
CharIteration_korean_unicodeScalars_Backwards 317656 311728 -1.9% 1.02x (?)
CharIteration_punctuatedJapanese_unicodeScalars 27468 27486 +0.1% 1.00x (?)
CharIteration_punctuatedJapanese_unicodeScalars_Backwards 57166 56494 -1.2% 1.01x (?)
CharIteration_punctuated_unicodeScalars 34498 34468 -0.1% 1.00x (?)
CharIteration_punctuated_unicodeScalars_Backwards 71454 71868 +0.6% 0.99x (?)
CharIteration_russian_unicodeScalars 127660 127892 +0.2% 1.00x (?)
CharIteration_tweet_unicodeScalars 303275 302765 -0.2% 1.00x (?)
CharacterLiteralsLarge 5992 6028 +0.6% 0.99x
CharacterLiteralsSmall 748 748 +0.0% 1.00x
CharacterPropertiesFetch 5519 5645 +2.3% 0.98x (?)
CharacterPropertiesPrecomputed 4191 4261 +1.7% 0.98x
CharacterPropertiesStashed 2329 2419 +3.9% 0.96x (?)
CharacterPropertiesStashedMemo 5136 4913 -4.3% 1.05x
Chars 39589 40142 +1.4% 0.99x
ClassArrayGetter 985 1001 +1.6% 0.98x
Combos 2260 2236 -1.1% 1.01x (?)
DictOfArraysToArrayOfDicts 3468 3512 +1.3% 0.99x
Dictionary 2627 2595 -1.2% 1.01x (?)
Dictionary2 2835 2828 -0.2% 1.00x
Dictionary2OfObjects 5503 5440 -1.1% 1.01x (?)
Dictionary3 1262 1261 -0.1% 1.00x (?)
Dictionary3OfObjects 2214 2216 +0.1% 1.00x (?)
DictionaryBridge 2182 2258 +3.5% 0.97x (?)
DictionaryGroup 4343 4334 -0.2% 1.00x
DictionaryGroupOfObjects 7554 7605 +0.7% 0.99x (?)
DictionaryLiteral 8611 8636 +0.3% 1.00x (?)
DictionaryOfObjects 6140 6300 +2.6% 0.97x (?)
DictionaryRemove 18211 18135 -0.4% 1.00x
DictionaryRemoveOfObjects 49742 49712 -0.1% 1.00x (?)
DictionarySubscriptDefaultMutation 2147 2105 -2.0% 1.02x
DictionarySubscriptDefaultMutationArray 2391 2382 -0.4% 1.00x (?)
DictionarySubscriptDefaultMutationArrayOfObjects 9064 9302 +2.6% 0.97x (?)
DictionarySubscriptDefaultMutationOfObjects 5693 5752 +1.0% 0.99x (?)
DictionarySwap 5203 5294 +1.7% 0.98x
DictionarySwapOfObjects 23128 22738 -1.7% 1.02x (?)
DoubleWidthDivision 23728 23650 -0.3% 1.00x (?)
DropFirstAnyCollection 14257 14201 -0.4% 1.00x (?)
DropFirstAnyCollectionLazy 106624 107151 +0.5% 1.00x (?)
DropFirstAnySeqCRangeIter 22529 22172 -1.6% 1.02x
DropFirstAnySeqCRangeIterLazy 22229 21730 -2.2% 1.02x
DropFirstAnySeqCntRange 14176 14195 +0.1% 1.00x (?)
DropFirstAnySeqCntRangeLazy 14282 14455 +1.2% 0.99x
DropFirstAnySequence 10958 10967 +0.1% 1.00x (?)
DropFirstAnySequenceLazy 11167 10884 -2.5% 1.03x
DropFirstArray 3772 3776 +0.1% 1.00x (?)
DropFirstArrayLazy 25320 25696 +1.5% 0.99x (?)
DropFirstCountableRange 326 326 +0.0% 1.00x
DropFirstCountableRangeLazy 26540 26426 -0.4% 1.00x (?)
DropFirstSequence 10706 10708 +0.0% 1.00x (?)
DropFirstSequenceLazy 10751 10683 -0.6% 1.01x
DropLastAnyCollection 4764 4751 -0.3% 1.00x (?)
DropLastAnySeqCRangeIter 38346 38433 +0.2% 1.00x (?)
DropLastAnySeqCRangeIterLazy 38452 38533 +0.2% 1.00x
DropLastAnySeqCntRange 4798 4768 -0.6% 1.01x
DropLastAnySeqCntRangeLazy 4745 4835 +1.9% 0.98x
DropLastAnySequence 28884 29007 +0.4% 1.00x (?)
DropLastAnySequenceLazy 28803 28760 -0.1% 1.00x (?)
DropLastCountableRange 113 113 +0.0% 1.00x
DropLastCountableRangeLazy 8885 8905 +0.2% 1.00x
DropLastSequence 28815 28904 +0.3% 1.00x
DropLastSequenceLazy 28648 28736 +0.3% 1.00x
DropWhileAnyCollection 18363 18369 +0.0% 1.00x (?)
DropWhileAnyCollectionLazy 19943 19647 -1.5% 1.02x (?)
DropWhileAnySeqCRangeIter 23556 23300 -1.1% 1.01x (?)
DropWhileAnySeqCRangeIterLazy 19726 19701 -0.1% 1.00x (?)
DropWhileAnySeqCntRange 18602 18404 -1.1% 1.01x (?)
DropWhileAnySeqCntRangeLazy 19966 19757 -1.0% 1.01x (?)
DropWhileAnySequence 12413 12340 -0.6% 1.01x
DropWhileAnySequenceLazy 10210 10115 -0.9% 1.01x
DropWhileArrayLazy 13629 13639 +0.1% 1.00x (?)
DropWhileCountableRange 4486 4462 -0.5% 1.01x
DropWhileCountableRangeLazy 19738 19411 -1.7% 1.02x
DropWhileSequence 12062 12317 +2.1% 0.98x
DropWhileSequenceLazy 9973 9814 -1.6% 1.02x
EqualStringSubstring 481 476 -1.0% 1.01x
EqualSubstringString 478 478 +0.0% 1.00x
EqualSubstringSubstring 478 478 +0.0% 1.00x
EqualSubstringSubstringGenericEquatable 489 489 +0.0% 1.00x
ErrorHandling 7774 7408 -4.7% 1.05x (?)
ExclusivityGlobal 183 183 +0.0% 1.00x
ExclusivityIndependent 69 72 +4.3% 0.96x
FilterEvenUsingReduce 3763 3853 +2.4% 0.98x (?)
FilterEvenUsingReduceInto 1985 1984 -0.1% 1.00x (?)
FrequenciesUsingReduce 10399 10485 +0.8% 0.99x (?)
FrequenciesUsingReduceInto 5396 5411 +0.3% 1.00x (?)
Hanoi 20277 20213 -0.3% 1.00x
HashTest 16764 16935 +1.0% 0.99x (?)
Histogram 6595 6615 +0.3% 1.00x (?)
Integrate 823 822 -0.1% 1.00x (?)
IterateData 7814 7877 +0.8% 0.99x
Join 1116 1104 -1.1% 1.01x
LazilyFilteredArrayContains 784759 787584 +0.4% 1.00x
LazilyFilteredArrays 1477523 1465717 -0.8% 1.01x
LazilyFilteredRange 489142 487888 -0.3% 1.00x (?)
LessSubstringSubstring 477 478 +0.2% 1.00x (?)
LessSubstringSubstringGenericComparable 487 485 -0.4% 1.00x
LinkedList 32193 32407 +0.7% 0.99x (?)
LuhnAlgoEager 5121 5186 +1.3% 0.99x (?)
LuhnAlgoLazy 5182 5361 +3.5% 0.97x
MapReduce 27333 27293 -0.1% 1.00x (?)
MapReduceAnyCollection 27361 27397 +0.1% 1.00x (?)
MapReduceAnyCollectionShort 39607 38648 -2.4% 1.02x (?)
MapReduceClass 33086 32195 -2.7% 1.03x
MapReduceClassShort 43662 44556 +2.0% 0.98x
MapReduceLazyCollection 23941 23331 -2.5% 1.03x
MapReduceLazyCollectionShort 34996 34027 -2.8% 1.03x (?)
MapReduceLazySequence 18203 18416 +1.2% 0.99x
MapReduceSequence 30883 30799 -0.3% 1.00x (?)
MapReduceShort 38777 38836 +0.2% 1.00x (?)
MapReduceShortString 246 256 +4.1% 0.96x (?)
MapReduceString 1977 1968 -0.5% 1.00x (?)
Memset 44479 44468 -0.0% 1.00x (?)
MonteCarloE 913527 897580 -1.7% 1.02x
MonteCarloPi 3915804 3974456 +1.5% 0.99x
NSDictionaryCastToSwift 6980 6901 -1.1% 1.01x (?)
NSError 747 731 -2.1% 1.02x (?)
NSStringConversion 358 358 +0.0% 1.00x
NibbleSort 304235 303264 -0.3% 1.00x (?)
NopDeinit 162451 162295 -0.1% 1.00x (?)
ObjectAllocation 1350 1374 +1.8% 0.98x (?)
ObjectiveCBridgeFromNSArrayAnyObject 24390 23766 -2.6% 1.03x (?)
ObjectiveCBridgeFromNSDictionaryAnyObject 132172 126356 -4.4% 1.05x (?)
ObjectiveCBridgeFromNSSetAnyObject 67308 68351 +1.5% 0.98x (?)
ObjectiveCBridgeFromNSSetAnyObjectToString 76642 79540 +3.8% 0.96x (?)
ObjectiveCBridgeFromNSStringForced 3259 3151 -3.3% 1.03x (?)
ObjectiveCBridgeStubDataAppend 4473 4405 -1.5% 1.02x (?)
ObjectiveCBridgeStubDateMutation 602 602 +0.0% 1.00x
ObjectiveCBridgeStubFromNSDate 4950 4905 -0.9% 1.01x (?)
ObjectiveCBridgeStubFromNSString 910 905 -0.5% 1.01x (?)
ObjectiveCBridgeStubFromNSStringRef 207 208 +0.5% 1.00x (?)
ObjectiveCBridgeStubNSDataAppend 2985 3057 +2.4% 0.98x (?)
ObjectiveCBridgeStubNSDateMutationRef 16473 16193 -1.7% 1.02x (?)
ObjectiveCBridgeStubToArrayOfNSString 29601 29697 +0.3% 1.00x (?)
ObjectiveCBridgeStubToNSDate 16014 15452 -3.5% 1.04x (?)
ObjectiveCBridgeStubToNSString 1574 1572 -0.1% 1.00x (?)
ObjectiveCBridgeStubToNSStringRef 165 165 +0.0% 1.00x
ObjectiveCBridgeStubURLAppendPath 335685 334201 -0.4% 1.00x (?)
ObjectiveCBridgeStubURLAppendPathRef 336478 342665 +1.8% 0.98x
ObjectiveCBridgeToNSArray 30310 29934 -1.2% 1.01x
ObjectiveCBridgeToNSDictionary 56692 56252 -0.8% 1.01x (?)
ObjectiveCBridgeToNSSet 48208 48465 +0.5% 0.99x (?)
ObjectiveCBridgeToNSString 1345 1344 -0.1% 1.00x
ObserverClosure 6352 6346 -0.1% 1.00x (?)
ObserverForwarderStruct 4363 4448 +1.9% 0.98x
ObserverPartiallyAppliedMethod 7800 7798 -0.0% 1.00x (?)
ObserverUnappliedMethod 7972 8018 +0.6% 0.99x
OpenClose 561 564 +0.5% 0.99x (?)
PartialApplyDynamicType 40403 41060 +1.6% 0.98x
Phonebook 20623 20475 -0.7% 1.01x
PolymorphicCalls 5966 6170 +3.4% 0.97x (?)
PopFrontArray 4637 4526 -2.4% 1.02x
PopFrontArrayGeneric 5780 5805 +0.4% 1.00x
PopFrontUnsafePointer 11220 11268 +0.4% 1.00x (?)
PrefixAnyCollection 14230 14207 -0.2% 1.00x (?)
PrefixAnyCollectionLazy 106165 104264 -1.8% 1.02x (?)
PrefixAnySeqCRangeIter 18083 17606 -2.6% 1.03x
PrefixAnySeqCRangeIterLazy 17944 17496 -2.5% 1.03x
PrefixAnySeqCntRange 14177 14166 -0.1% 1.00x (?)
PrefixAnySeqCntRangeLazy 14277 14452 +1.2% 0.99x (?)
PrefixAnySequence 9362 9153 -2.2% 1.02x
PrefixAnySequenceLazy 9147 9099 -0.5% 1.01x (?)
PrefixArray 3740 3766 +0.7% 0.99x
PrefixArrayLazy 25320 25195 -0.5% 1.00x (?)
PrefixCountableRange 326 325 -0.3% 1.00x
PrefixCountableRangeLazy 26746 26467 -1.0% 1.01x (?)
PrefixSequence 8801 8834 +0.4% 1.00x (?)
PrefixSequenceLazy 8941 8778 -1.8% 1.02x
PrefixWhileAnyCollection 26303 26277 -0.1% 1.00x
PrefixWhileAnyCollectionLazy 16729 16412 -1.9% 1.02x
PrefixWhileAnySeqCRangeIter 34899 33907 -2.8% 1.03x
PrefixWhileAnySeqCRangeIterLazy 16878 16480 -2.4% 1.02x (?)
PrefixWhileAnySeqCntRange 26562 26668 +0.4% 1.00x
PrefixWhileAnySeqCntRangeLazy 16776 16555 -1.3% 1.01x
PrefixWhileAnySequence 26437 26497 +0.2% 1.00x (?)
PrefixWhileAnySequenceLazy 9297 9201 -1.0% 1.01x (?)
PrefixWhileArray 11514 11548 +0.3% 1.00x (?)
PrefixWhileCountableRange 12600 12552 -0.4% 1.00x
PrefixWhileCountableRangeLazy 16739 16194 -3.3% 1.03x
PrefixWhileSequence 26398 26179 -0.8% 1.01x
PrefixWhileSequenceLazy 9088 8893 -2.1% 1.02x
Prims 9598 9802 +2.1% 0.98x (?)
PrimsSplit 9712 9760 +0.5% 1.00x (?)
RC4 16570 16583 +0.1% 1.00x (?)
RGBHistogram 26976 26901 -0.3% 1.00x
RGBHistogramOfObjects 96967 96747 -0.2% 1.00x (?)
RangeAssignment 2761 2736 -0.9% 1.01x (?)
RangeIterationSigned 17022 16981 -0.2% 1.00x (?)
RangeIterationSigned64 41022 40694 -0.8% 1.01x (?)
RangeIterationUnsigned 36435 36084 -1.0% 1.01x (?)
RangeReplaceableCollectionPlusDefault 8257 8213 -0.5% 1.01x (?)
RecursiveOwnedParameter 7941 7863 -1.0% 1.01x (?)
ReversedArray 13043 13046 +0.0% 1.00x (?)
ReversedBidirectional 42383 43410 +2.4% 0.98x
ReversedDictionary 22908 23050 +0.6% 0.99x
RomanNumbers 1188518 1226831 +3.2% 0.97x (?)
SetExclusiveOr 17294 17472 +1.0% 0.99x (?)
SetExclusiveOr_OfObjects 41783 42136 +0.8% 0.99x
SetIntersect 8274 8260 -0.2% 1.00x (?)
SetIntersect_OfObjects 12523 12442 -0.6% 1.01x (?)
SetIsSubsetOf 1362 1349 -1.0% 1.01x (?)
SetIsSubsetOf_OfObjects 1556 1553 -0.2% 1.00x (?)
SetUnion 11882 11903 +0.2% 1.00x (?)
SetUnion_OfObjects 29159 29887 +2.5% 0.98x
SevenBoom 1755 1686 -3.9% 1.04x (?)
Sim2DArray 43531 43593 +0.1% 1.00x
SortLargeExistentials 15714 15723 +0.1% 1.00x (?)
SortLettersInPlace 2841 2855 +0.5% 1.00x (?)
SortSortedStrings 1359 1352 -0.5% 1.01x
SortStrings 2475 2509 +1.4% 0.99x
SortStringsUnicode 16354 16346 -0.0% 1.00x (?)
StackPromo 91081 94028 +3.2% 0.97x (?)
StaticArray 2693 2692 -0.0% 1.00x (?)
StrComplexWalk 6666 6666 +0.0% 1.00x
StrToInt 58555 57518 -1.8% 1.02x (?)
StringAdder 4762 4790 +0.6% 0.99x
StringBuilder 6845 6865 +0.3% 1.00x (?)
StringBuilderLong 2722 2714 -0.3% 1.00x (?)
StringComparison_abnormal 1419 1418 -0.1% 1.00x (?)
StringComparison_ascii 9720 9575 -1.5% 1.02x
StringComparison_emoji 3806 3800 -0.2% 1.00x (?)
StringComparison_fastPrenormal 13266 13250 -0.1% 1.00x (?)
StringComparison_latin1 9554 9478 -0.8% 1.01x
StringComparison_longSharedPrefix 13068 13069 +0.0% 1.00x (?)
StringComparison_nonBMPSlowestPrenormal 6942 6928 -0.2% 1.00x (?)
StringComparison_slowerPrenormal 6838 6868 +0.4% 1.00x (?)
StringComparison_zalgo 2850 2851 +0.0% 1.00x (?)
StringEdits 349732 338374 -3.2% 1.03x (?)
StringEnumRawValueInitialization 20697 20772 +0.4% 1.00x (?)
StringEqualPointerComparison 3151 3150 -0.0% 1.00x (?)
StringFromLongWholeSubstring 23 23 +0.0% 1.00x
StringFromLongWholeSubstringGeneric 208 204 -1.9% 1.02x
StringHasPrefixAscii 2967 2972 +0.2% 1.00x (?)
StringHasPrefixUnicode 31184 31076 -0.3% 1.00x
StringHasSuffixAscii 3101 3101 +0.0% 1.00x
StringHasSuffixUnicode 88247 88400 +0.2% 1.00x (?)
StringMatch 37064 37214 +0.4% 1.00x (?)
StringRemoveDupes 1422 1403 -1.3% 1.01x
StringWalk 12894 12929 +0.3% 1.00x (?)
StringWithCString 39782 39620 -0.4% 1.00x
StringWordBuilder 2519 2515 -0.2% 1.00x (?)
StringWordBuilderReservingCapacity 2195 2177 -0.8% 1.01x
SubstringComparable 4154 4195 +1.0% 0.99x
SubstringEqualString 3467 3492 +0.7% 0.99x
SubstringEquatable 7967 8060 +1.2% 0.99x (?)
SubstringFromLongString 24 24 +0.0% 1.00x
SubstringFromLongStringGeneric 104 102 -1.9% 1.02x
SuffixAnyCollection 4776 4759 -0.4% 1.00x (?)
SuffixAnyCollectionLazy 35358 36362 +2.8% 0.97x (?)
SuffixAnySeqCRangeIter 34659 34795 +0.4% 1.00x (?)
SuffixAnySeqCRangeIterLazy 34927 34446 -1.4% 1.01x
SuffixAnySeqCntRange 4805 4735 -1.5% 1.01x
SuffixAnySeqCntRangeLazy 4770 4821 +1.1% 0.99x
SuffixAnySequence 25197 25108 -0.4% 1.00x (?)
SuffixAnySequenceLazy 25018 25078 +0.2% 1.00x (?)
SuffixCountableRange 113 113 +0.0% 1.00x
SuffixCountableRangeLazy 8881 8907 +0.3% 1.00x (?)
SuffixSequence 25199 25210 +0.0% 1.00x (?)
SuffixSequenceLazy 25312 25033 -1.1% 1.01x
SuperChars 210841 219761 +4.2% 0.96x
TwoSum 3932 3941 +0.2% 1.00x (?)
TypeFlood 164 158 -3.7% 1.04x (?)
UTF8Decode 30031 30892 +2.9% 0.97x
Walsh 11940 11929 -0.1% 1.00x (?)
WordCountHistogramASCII 47914 49775 +3.9% 0.96x
WordCountHistogramUTF16 105017 105416 +0.4% 1.00x (?)
WordCountUniqueASCII 7985 8043 +0.7% 0.99x
WordCountUniqueUTF16 34119 32936 -3.5% 1.04x (?)
WordSplitASCII 25452 24812 -2.5% 1.03x (?)
WordSplitUTF16 26298 26594 +1.1% 0.99x (?)
Added (3)
TEST MIN MAX MEAN MAX_RSS
CSVParsing 2514041 2579726 2545896 334925824
CSVParsingAlt 1360015 1396809 1372744 334953131
CSVParsingAltIndices 2637047 2731143 2672746 334964053
Hardware Overview 
  Model Name: Mac Pro
  Model Identifier: MacPro6,1
  Processor Name: 12-Core Intel Xeon E5
  Processor Speed: 2.7 GHz
  Number of Processors: 1
  Total Number of Cores: 12
  L2 Cache (per Core): 256 KB
  L3 Cache: 30 MB
  Memory: 64 GB

@lancep
Copy link
Contributor

lancep commented Feb 1, 2018

@swift-ci please smoke test and merge

@swift-ci swift-ci merged commit 6dc76e6 into master Feb 1, 2018
@milseman milseman deleted the revert-14220-skip-csv-benchmarks branch February 1, 2018 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@airspeedswift airspeedswift Awaiting requested review from airspeedswift

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@milseman @jrose-apple @airspeedswift @lancep @swift-ci