Skip to content

Update prefix-drop regression test #8194

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Mar 22, 2017
Merged

Update prefix-drop regression test #8194

merged 1 commit into from
Mar 22, 2017

Conversation

CodaFi
Copy link
Contributor

@CodaFi CodaFi commented Mar 20, 2017

Updates the regression test and provides us an opportunity to benchmark the prefix-drop optimization change.

@CodaFi CodaFi requested a review from dabrahams March 20, 2017 06:15
@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 20, 2017

@swift-ci benchmark

@swift-ci
Copy link
Contributor

Build comment file:

Optimized (O)

Regression (2)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
PopFrontArray 1063 1156 +8.8% 0.92x(?)
PopFrontUnsafePointer 8620 9244 +7.2% 0.93x(?)
Improvement (0)
No Changes (190)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
SuffixArray 31 30 -3.2% 1.03x(?)
ObjectiveCBridgeStubToNSDateRef 3198 3148 -1.6% 1.02x(?)
ArrayInClass 59 58 -1.7% 1.02x(?)
StringInterpolation 8925 8857 -0.8% 1.01x(?)
ObserverUnappliedMethod 2562 2548 -0.6% 1.01x(?)
ObjectiveCBridgeStubURLAppendPathRef 211056 209234 -0.9% 1.01x(?)
ObjectiveCBridgeToNSSet 34907 34563 -1.0% 1.01x(?)
MapReduceShort 1849 1839 -0.5% 1.01x(?)
ObjectiveCBridgeStubURLAppendPath 211621 209763 -0.9% 1.01x(?)
StringHasSuffix 640 636 -0.6% 1.01x(?)
ObjectiveCBridgeStubFromArrayOfNSString 49858 49573 -0.6% 1.01x(?)
TwoSum 1187 1180 -0.6% 1.01x(?)
DropLastSequence 4386 4387 +0.0% 1.00x(?)
ArraySubscript 1440 1438 -0.1% 1.00x(?)
DictionarySwapOfObjects 6546 6543 -0.1% 1.00x(?)
StackPromo 22018 22055 +0.2% 1.00x(?)
ObjectiveCBridgeFromNSDictionaryAnyObject 111945 111479 -0.4% 1.00x(?)
RecursiveOwnedParameter 2192 2193 +0.1% 1.00x(?)
Integrate 247 247 +0.0% 1.00x
DropLastAnySequence 6051 6050 -0.0% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 40817 40679 -0.3% 1.00x(?)
StringAdder 1531 1530 -0.1% 1.00x(?)
Array2D 1938 1936 -0.1% 1.00x(?)
Histogram 233 233 +0.0% 1.00x
SortStrings 1596 1597 +0.1% 1.00x(?)
DictionaryBridge 2909 2912 +0.1% 1.00x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectForced 4621 4620 -0.0% 1.00x(?)
ProtocolDispatch2 141 141 +0.0% 1.00x
ObjectiveCBridgeStubFromNSDateRef 3521 3524 +0.1% 1.00x(?)
MonteCarloPi 42338 42342 +0.0% 1.00x(?)
StringWithCString 148209 148161 -0.0% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 4185 4180 -0.1% 1.00x(?)
ObjectiveCBridgeFromNSStringForced 2162 2161 -0.1% 1.00x(?)
Prims 717 714 -0.4% 1.00x(?)
SortLettersInPlace 1085 1084 -0.1% 1.00x(?)
DictionarySwap 350 350 +0.0% 1.00x
ReversedDictionary 109 109 +0.0% 1.00x
ArrayAppendToFromGeneric 562 562 +0.0% 1.00x
MapReduceString 70 70 +0.0% 1.00x
ArrayAppendReserved 504 503 -0.2% 1.00x(?)
Dictionary3OfObjects 1004 1004 +0.0% 1.00x
StringUTF16Builder 2073 2074 +0.1% 1.00x(?)
MapReduceLazyCollectionShort 43 43 +0.0% 1.00x
StringHasPrefix 573 573 +0.0% 1.00x
ByteSwap 0 0 +0.0% 1.00x
ArrayAppendGenericStructs 1136 1136 +0.0% 1.00x
SuperChars 218632 218587 -0.0% 1.00x(?)
ArrayAppendLazyMap 859 860 +0.1% 1.00x(?)
ArrayPlusEqualFiveElementCollection 51871 51688 -0.3% 1.00x(?)
ObjectiveCBridgeStubToNSDate 13966 14019 +0.4% 1.00x(?)
XorLoop 333 333 +0.0% 1.00x
SuffixAnySequence 6057 6057 +0.0% 1.00x
ObserverClosure 2103 2103 +0.0% 1.00x
AnyHashableWithAClass 63941 63926 -0.0% 1.00x(?)
CharacterLiteralsSmall 759 759 +0.0% 1.00x
LazilyFilteredRange 6864 6864 +0.0% 1.00x
ObjectiveCBridgeStubToNSString 1445 1447 +0.1% 1.00x(?)
ArrayPlusEqualSingleElementCollection 46607 46625 +0.0% 1.00x(?)
ArrayAppendStrings 12738 12743 +0.0% 1.00x(?)
Join 461 461 +0.0% 1.00x
ObjectiveCBridgeStubFromNSStringRef 199 200 +0.5% 1.00x(?)
ObjectiveCBridgeStubFromNSString 882 882 +0.0% 1.00x
StaticArray 145 145 +0.0% 1.00x
ProtocolDispatch 2859 2859 +0.0% 1.00x
ObjectAllocation 167 167 +0.0% 1.00x
TypeFlood 0 0 +0.0% 1.00x
SortSortedStrings 794 794 +0.0% 1.00x
ObjectiveCBridgeFromNSSetAnyObject 60429 60364 -0.1% 1.00x(?)
ArrayLiteral 1156 1154 -0.2% 1.00x(?)
ArrayAppendLatin1 42175 42176 +0.0% 1.00x(?)
CStringLongAscii 7558 7556 -0.0% 1.00x(?)
CharacterLiteralsLarge 11752 11755 +0.0% 1.00x(?)
Walsh 332 332 +0.0% 1.00x
StringBuilderLong 906 910 +0.4% 1.00x(?)
Dictionary3 558 558 +0.0% 1.00x
Dictionary2 2013 2013 +0.0% 1.00x
SetIntersect_OfObjects 1611 1617 +0.4% 1.00x(?)
ErrorHandling 2796 2791 -0.2% 1.00x(?)
ArrayOfRef 3746 3748 +0.1% 1.00x(?)
ArrayAppendOptionals 1137 1135 -0.2% 1.00x(?)
OpenClose 52 52 +0.0% 1.00x
ObjectiveCBridgeToNSArray 26941 26953 +0.0% 1.00x(?)
NSError 338 338 +0.0% 1.00x
DictionaryOfObjects 2421 2419 -0.1% 1.00x(?)
PopFrontArrayGeneric 1156 1156 +0.0% 1.00x
StringEqualPointerComparison 6846 6846 +0.0% 1.00x
CaptureProp 4577 4577 +0.0% 1.00x
MapReduceAnyCollectionShort 2022 2023 +0.1% 1.00x(?)
ClassArrayGetter 13 13 +0.0% 1.00x
RC4 149 149 +0.0% 1.00x
ObjectiveCBridgeStubToNSStringRef 122 122 +0.0% 1.00x
Calculator 30 30 +0.0% 1.00x
ArrayAppendFromGeneric 562 562 +0.0% 1.00x
MapReduce 294 294 +0.0% 1.00x
MapReduceSequence 507 507 +0.0% 1.00x
ObjectiveCBridgeStubDateMutation 257 257 +0.0% 1.00x
ArrayAppendUTF16 38906 38909 +0.0% 1.00x(?)
IterateData 2629 2631 +0.1% 1.00x(?)
DictionaryLiteral 1394 1394 +0.0% 1.00x
Hanoi 3238 3238 +0.0% 1.00x
ArrayOfGenericPOD 207 207 +0.0% 1.00x
DictionaryRemoveOfObjects 21015 21015 +0.0% 1.00x
UTF8Decode 269 269 +0.0% 1.00x
SortStringsUnicode 7282 7279 -0.0% 1.00x(?)
MapReduceLazySequence 85 85 +0.0% 1.00x
SetExclusiveOr 2458 2470 +0.5% 1.00x(?)
LazilyFilteredArrays 68960 68978 +0.0% 1.00x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToStringForced 90887 90650 -0.3% 1.00x(?)
SetIsSubsetOf 271 271 +0.0% 1.00x
Dictionary 756 755 -0.1% 1.00x(?)
NopDeinit 21596 21589 -0.0% 1.00x(?)
CStringShortAscii 4895 4894 -0.0% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObject 22158 22239 +0.4% 1.00x(?)
SetIntersect 314 313 -0.3% 1.00x(?)
ObjectiveCBridgeStubDataAppend 3487 3485 -0.1% 1.00x(?)
MapReduceClassShort 4481 4483 +0.0% 1.00x(?)
NSDictionaryCastToSwift 5043 5061 +0.4% 1.00x(?)
ObjectiveCBridgeFromNSSetAnyObjectToString 75256 75050 -0.3% 1.00x(?)
ObjectiveCBridgeStubNSDateRefAccess 294 294 +0.0% 1.00x
191 9313792 9300807 -0.1% 1.00x
ArrayOfGenericRef 3793 3793 +0.0% 1.00x
ObjectiveCBridgeFromNSString 1322 1321 -0.1% 1.00x(?)
Phonebook 6927 6925 -0.0% 1.00x(?)
PolymorphicCalls 20 20 +0.0% 1.00x
Sim2DArray 260 260 +0.0% 1.00x
SetExclusiveOr_OfObjects 7434 7428 -0.1% 1.00x(?)
ArrayAppendRepeatCol 791 791 +0.0% 1.00x
MapReduceShortString 18 18 +0.0% 1.00x
StringEdits 490249 490325 +0.0% 1.00x(?)
ArrayAppendAscii 18833 18833 +0.0% 1.00x
MonteCarloE 9919 9924 +0.1% 1.00x(?)
SetUnion_OfObjects 6011 6017 +0.1% 1.00x(?)
ReversedBidirectional 46968 46988 +0.0% 1.00x(?)
StringHasSuffixUnicode 57895 57914 +0.0% 1.00x(?)
ArrayAppendToGeneric 563 562 -0.2% 1.00x(?)
HashTest 1637 1638 +0.1% 1.00x(?)
SetIsSubsetOf_OfObjects 338 338 +0.0% 1.00x
HashQuadratic 5963623 5961262 -0.0% 1.00x(?)
ArrayAppend 732 731 -0.1% 1.00x(?)
DictionaryRemove 2957 2959 +0.1% 1.00x(?)
StringHasPrefixUnicode 13367 13372 +0.0% 1.00x(?)
LinkedList 6776 6776 +0.0% 1.00x
SuffixCountableRange 27 27 +0.0% 1.00x
MapReduceAnyCollection 286 285 -0.3% 1.00x(?)
StringMatch 35165 35164 -0.0% 1.00x(?)
ObjectiveCBridgeFromNSSetAnyObjectToStringForced 66388 66477 +0.1% 1.00x(?)
RGBHistogramOfObjects 22939 22960 +0.1% 1.00x(?)
NSStringConversion 681 680 -0.1% 1.00x(?)
MapReduceLazyCollection 15 15 +0.0% 1.00x
ObjectiveCBridgeFromNSSetAnyObjectForced 3885 3883 -0.1% 1.00x(?)
ArrayAppendSequence 923 922 -0.1% 1.00x(?)
ArrayAppendArrayOfInt 562 562 +0.0% 1.00x
ArrayOfPOD 156 156 +0.0% 1.00x
SetUnion 2029 2023 -0.3% 1.00x(?)
Chars 1381 1381 +0.0% 1.00x
RGBHistogram 2486 2482 -0.2% 1.00x(?)
ReversedArray 46 46 +0.0% 1.00x
StringBuilder 1265 1261 -0.3% 1.00x(?)
ObserverForwarderStruct 1019 1021 +0.2% 1.00x(?)
CStringLongNonAscii 2709 2715 +0.2% 1.00x(?)
DeadArray 174 174 +0.0% 1.00x
ArrayValueProp2 5 5 +0.0% 1.00x
BitCount 1 1 +0.0% 1.00x
StrToInt 5631 5629 -0.0% 1.00x(?)
AngryPhonebook 2782 2777 -0.2% 1.00x(?)
ArrayPlusEqualArrayOfInt 562 562 +0.0% 1.00x
SevenBoom 1429 1427 -0.1% 1.00x(?)
DropLastCountableRange 26 26 +0.0% 1.00x
SuffixSequence 4679 4672 -0.1% 1.00x(?)
StringWalk 5504 5504 +0.0% 1.00x
ArrayValueProp 5 5 +0.0% 1.00x
MapReduceClass 2864 2868 +0.1% 1.00x(?)
ObjectiveCBridgeStubNSDateMutationRef 12037 12049 +0.1% 1.00x(?)
GlobalClass 0 0 +0.0% 1.00x
Memset 221 221 +0.0% 1.00x
Dictionary2OfObjects 3456 3460 +0.1% 1.00x(?)
ArrayValueProp4 5 5 +0.0% 1.00x
ObjectiveCBridgeStubDateAccess 171 171 +0.0% 1.00x
ArrayValueProp3 5 5 +0.0% 1.00x
ObjectiveCBridgeStubFromNSDate 3534 3533 -0.0% 1.00x(?)
ObserverPartiallyAppliedMethod 3607 3608 +0.0% 1.00x(?)
ObjectiveCBridgeToNSString 1221 1228 +0.6% 0.99x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 129390 130477 +0.8% 0.99x(?)
RangeAssignment 291 295 +1.4% 0.99x(?)
ObjectiveCBridgeStubToArrayOfNSString 26136 26432 +1.1% 0.99x(?)
ObjectiveCBridgeToNSDictionary 56830 57388 +1.0% 0.99x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 67334 67734 +0.6% 0.99x(?)
ObjectiveCBridgeStubNSDataAppend 2115 2126 +0.5% 0.99x(?)
StrComplexWalk 2682 2724 +1.6% 0.98x(?)
DropLastArray 28 29 +3.6% 0.97x
**Unoptimized (Onone)**
Regression (0)
Improvement (1)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
ObjectiveCBridgeStubURLAppendPath 217136 204070 -6.0% 1.06x(?)
No Changes (191)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 140291 136177 -2.9% 1.03x(?)
ObjectiveCBridgeStubURLAppendPathRef 213540 207798 -2.7% 1.03x(?)
ObjectiveCBridgeStubNSDateMutationRef 14837 14413 -2.9% 1.03x(?)
ObjectiveCBridgeFromNSSetAnyObjectToString 82159 79919 -2.7% 1.03x(?)
ObjectiveCBridgeStubToNSDate 14096 13877 -1.6% 1.02x(?)
ObjectiveCBridgeStubDataAppend 3609 3545 -1.8% 1.02x(?)
ObserverClosure 6382 6295 -1.4% 1.01x(?)
ObjectiveCBridgeFromNSSetAnyObject 63974 63321 -1.0% 1.01x(?)
MapReduceShort 44741 44265 -1.1% 1.01x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToStringForced 93753 92797 -1.0% 1.01x(?)
NSDictionaryCastToSwift 5984 5943 -0.7% 1.01x(?)
MapReduceShortString 222 220 -0.9% 1.01x(?)
SuffixCountableRange 136 135 -0.7% 1.01x(?)
MapReduceLazyCollection 32203 32034 -0.5% 1.01x(?)
RGBHistogram 30177 29988 -0.6% 1.01x(?)
StringWalk 21364 21161 -0.9% 1.01x(?)
StringHasSuffix 1595 1587 -0.5% 1.01x(?)
TwoSum 4438 4414 -0.5% 1.01x(?)
DropLastSequence 39797 39796 -0.0% 1.00x(?)
ArraySubscript 3937 3949 +0.3% 1.00x(?)
ObjectiveCBridgeToNSString 1236 1241 +0.4% 1.00x(?)
DictionarySwapOfObjects 19011 19056 +0.2% 1.00x
StackPromo 91216 91329 +0.1% 1.00x(?)
PopFrontArray 10345 10345 +0.0% 1.00x
RecursiveOwnedParameter 8878 8877 -0.0% 1.00x(?)
Integrate 373 373 +0.0% 1.00x
DropLastAnySequence 6089 6089 +0.0% 1.00x
ObjectiveCBridgeFromNSArrayAnyObjectToString 42162 42364 +0.5% 1.00x(?)
ClassArrayGetter 874 874 +0.0% 1.00x
Array2D 572645 572631 -0.0% 1.00x(?)
Histogram 8043 8041 -0.0% 1.00x(?)
SortStrings 2497 2497 +0.0% 1.00x
ObjectiveCBridgeFromNSDictionaryAnyObjectForced 6824 6802 -0.3% 1.00x(?)
ArrayAppendLatin1 99328 99296 -0.0% 1.00x(?)
ObjectiveCBridgeStubFromNSDateRef 3983 3981 -0.1% 1.00x(?)
MonteCarloPi 50674 50678 +0.0% 1.00x(?)
StringWithCString 319370 319399 +0.0% 1.00x(?)
ObjectiveCBridgeFromNSStringForced 2527 2527 +0.0% 1.00x
Prims 8442 8443 +0.0% 1.00x(?)
SortLettersInPlace 2596 2596 +0.0% 1.00x
DictionarySwap 5058 5052 -0.1% 1.00x(?)
ReversedDictionary 23351 23365 +0.1% 1.00x(?)
ArrayAppendToFromGeneric 619 619 +0.0% 1.00x
MapReduceString 2109 2113 +0.2% 1.00x
ObjectiveCBridgeFromNSDictionaryAnyObject 114228 114254 +0.0% 1.00x(?)
Dictionary3OfObjects 2210 2211 +0.1% 1.00x(?)
MapReduceLazyCollectionShort 41722 41655 -0.2% 1.00x(?)
StringHasPrefix 1558 1555 -0.2% 1.00x(?)
ByteSwap 9 9 +0.0% 1.00x
ArrayAppendGenericStructs 1197 1197 +0.0% 1.00x
SuperChars 266574 266662 +0.0% 1.00x(?)
ArrayAppendLazyMap 211153 211070 -0.0% 1.00x(?)
ArrayPlusEqualFiveElementCollection 253031 252779 -0.1% 1.00x(?)
XorLoop 21521 21518 -0.0% 1.00x(?)
SuffixAnySequence 6102 6103 +0.0% 1.00x(?)
StringInterpolation 13986 13972 -0.1% 1.00x(?)
AnyHashableWithAClass 78974 78972 -0.0% 1.00x(?)
CharacterLiteralsSmall 972 972 +0.0% 1.00x
LazilyFilteredRange 1189629 1190147 +0.0% 1.00x(?)
ObjectiveCBridgeStubToNSString 1481 1482 +0.1% 1.00x(?)
ArrayPlusEqualSingleElementCollection 251036 251741 +0.3% 1.00x(?)
ArrayAppendStrings 12843 12848 +0.0% 1.00x(?)
Join 1248 1248 +0.0% 1.00x
ObjectiveCBridgeStubFromNSStringRef 228 228 +0.0% 1.00x
ObjectiveCBridgeStubFromNSString 928 924 -0.4% 1.00x(?)
StaticArray 4318 4326 +0.2% 1.00x(?)
ProtocolDispatch 6001 6009 +0.1% 1.00x(?)
ObjectAllocation 600 598 -0.3% 1.00x(?)
SortSortedStrings 1332 1329 -0.2% 1.00x(?)
ProtocolDispatch2 400 401 +0.2% 1.00x
CStringLongAscii 16183 16186 +0.0% 1.00x(?)
CharacterLiteralsLarge 13231 13240 +0.1% 1.00x(?)
Walsh 11194 11202 +0.1% 1.00x(?)
StringBuilderLong 1089 1090 +0.1% 1.00x(?)
Dictionary3 1366 1367 +0.1% 1.00x(?)
Dictionary2 3597 3594 -0.1% 1.00x(?)
StrComplexWalk 8081 8103 +0.3% 1.00x(?)
SetIntersect_OfObjects 10527 10532 +0.1% 1.00x(?)
ErrorHandling 3689 3693 +0.1% 1.00x(?)
ArrayOfRef 8141 8134 -0.1% 1.00x(?)
ObserverUnappliedMethod 8012 8028 +0.2% 1.00x(?)
ObjectiveCBridgeToNSSet 35110 35130 +0.1% 1.00x(?)
ArrayAppendOptionals 1196 1195 -0.1% 1.00x(?)
DropLastArray 2001 2000 -0.1% 1.00x(?)
OpenClose 381 381 +0.0% 1.00x
DictionaryOfObjects 4539 4547 +0.2% 1.00x(?)
PopFrontArrayGeneric 7766 7774 +0.1% 1.00x(?)
PopFrontUnsafePointer 168200 168150 -0.0% 1.00x(?)
StringEqualPointerComparison 9140 9143 +0.0% 1.00x(?)
CaptureProp 94262 94212 -0.1% 1.00x(?)
MapReduceAnyCollectionShort 44515 44347 -0.4% 1.00x(?)
StringAdder 1672 1673 +0.1% 1.00x(?)
RC4 6775 6769 -0.1% 1.00x(?)
ObjectiveCBridgeStubToNSStringRef 160 160 +0.0% 1.00x
ArrayAppendFromGeneric 621 620 -0.2% 1.00x(?)
MapReduce 34274 34348 +0.2% 1.00x(?)
191 56134033 56257276 +0.2% 1.00x
MapReduceSequence 38539 38592 +0.1% 1.00x(?)
ObjectiveCBridgeStubDateMutation 486 486 +0.0% 1.00x
ArrayAppendUTF16 98888 98932 +0.0% 1.00x(?)
IterateData 10593 10592 -0.0% 1.00x(?)
Hanoi 15849 15853 +0.0% 1.00x(?)
ArrayOfGenericPOD 2897 2898 +0.0% 1.00x(?)
UTF8Decode 35014 35024 +0.0% 1.00x(?)
SortStringsUnicode 8493 8502 +0.1% 1.00x(?)
MapReduceLazySequence 26370 26362 -0.0% 1.00x(?)
SetExclusiveOr 19689 19669 -0.1% 1.00x(?)
LazilyFilteredArrays 2555882 2560551 +0.2% 1.00x(?)
SetIsSubsetOf 1529 1524 -0.3% 1.00x(?)
Dictionary 1743 1743 +0.0% 1.00x
NopDeinit 43814 43805 -0.0% 1.00x(?)
ObjectiveCBridgeStubToArrayOfNSString 26629 26535 -0.3% 1.00x(?)
CStringShortAscii 8576 8564 -0.1% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObject 24208 24258 +0.2% 1.00x(?)
SetIntersect 10052 10059 +0.1% 1.00x(?)
MapReduceClassShort 48262 48403 +0.3% 1.00x(?)
RGBHistogramOfObjects 81349 81302 -0.1% 1.00x(?)
ObjectiveCBridgeStubNSDateRefAccess 1138 1139 +0.1% 1.00x(?)
ArrayInClass 4372 4387 +0.3% 1.00x(?)
ArrayOfGenericRef 9125 9133 +0.1% 1.00x(?)
ObjectiveCBridgeFromNSString 3765 3767 +0.1% 1.00x(?)
Phonebook 20533 20519 -0.1% 1.00x(?)
PolymorphicCalls 742 741 -0.1% 1.00x(?)
Sim2DArray 27951 27950 -0.0% 1.00x(?)
SetExclusiveOr_OfObjects 38709 38651 -0.1% 1.00x(?)
ArrayAppendRepeatCol 196418 196462 +0.0% 1.00x(?)
ObjectiveCBridgeToNSDictionary 57774 57614 -0.3% 1.00x(?)
ArrayAppendAscii 81277 80922 -0.4% 1.00x(?)
MonteCarloE 80761 80773 +0.0% 1.00x(?)
SetUnion_OfObjects 27993 27971 -0.1% 1.00x(?)
ReversedBidirectional 135323 135268 -0.0% 1.00x(?)
StringHasSuffixUnicode 59225 59290 +0.1% 1.00x(?)
ArrayAppendToGeneric 620 620 +0.0% 1.00x
HashTest 5668 5667 -0.0% 1.00x(?)
SetIsSubsetOf_OfObjects 1522 1522 +0.0% 1.00x
HashQuadratic 45100052 45121220 +0.1% 1.00x(?)
ArrayAppend 3575 3577 +0.1% 1.00x(?)
DictionaryRemove 18031 18034 +0.0% 1.00x(?)
ArrayAppendReserved 3225 3224 -0.0% 1.00x(?)
StringHasPrefixUnicode 14798 14805 +0.1% 1.00x(?)
LinkedList 31329 31332 +0.0% 1.00x(?)
MapReduceAnyCollection 34259 34354 +0.3% 1.00x(?)
StringMatch 82007 81762 -0.3% 1.00x(?)
ArrayLiteral 1400 1401 +0.1% 1.00x(?)
NSStringConversion 1205 1207 +0.2% 1.00x(?)
ObjectiveCBridgeFromNSSetAnyObjectForced 6557 6567 +0.1% 1.00x(?)
ArrayAppendSequence 71110 71177 +0.1% 1.00x(?)
ArrayAppendArrayOfInt 617 618 +0.2% 1.00x(?)
ArrayOfPOD 1728 1728 +0.0% 1.00x
SetUnion 10941 10964 +0.2% 1.00x(?)
Chars 7449 7442 -0.1% 1.00x(?)
ReversedArray 556 557 +0.2% 1.00x(?)
StrToInt 7368 7368 +0.0% 1.00x
ObserverForwarderStruct 4417 4400 -0.4% 1.00x(?)
DeadArray 115945 116268 +0.3% 1.00x(?)
ObjectiveCBridgeStubNSDataAppend 2495 2507 +0.5% 1.00x(?)
BitCount 90 90 +0.0% 1.00x
AngryPhonebook 2929 2932 +0.1% 1.00x(?)
ArrayPlusEqualArrayOfInt 617 618 +0.2% 1.00x(?)
SevenBoom 1512 1514 +0.1% 1.00x(?)
DropLastCountableRange 135 135 +0.0% 1.00x
SuffixSequence 38499 38494 -0.0% 1.00x(?)
ArrayValueProp 2856 2864 +0.3% 1.00x(?)
ObjectiveCBridgeStubFromArrayOfNSString 50058 49816 -0.5% 1.00x(?)
SuffixArray 2002 2002 +0.0% 1.00x
MapReduceClass 39352 39231 -0.3% 1.00x(?)
GlobalClass 0 0 +0.0% 1.00x
Memset 42037 42072 +0.1% 1.00x(?)
Dictionary2OfObjects 5845 5847 +0.0% 1.00x(?)
ArrayValueProp4 3140 3145 +0.2% 1.00x(?)
ObjectiveCBridgeStubDateAccess 946 946 +0.0% 1.00x
ArrayValueProp2 3456 3457 +0.0% 1.00x(?)
ArrayValueProp3 3244 3247 +0.1% 1.00x(?)
ObjectiveCBridgeStubFromNSDate 3899 3905 +0.1% 1.00x(?)
ObserverPartiallyAppliedMethod 7691 7694 +0.0% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 7247 7321 +1.0% 0.99x(?)
StringUTF16Builder 3486 3513 +0.8% 0.99x(?)
RangeAssignment 5272 5306 +0.6% 0.99x(?)
StringEdits 813535 820841 +0.9% 0.99x(?)
ObjectiveCBridgeToNSArray 27116 27360 +0.9% 0.99x(?)
Calculator 966 971 +0.5% 0.99x(?)
DictionaryLiteral 12470 12627 +1.3% 0.99x(?)
DictionaryRemoveOfObjects 50766 51126 +0.7% 0.99x(?)
StringBuilder 2660 2675 +0.6% 0.99x(?)
CStringLongNonAscii 4181 4227 +1.1% 0.99x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 68962 69415 +0.7% 0.99x(?)
DictionaryBridge 2978 3034 +1.9% 0.98x(?)
TypeFlood 158 161 +1.9% 0.98x(?)
NSError 665 679 +2.1% 0.98x(?)
ObjectiveCBridgeStubToNSDateRef 3256 3324 +2.1% 0.98x(?)
ObjectiveCBridgeFromNSSetAnyObjectToStringForced 70270 71514 +1.8% 0.98x(?)
**Hardware Overview** Model Name: Mac mini Model Identifier: Macmini7,1 Processor Name: Intel Core i7 Processor Speed: 3 GHz Number of Processors: 1 Total Number of Cores: 2 L2 Cache (per Core): 256 KB L3 Cache: 4 MB Memory: 16 GB

@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 21, 2017

@swift-ci benchmark

@swift-ci
Copy link
Contributor

Build comment file:

Optimized (O)

Regression (0)
Improvement (0)
No Changes (192)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
RangeAssignment 317 305 -3.8% 1.04x(?)
ObjectiveCBridgeStubNSDateRefAccess 318 313 -1.6% 1.02x(?)
ArrayAppendLatin1 43847 43309 -1.2% 1.01x(?)
ReversedDictionary 117 116 -0.8% 1.01x(?)
XorLoop 343 339 -1.2% 1.01x(?)
Walsh 347 342 -1.4% 1.01x(?)
SetIntersect_OfObjects 1620 1609 -0.7% 1.01x(?)
SetUnion_OfObjects 6182 6135 -0.8% 1.01x(?)
NSStringConversion 707 701 -0.8% 1.01x(?)
SuffixSequence 4716 4684 -0.7% 1.01x(?)
ObjectiveCBridgeStubDateAccess 176 175 -0.6% 1.01x(?)
ArraySubscript 1447 1450 +0.2% 1.00x(?)
StackPromo 22427 22426 -0.0% 1.00x(?)
RecursiveOwnedParameter 2189 2190 +0.1% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 43144 43207 +0.1% 1.00x(?)
Array2D 2030 2031 +0.1% 1.00x(?)
Histogram 237 238 +0.4% 1.00x(?)
SortStrings 1628 1628 +0.0% 1.00x
ProtocolDispatch2 150 150 +0.0% 1.00x
MonteCarloPi 42355 42343 -0.0% 1.00x(?)
StringWithCString 152784 152605 -0.1% 1.00x(?)
ObjectiveCBridgeFromNSStringForced 2315 2308 -0.3% 1.00x(?)
SortLettersInPlace 1082 1083 +0.1% 1.00x(?)
ObjectiveCBridgeFromNSString 1400 1401 +0.1% 1.00x(?)
PopFrontArray 1162 1165 +0.3% 1.00x(?)
Dictionary3OfObjects 1021 1022 +0.1% 1.00x(?)
StringUTF16Builder 2150 2147 -0.1% 1.00x(?)
MapReduceLazyCollectionShort 44 44 +0.0% 1.00x
StringHasPrefix 592 591 -0.2% 1.00x(?)
ByteSwap 0 0 +0.0% 1.00x
ArrayAppendGenericStructs 1135 1138 +0.3% 1.00x(?)
SuperChars 216828 217503 +0.3% 1.00x(?)
ArrayPlusEqualFiveElementCollection 51816 51955 +0.3% 1.00x(?)
SortStringsUnicode 7522 7516 -0.1% 1.00x(?)
AnyHashableWithAClass 67412 67309 -0.1% 1.00x(?)
Integrate 262 262 +0.0% 1.00x
ArrayAppendStrings 12814 12761 -0.4% 1.00x(?)
ObjectiveCBridgeStubFromNSStringRef 207 207 +0.0% 1.00x
StaticArray 148 148 +0.0% 1.00x
ProtocolDispatch 2942 2942 +0.0% 1.00x
TypeFlood 0 0 +0.0% 1.00x
SortSortedStrings 815 813 -0.2% 1.00x(?)
ArrayLiteral 1151 1152 +0.1% 1.00x(?)
CStringLongAscii 7814 7850 +0.5% 1.00x(?)
CharacterLiteralsLarge 11998 12057 +0.5% 1.00x(?)
Dictionary3 577 577 +0.0% 1.00x
Dictionary2 2063 2070 +0.3% 1.00x(?)
StrComplexWalk 2797 2803 +0.2% 1.00x(?)
ArrayOfRef 3797 3803 +0.2% 1.00x(?)
ObserverUnappliedMethod 2581 2585 +0.1% 1.00x(?)
ObjectiveCBridgeStubURLAppendPathRef 227403 227414 +0.0% 1.00x(?)
ArrayAppend 731 733 +0.3% 1.00x(?)
DropLastArray 29 29 +0.0% 1.00x
OpenClose 48 48 +0.0% 1.00x
ObjectiveCBridgeToNSArray 28376 28402 +0.1% 1.00x(?)
DictionaryOfObjects 2479 2477 -0.1% 1.00x(?)
PopFrontArrayGeneric 1190 1191 +0.1% 1.00x(?)
PopFrontUnsafePointer 9236 9234 -0.0% 1.00x(?)
MapReduceAnyCollectionShort 2067 2067 +0.0% 1.00x
ClassArrayGetter 13 13 +0.0% 1.00x
RC4 153 153 +0.0% 1.00x
Calculator 33 33 +0.0% 1.00x
MapReduceShort 1889 1887 -0.1% 1.00x(?)
CharacterLiteralsSmall 760 761 +0.1% 1.00x(?)
IterateData 2565 2572 +0.3% 1.00x(?)
DictionaryLiteral 1443 1436 -0.5% 1.00x(?)
Hanoi 3333 3337 +0.1% 1.00x(?)
ArrayOfGenericPOD 207 207 +0.0% 1.00x
DictionaryRemoveOfObjects 20956 20957 +0.0% 1.00x(?)
ObjectiveCBridgeStubURLAppendPath 222988 222849 -0.1% 1.00x(?)
MapReduceLazySequence 85 85 +0.0% 1.00x
SetExclusiveOr 2522 2516 -0.2% 1.00x(?)
SetIsSubsetOf 271 271 +0.0% 1.00x
CStringShortAscii 4994 4992 -0.0% 1.00x(?)
MapReduceClassShort 4474 4478 +0.1% 1.00x(?)
ArrayAppendOptionals 1136 1136 +0.0% 1.00x
Phonebook 7113 7121 +0.1% 1.00x(?)
PolymorphicCalls 20 20 +0.0% 1.00x
ArrayAppendRepeatCol 812 811 -0.1% 1.00x(?)
MapReduceShortString 18 18 +0.0% 1.00x
MonteCarloE 9956 9961 +0.1% 1.00x(?)
ReversedBidirectional 47314 47227 -0.2% 1.00x(?)
StringHasSuffixUnicode 61411 61544 +0.2% 1.00x(?)
ArrayAppendToGeneric 562 562 +0.0% 1.00x
HashTest 1686 1692 +0.4% 1.00x(?)
SetIsSubsetOf_OfObjects 338 338 +0.0% 1.00x
DictionaryRemove 3047 3049 +0.1% 1.00x(?)
LinkedList 6707 6738 +0.5% 1.00x(?)
SuffixCountableRange 27 27 +0.0% 1.00x
MapReduceAnyCollection 334 334 +0.0% 1.00x
ObjectiveCBridgeFromNSSetAnyObjectToStringForced 70300 70038 -0.4% 1.00x(?)
RGBHistogramOfObjects 22725 22704 -0.1% 1.00x(?)
MapReduceLazyCollection 15 15 +0.0% 1.00x
ArrayAppendSequence 949 949 +0.0% 1.00x
ArrayOfPOD 156 156 +0.0% 1.00x
RGBHistogram 2569 2577 +0.3% 1.00x(?)
StringBuilder 1318 1317 -0.1% 1.00x(?)
ObserverForwarderStruct 1026 1025 -0.1% 1.00x(?)
ArrayValueProp2 5 5 +0.0% 1.00x
BitCount 1 1 +0.0% 1.00x
SevenBoom 1466 1463 -0.2% 1.00x(?)
DropLastCountableRange 26 26 +0.0% 1.00x
ArrayValueProp4 5 5 +0.0% 1.00x
StringWalk 5506 5506 +0.0% 1.00x
ArrayValueProp 5 5 +0.0% 1.00x
SuffixArray 31 31 +0.0% 1.00x
MapReduceClass 2871 2872 +0.0% 1.00x(?)
GlobalClass 0 0 +0.0% 1.00x
Memset 221 221 +0.0% 1.00x
Dictionary2OfObjects 3556 3546 -0.3% 1.00x(?)
ArrayValueProp3 5 5 +0.0% 1.00x
ObjectiveCBridgeToNSString 1237 1247 +0.8% 0.99x(?)
DictionarySwapOfObjects 6549 6613 +1.0% 0.99x(?)
ObjectiveCBridgeFromNSDictionaryAnyObject 116398 118122 +1.5% 0.99x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 136568 138490 +1.4% 0.99x(?)
DictionaryBridge 2911 2940 +1.0% 0.99x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectForced 4866 4900 +0.7% 0.99x(?)
Prims 748 755 +0.9% 0.99x(?)
DictionarySwap 360 364 +1.1% 0.99x(?)
MapReduceString 75 76 +1.3% 0.99x(?)
ObjectiveCBridgeStubToNSDate 14243 14452 +1.5% 0.99x(?)
StringInterpolation 9112 9233 +1.3% 0.99x(?)
ObserverClosure 2098 2111 +0.6% 0.99x(?)
191 9936088 10049847 +1.1% 0.99x
LazilyFilteredRange 6869 6968 +1.4% 0.99x(?)
ObjectiveCBridgeStubFromNSString 915 923 +0.9% 0.99x(?)
ObjectiveCBridgeFromNSSetAnyObject 63368 64269 +1.4% 0.99x(?)
StringEdits 501390 507575 +1.2% 0.99x(?)
Join 466 469 +0.6% 0.99x(?)
NSError 343 347 +1.2% 0.99x(?)
StringEqualPointerComparison 7291 7342 +0.7% 0.99x(?)
CaptureProp 4618 4643 +0.5% 0.99x(?)
ObjectiveCBridgeStubToNSStringRef 125 126 +0.8% 0.99x(?)
MapReduce 325 328 +0.9% 0.99x(?)
MapReduceSequence 531 534 +0.6% 0.99x(?)
ArrayAppendUTF16 40857 41206 +0.8% 0.99x(?)
UTF8Decode 273 277 +1.5% 0.99x(?)
SuffixAnySequence 6245 6312 +1.1% 0.99x(?)
LazilyFilteredArrays 69307 70138 +1.2% 0.99x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToStringForced 95712 96948 +1.3% 0.99x(?)
ObjectiveCBridgeFromNSArrayAnyObject 23303 23625 +1.4% 0.99x(?)
SetIntersect 325 327 +0.6% 0.99x(?)
NSDictionaryCastToSwift 5047 5102 +1.1% 0.99x(?)
StrToInt 5861 5923 +1.1% 0.99x(?)
ArrayOfGenericRef 3881 3913 +0.8% 0.99x(?)
Sim2DArray 273 276 +1.1% 0.99x(?)
ArrayAppendAscii 19846 19953 +0.5% 0.99x(?)
HashQuadratic 6211930 6265129 +0.9% 0.99x(?)
ObjectiveCBridgeToNSSet 35594 35913 +0.9% 0.99x(?)
SetUnion 2017 2032 +0.7% 0.99x(?)
AngryPhonebook 2889 2906 +0.6% 0.99x(?)
ObjectiveCBridgeStubNSDateMutationRef 12621 12722 +0.8% 0.99x(?)
StringBuilderLong 937 954 +1.8% 0.98x(?)
StringAdder 1558 1582 +1.5% 0.98x(?)
ReversedArray 46 47 +2.2% 0.98x(?)
ArrayAppendLazyMap 896 911 +1.7% 0.98x(?)
ArrayPlusEqualSingleElementCollection 46486 47557 +2.3% 0.98x(?)
ErrorHandling 2866 2919 +1.9% 0.98x(?)
DropLastAnySequence 6255 6374 +1.9% 0.98x(?)
ObjectiveCBridgeStubToNSDateRef 3157 3224 +2.1% 0.98x(?)
ObjectiveCBridgeStubDateMutation 258 264 +2.3% 0.98x(?)
ObjectiveCBridgeStubToArrayOfNSString 27053 27667 +2.3% 0.98x(?)
ObjectiveCBridgeStubDataAppend 3497 3571 +2.1% 0.98x(?)
ObjectiveCBridgeFromNSSetAnyObjectToString 78090 79624 +2.0% 0.98x(?)
SetExclusiveOr_OfObjects 7645 7787 +1.9% 0.98x(?)
StringHasPrefixUnicode 14033 14291 +1.8% 0.98x(?)
ArrayAppendArrayOfInt 563 574 +1.9% 0.98x(?)
Chars 1435 1460 +1.7% 0.98x(?)
CStringLongNonAscii 2830 2900 +2.5% 0.98x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 69944 71156 +1.7% 0.98x(?)
ObjectiveCBridgeStubFromArrayOfNSString 51271 52573 +2.5% 0.98x(?)
ObjectiveCBridgeStubNSDataAppend 2232 2283 +2.3% 0.98x(?)
ObjectiveCBridgeStubFromNSDate 3608 3688 +2.2% 0.98x(?)
ObserverPartiallyAppliedMethod 3604 3659 +1.5% 0.98x(?)
DropLastSequence 4389 4511 +2.8% 0.97x(?)
ObjectiveCBridgeStubToNSString 1439 1477 +2.6% 0.97x(?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 4324 4436 +2.6% 0.97x(?)
ArrayAppendToFromGeneric 562 578 +2.9% 0.97x(?)
ObjectAllocation 167 172 +3.0% 0.97x(?)
ArrayPlusEqualArrayOfInt 563 578 +2.7% 0.97x(?)
ArrayAppendFromGeneric 563 578 +2.7% 0.97x(?)
NopDeinit 22259 22880 +2.8% 0.97x(?)
ArrayInClass 61 63 +3.3% 0.97x(?)
StringHasSuffix 657 675 +2.7% 0.97x(?)
ObjectiveCBridgeToNSDictionary 57631 59397 +3.1% 0.97x(?)
StringMatch 36147 37233 +3.0% 0.97x(?)
ObjectiveCBridgeFromNSSetAnyObjectForced 4092 4215 +3.0% 0.97x(?)
ObjectiveCBridgeStubFromNSDateRef 3604 3730 +3.5% 0.97x(?)
DeadArray 179 184 +2.8% 0.97x(?)
ArrayAppendReserved 502 517 +3.0% 0.97x(?)
TwoSum 1201 1233 +2.7% 0.97x(?)
Dictionary 780 810 +3.9% 0.96x(?)
**Unoptimized (Onone)**
Regression (2)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
PopFrontUnsafePointer 159321 178315 +11.9% 0.89x
TypeFlood 160 173 +8.1% 0.92x(?)
Improvement (0)
No Changes (190)
TEST OLD_MIN NEW_MIN DELTA (%) SPEEDUP
StringWalk 23142 21961 -5.1% 1.05x(?)
ObjectAllocation 634 611 -3.6% 1.04x
ObjectiveCBridgeStubURLAppendPathRef 240516 230986 -4.0% 1.04x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToStringForced 102357 98464 -3.8% 1.04x(?)
ArrayAppendRepeatCol 209418 202269 -3.4% 1.04x
HashQuadratic 53037354 51159761 -3.5% 1.04x
ObjectiveCBridgeFromNSStringForced 2769 2687 -3.0% 1.03x(?)
ObjectiveCBridgeStubToNSDateRef 3389 3288 -3.0% 1.03x(?)
ArrayAppendFromGeneric 657 639 -2.7% 1.03x(?)
191 64968661 63337321 -2.5% 1.03x
MapReduceShort 46929 45650 -2.7% 1.03x(?)
ObjectiveCBridgeStubURLAppendPath 235749 229473 -2.7% 1.03x(?)
ArrayPlusEqualArrayOfInt 654 637 -2.6% 1.03x(?)
NopDeinit 47881 46436 -3.0% 1.03x(?)
ObjectiveCBridgeFromNSSetAnyObjectForced 7218 7003 -3.0% 1.03x(?)
MapReduceAnyCollectionShort 47060 45517 -3.3% 1.03x(?)
DictionarySwapOfObjects 19798 19497 -1.5% 1.02x(?)
ArrayPlusEqualSingleElementCollection 262496 258085 -1.7% 1.02x(?)
ErrorHandling 3917 3847 -1.8% 1.02x(?)
DropLastAnySequence 6449 6353 -1.5% 1.02x(?)
OpenClose 421 412 -2.1% 1.02x(?)
DictionaryLiteral 13242 12928 -2.4% 1.02x(?)
MapReduceLazySequence 27545 27084 -1.7% 1.02x(?)
MapReduceShortString 232 227 -2.2% 1.02x(?)
NSStringConversion 1301 1281 -1.5% 1.02x(?)
SetUnion 11705 11454 -2.1% 1.02x(?)
Chars 7867 7749 -1.5% 1.02x(?)
ObjectiveCBridgeToNSString 1279 1265 -1.1% 1.01x(?)
SuffixAnySequence 6371 6302 -1.1% 1.01x(?)
Prims 8708 8649 -0.7% 1.01x(?)
PopFrontArray 11076 10993 -0.8% 1.01x(?)
ObserverUnappliedMethod 8271 8203 -0.8% 1.01x(?)
ObjectiveCBridgeToNSSet 36994 36700 -0.8% 1.01x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 45025 44650 -0.8% 1.01x(?)
CaptureProp 99891 98963 -0.9% 1.01x(?)
ArrayAppendUTF16 103692 102492 -1.2% 1.01x(?)
StringHasSuffix 1703 1694 -0.5% 1.01x(?)
SetUnion_OfObjects 28336 28113 -0.8% 1.01x(?)
ArrayAppend 3689 3643 -1.2% 1.01x(?)
ObjectiveCBridgeStubToNSString 1541 1522 -1.2% 1.01x(?)
ArrayAppendSequence 74130 73546 -0.8% 1.01x(?)
ObserverForwarderStruct 4561 4528 -0.7% 1.01x(?)
ArrayValueProp3 3407 3388 -0.6% 1.01x(?)
SuffixSequence 41589 41165 -1.0% 1.01x(?)
ObjectiveCBridgeStubNSDateMutationRef 15637 15524 -0.7% 1.01x(?)
MonteCarloPi 50568 50588 +0.0% 1.00x(?)
StackPromo 97319 97585 +0.3% 1.00x(?)
RecursiveOwnedParameter 8911 8907 -0.0% 1.00x(?)
Integrate 396 395 -0.2% 1.00x
AnyHashableWithAClass 81134 81228 +0.1% 1.00x(?)
ClassArrayGetter 930 930 +0.0% 1.00x
DictionaryBridge 3013 3017 +0.1% 1.00x(?)
ObjectiveCBridgeStubFromNSDateRef 4191 4201 +0.2% 1.00x(?)
StringWithCString 324415 324396 -0.0% 1.00x(?)
ReversedDictionary 25223 25181 -0.2% 1.00x
ArrayAppendToFromGeneric 638 638 +0.0% 1.00x
Dictionary3OfObjects 2239 2232 -0.3% 1.00x(?)
StrComplexWalk 8592 8559 -0.4% 1.00x(?)
ByteSwap 10 10 +0.0% 1.00x
ArrayAppendGenericStructs 1230 1230 +0.0% 1.00x
SuperChars 273714 273372 -0.1% 1.00x(?)
ArrayAppendLazyMap 223886 223906 +0.0% 1.00x(?)
ArrayPlusEqualFiveElementCollection 260592 260625 +0.0% 1.00x(?)
XorLoop 21528 21533 +0.0% 1.00x(?)
ArrayAppendReserved 3780 3770 -0.3% 1.00x(?)
StringInterpolation 14827 14768 -0.4% 1.00x(?)
ObserverClosure 6456 6444 -0.2% 1.00x(?)
ArrayAppendLatin1 102867 102906 +0.0% 1.00x(?)
ObjectiveCBridgeStubFromNSStringRef 238 237 -0.4% 1.00x(?)
ObjectiveCBridgeStubFromNSString 961 964 +0.3% 1.00x(?)
StaticArray 4554 4552 -0.0% 1.00x(?)
ProtocolDispatch 6099 6110 +0.2% 1.00x(?)
ObjectiveCBridgeFromNSSetAnyObject 68014 67779 -0.3% 1.00x(?)
ArrayLiteral 1395 1401 +0.4% 1.00x(?)
CharacterLiteralsLarge 14088 14068 -0.1% 1.00x(?)
HashTest 5837 5837 +0.0% 1.00x
Dictionary2 3823 3827 +0.1% 1.00x(?)
Join 1293 1293 +0.0% 1.00x
ArrayOfRef 8577 8610 +0.4% 1.00x(?)
ObjectiveCBridgeToNSArray 28517 28383 -0.5% 1.00x(?)
StringAdder 1792 1797 +0.3% 1.00x(?)
RC4 6817 6839 +0.3% 1.00x(?)
ObjectiveCBridgeStubToNSStringRef 164 164 +0.0% 1.00x
Hanoi 16786 16727 -0.3% 1.00x(?)
UTF8Decode 35186 35223 +0.1% 1.00x(?)
SetExclusiveOr 20873 20963 +0.4% 1.00x(?)
SetIsSubsetOf 1642 1641 -0.1% 1.00x(?)
CStringShortAscii 9154 9166 +0.1% 1.00x(?)
ObjectiveCBridgeStubDataAppend 3865 3853 -0.3% 1.00x(?)
MapReduceClassShort 49618 49620 +0.0% 1.00x(?)
ArrayAppendOptionals 1267 1268 +0.1% 1.00x(?)
ArrayInClass 4304 4298 -0.1% 1.00x(?)
ArrayOfGenericRef 9976 9959 -0.2% 1.00x(?)
PolymorphicCalls 787 787 +0.0% 1.00x
Sim2DArray 27978 27955 -0.1% 1.00x(?)
ArrayAppendAscii 83767 83856 +0.1% 1.00x(?)
MonteCarloE 80984 81035 +0.1% 1.00x(?)
ObjectiveCBridgeFromNSSetAnyObjectToStringForced 74895 75022 +0.2% 1.00x(?)
ArrayAppendToGeneric 621 621 +0.0% 1.00x
SetIsSubsetOf_OfObjects 1607 1605 -0.1% 1.00x(?)
LinkedList 31343 31359 +0.1% 1.00x(?)
ReversedArray 592 590 -0.3% 1.00x(?)
SuffixCountableRange 144 144 +0.0% 1.00x
MapReduceAnyCollection 35329 35371 +0.1% 1.00x(?)
MapReduce 34390 34338 -0.1% 1.00x(?)
ObjectiveCBridgeFromNSSetAnyObjectToString 85346 85426 +0.1% 1.00x(?)
ArrayAppendArrayOfInt 654 656 +0.3% 1.00x
ObjectiveCBridgeStubNSDateRefAccess 1208 1208 +0.0% 1.00x
StrToInt 7930 7955 +0.3% 1.00x(?)
CStringLongNonAscii 4439 4440 +0.0% 1.00x(?)
DeadArray 123112 123595 +0.4% 1.00x(?)
ObjectiveCBridgeStubNSDataAppend 2593 2600 +0.3% 1.00x(?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 73377 73173 -0.3% 1.00x(?)
DropLastCountableRange 143 143 +0.0% 1.00x
ArrayValueProp 2842 2850 +0.3% 1.00x(?)
ObjectiveCBridgeStubFromArrayOfNSString 54431 54494 +0.1% 1.00x(?)
MapReduceClass 40226 40284 +0.1% 1.00x(?)
GlobalClass 0 0 +0.0% 1.00x
Memset 42036 42044 +0.0% 1.00x(?)
Dictionary2OfObjects 6019 6037 +0.3% 1.00x(?)
ArrayValueProp4 3215 3211 -0.1% 1.00x(?)
TwoSum 4707 4726 +0.4% 1.00x(?)
ObjectiveCBridgeStubDateAccess 1038 1039 +0.1% 1.00x(?)
ArrayValueProp2 3524 3510 -0.4% 1.00x(?)
SevenBoom 1555 1559 +0.3% 1.00x(?)
ObjectiveCBridgeStubFromNSDate 4050 4032 -0.4% 1.00x(?)
ObserverPartiallyAppliedMethod 7871 7876 +0.1% 1.00x(?)
DropLastSequence 42749 43068 +0.8% 0.99x(?)
ObjectiveCBridgeFromNSDictionaryAnyObject 120502 122027 +1.3% 0.99x(?)
StringBuilderLong 1152 1168 +1.4% 0.99x
ObjectiveCBridgeFromNSDictionaryAnyObjectForced 7161 7229 +0.9% 0.99x(?)
DictionarySwap 5226 5256 +0.6% 0.99x(?)
MapReduceString 2226 2244 +0.8% 0.99x(?)
RangeAssignment 5522 5556 +0.6% 0.99x(?)
ObjectiveCBridgeStubToNSDate 15433 15552 +0.8% 0.99x(?)
CharacterLiteralsSmall 1000 1010 +1.0% 0.99x(?)
LazilyFilteredRange 1247952 1259965 +1.0% 0.99x(?)
ArrayAppendStrings 13164 13340 +1.3% 0.99x(?)
StringEdits 876155 882848 +0.8% 0.99x(?)
Dictionary3 1403 1415 +0.9% 0.99x(?)
StringHasPrefix 1598 1620 +1.4% 0.99x(?)
ObjectiveCBridgeStubDateMutation 500 507 +1.4% 0.99x(?)
StringEqualPointerComparison 9722 9813 +0.9% 0.99x(?)
CStringLongAscii 17069 17163 +0.6% 0.99x(?)
MapReduceSequence 40912 41171 +0.6% 0.99x(?)
IterateData 10955 11097 +1.3% 0.99x(?)
ArrayOfGenericPOD 3102 3123 +0.7% 0.99x(?)
DictionaryRemoveOfObjects 52400 53135 +1.4% 0.99x(?)
LazilyFilteredArrays 2647842 2663051 +0.6% 0.99x(?)
Dictionary 1834 1847 +0.7% 0.99x(?)
StringBuilder 2788 2823 +1.3% 0.99x(?)
Phonebook 21550 21876 +1.5% 0.99x(?)
ObjectiveCBridgeToNSDictionary 60047 60402 +0.6% 0.99x(?)
StringHasSuffixUnicode 62990 63564 +0.9% 0.99x(?)
Walsh 11388 11490 +0.9% 0.99x(?)
MapReduceLazyCollection 32559 32832 +0.8% 0.99x(?)
RGBHistogram 30859 31136 +0.9% 0.99x(?)
BitCount 101 102 +1.0% 0.99x(?)
AngryPhonebook 2962 2989 +0.9% 0.99x(?)
ArraySubscript 4022 4111 +2.2% 0.98x(?)
Histogram 8420 8558 +1.6% 0.98x(?)
SortLettersInPlace 2560 2606 +1.8% 0.98x(?)
StringUTF16Builder 3701 3790 +2.4% 0.98x
DropLastArray 2091 2133 +2.0% 0.98x(?)
DictionaryOfObjects 4687 4802 +2.5% 0.98x(?)
PopFrontArrayGeneric 8112 8285 +2.1% 0.98x
StringMatch 87405 89005 +1.8% 0.98x(?)
SortStringsUnicode 9022 9225 +2.2% 0.98x
ObjectiveCBridgeStubToArrayOfNSString 27782 28293 +1.8% 0.98x(?)
ObjectiveCBridgeFromNSArrayAnyObject 24395 24866 +1.9% 0.98x(?)
RGBHistogramOfObjects 81833 83722 +2.3% 0.98x(?)
DictionaryRemove 18482 18941 +2.5% 0.98x(?)
ReversedBidirectional 139735 142953 +2.3% 0.98x(?)
ArrayOfPOD 1892 1923 +1.6% 0.98x(?)
SuffixArray 2095 2133 +1.8% 0.98x(?)
Array2D 573924 589696 +2.8% 0.97x(?)
ProtocolDispatch2 428 439 +2.6% 0.97x(?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 7765 8023 +3.3% 0.97x(?)
MapReduceLazyCollectionShort 42759 44038 +3.0% 0.97x
SortSortedStrings 1383 1420 +2.7% 0.97x(?)
SetIntersect_OfObjects 11188 11527 +3.0% 0.97x(?)
NSError 703 722 +2.7% 0.97x(?)
Calculator 982 1013 +3.2% 0.97x(?)
SetIntersect 10278 10577 +2.9% 0.97x(?)
NSDictionaryCastToSwift 6145 6324 +2.9% 0.97x(?)
ObjectiveCBridgeFromNSString 4008 4117 +2.7% 0.97x(?)
SetExclusiveOr_OfObjects 40118 41161 +2.6% 0.97x(?)
ObjectiveCBridgeFromNSDictionaryAnyObjectToString 141497 147723 +4.4% 0.96x(?)
SortStrings 2663 2791 +4.8% 0.95x
StringHasPrefixUnicode 15843 16658 +5.1% 0.95x
**Hardware Overview** Model Name: Mac mini Model Identifier: Macmini7,1 Processor Name: Intel Core i7 Processor Speed: 3 GHz Number of Processors: 1 Total Number of Cores: 2 L2 Cache (per Core): 256 KB L3 Cache: 4 MB Memory: 16 GB

@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 21, 2017

@dabrahams Just as I suspected: No measurable (benchmarkable?) impact.

@dabrahams
Copy link
Contributor

@swift-ci Please smoke test and merge

@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 22, 2017

@swift-ci please smoke test and merge

@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 22, 2017

(Merge happening here)

@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 22, 2017

@swift-ci please smoke test

@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 22, 2017

⛵️

@CodaFi CodaFi merged commit 2c19ceb into swiftlang:master Mar 22, 2017
@CodaFi CodaFi deleted the equal-sequence branch March 22, 2017 15:25
CodaFi added a commit to CodaFi/swift that referenced this pull request Mar 22, 2017
@CodaFi
Update prefix-drop regression test (swiftlang#8194)
af78c29
@dabrahams
Copy link
Contributor

@CodaFi what does the sailboat mean?

dabrahams pushed a commit that referenced this pull request Mar 22, 2017
@CodaFi
Update prefix-drop regression test (#8194)
2a5d5bc
@CodaFi
Copy link
Contributor Author

CodaFi commented Mar 23, 2017

Some people use 🚢 (:ship:) or :shipit: (:shipit:) to signal a merge. I just like ⛵️ (:boat:) better is all.

@palimondo
Copy link
Contributor

palimondo commented Apr 22, 2017 •
edited
Loading

@CodaFi I'm curious, how should the change in validation-test provide

an opportunity to benchmark the prefix-drop optimization change

? 🤷‍♂️ It seems inevitable that it provides

No measurable (benchmarkable?) impact.

Was this PR missing some commits?

@CodaFi
Copy link
Contributor Author

CodaFi commented Apr 22, 2017

We couldn't get the benchmark build to work on the 3.1 release branch, so this pull request allowed me to kill two birds with one stone by demonstrating no regression in performance by making the change as well as fix the test.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dabrahams dabrahams Awaiting requested review from dabrahams

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@CodaFi @swift-ci @dabrahams @palimondo