Skip to content

[analysis] Turn on the pass manager notification verifier analysis. #18781

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

gottesmm
Copy link
Contributor

When asserts are enabled this tracks the add/delete notifications from the
SILPassManager it belongs to. When the SILPassManager is destroyed, the analysis
verifies that it worked correctly by looping over all the functions in the
module and verifying that its internal state is consistent with the module.

This will ensure we never lose add/delete notification events ever again by
mistake.

rdar://42301529


NOTE: The second commit is in a different PR. I just wanted to do some parallel testing.

…ead of SILFunction pointers for its internal state.

This enables us to have state independent of the liveness of the SILFunction's
that we are tracking.

I also changed the verifier to implement only verifyFull instead of verify to
ensure that when we run with sil-verify-all this only runs at the end of pass
manager pipelines.

rdar://42301529
When asserts are enabled this tracks the add/delete notifications from the
SILPassManager it belongs to. When the SILPassManager is destroyed, the analysis
verifies that it worked correctly by looping over all the functions in the
module and verifying that its internal state is consistent with the module.

This will ensure we never lose add/delete notification events ever again by
mistake.

rdar://42301529
@gottesmm
Copy link
Contributor Author

@swift-ci smoke test

@gottesmm
Copy link
Contributor Author

@swift-ci test

@gottesmm
Copy link
Contributor Author

@swift-ci test source compatibility

@gottesmm
Copy link
Contributor Author

@swift-ci smoke benchmark

@gottesmm
Copy link
Contributor Author

Doing a bunch of testing to make sure I don't break anything by turning this on.

@gottesmm
Copy link
Contributor Author

I am going to kill the smoke test jobs

@gottesmm
Copy link
Contributor Author

This turns on #18781.

@gottesmm
Copy link
Contributor Author

Erm: #18767.

@gottesmm
Copy link
Contributor Author

I am going to test perf as well. If this is too expensive to run normally, then I will only have it run at end of pipeline with -sil-verify-all enabled.

@gottesmm
Copy link
Contributor Author

@swift-ci test compiler performance

@swift-ci
Copy link
Contributor

Build comment file:

Optimized (O)

Regression (6)
TEST OLD NEW DELTA SPEEDUP
ObjectiveCBridgeFromNSSetAnyObjectForced 5020 5464 +8.8% 0.92x (?)
RemoveWhereMoveInts 14 15 +7.1% 0.93x
DataReplaceSmallBuffer 10050 10748 +6.9% 0.94x (?)
ObjectiveCBridgeFromNSArrayAnyObjectForced 5206 5563 +6.9% 0.94x (?)
ObjectiveCBridgeStubFromArrayOfNSString2 3363 3579 +6.4% 0.94x (?)
COWArrayGuaranteedParameterOverhead 11332 12051 +6.3% 0.94x (?)
Improvement (3)
TEST OLD NEW DELTA SPEEDUP
DictionaryBridgeToObjC_Access 1045 959 -8.2% 1.09x (?)
SuffixAnyCollectionLazy 23707 22175 -6.5% 1.07x (?)
StringBuilderWithLongSubstring 1608 1529 -4.9% 1.05x (?)
No Changes (438)
TEST OLD NEW DELTA SPEEDUP
AngryPhonebook 3781 3790 +0.2% 1.00x (?)
AnyHashableWithAClass 90980 90860 -0.1% 1.00x (?)
Array2D 2718 2718 +0.0% 1.00x
ArrayAppend 801 801 +0.0% 1.00x
ArrayAppendArrayOfInt 798 793 -0.6% 1.01x (?)
ArrayAppendAscii 3980 3943 -0.9% 1.01x (?)
ArrayAppendAsciiSubstring 25020 25013 -0.0% 1.00x (?)
ArrayAppendFromGeneric 800 801 +0.1% 1.00x (?)
ArrayAppendGenericStructs 1432 1416 -1.1% 1.01x (?)
ArrayAppendLatin1 39745 39808 +0.2% 1.00x
ArrayAppendLatin1Substring 143967 144113 +0.1% 1.00x
ArrayAppendLazyMap 1344 1332 -0.9% 1.01x
ArrayAppendOptionals 1431 1436 +0.3% 1.00x (?)
ArrayAppendRepeatCol 1346 1342 -0.3% 1.00x (?)
ArrayAppendReserved 530 529 -0.2% 1.00x
ArrayAppendSequence 1118 1120 +0.2% 1.00x (?)
ArrayAppendStrings 6348 6344 -0.1% 1.00x (?)
ArrayAppendToFromGeneric 800 802 +0.2% 1.00x (?)
ArrayAppendToGeneric 788 792 +0.5% 0.99x (?)
ArrayAppendUTF16 41265 41240 -0.1% 1.00x (?)
ArrayAppendUTF16Substring 142879 142947 +0.0% 1.00x (?)
ArrayInClass 85 85 +0.0% 1.00x
ArrayLiteral 0 0 +0.0% 1.00x
ArrayOfGenericPOD2 152 151 -0.7% 1.01x (?)
ArrayOfGenericRef 4365 4323 -1.0% 1.01x
ArrayOfPOD 186 186 +0.0% 1.00x
ArrayOfRef 4329 4320 -0.2% 1.00x (?)
ArrayPlusEqualArrayOfInt 798 799 +0.1% 1.00x (?)
ArrayPlusEqualFiveElementCollection 4248 4233 -0.4% 1.00x (?)
ArrayPlusEqualSingleElementCollection 805 799 -0.7% 1.01x
ArrayPlusEqualThreeElements 1632 1624 -0.5% 1.00x (?)
ArraySubscript 1556 1557 +0.1% 1.00x (?)
ArrayValueProp 8 8 +0.0% 1.00x
ArrayValueProp2 8 8 +0.0% 1.00x
ArrayValueProp3 8 8 +0.0% 1.00x
ArrayValueProp4 8 8 +0.0% 1.00x
BinaryFloatingPointPropertiesBinade 31 31 +0.0% 1.00x
BinaryFloatingPointPropertiesNextUp 29 29 +0.0% 1.00x
BinaryFloatingPointPropertiesUlp 37 37 +0.0% 1.00x
BitCount 169 169 +0.0% 1.00x
ByteSwap 105 106 +1.0% 0.99x
COWTree 3587 3600 +0.4% 1.00x (?)
CSVParsing2 1722 1720 -0.1% 1.00x (?)
CSVParsingAlt2 1802 1796 -0.3% 1.00x (?)
CSVParsingAltIndices2 771 774 +0.4% 1.00x (?)
CStringLongAscii 3541 3535 -0.2% 1.00x (?)
CStringLongNonAscii 2134 2138 +0.2% 1.00x (?)
CStringShortAscii 3178 3178 +0.0% 1.00x
Calculator 211 211 +0.0% 1.00x
CaptureProp 4098 4085 -0.3% 1.00x
ChainedFilterMap 1408 1408 +0.0% 1.00x
CharIndexing_ascii_unicodeScalars 16618 16614 -0.0% 1.00x (?)
CharIndexing_ascii_unicodeScalars_Backwards 16200 16200 +0.0% 1.00x
CharIndexing_chinese_unicodeScalars 12595 12593 -0.0% 1.00x (?)
CharIndexing_chinese_unicodeScalars_Backwards 12263 12262 -0.0% 1.00x (?)
CharIndexing_japanese_unicodeScalars 19913 19906 -0.0% 1.00x (?)
CharIndexing_japanese_unicodeScalars_Backwards 19406 19399 -0.0% 1.00x (?)
CharIndexing_korean_unicodeScalars 16127 16116 -0.1% 1.00x (?)
CharIndexing_korean_unicodeScalars_Backwards 15703 15698 -0.0% 1.00x (?)
CharIndexing_punctuatedJapanese_unicodeScalars 3019 3017 -0.1% 1.00x (?)
CharIndexing_punctuatedJapanese_unicodeScalars_Backwards 2960 2940 -0.7% 1.01x (?)
CharIndexing_punctuated_unicodeScalars 3773 3773 +0.0% 1.00x
CharIndexing_punctuated_unicodeScalars_Backwards 3671 3669 -0.1% 1.00x (?)
CharIndexing_russian_unicodeScalars 13841 13846 +0.0% 1.00x (?)
CharIndexing_russian_unicodeScalars_Backwards 13497 13503 +0.0% 1.00x (?)
CharIndexing_tweet_unicodeScalars 32771 32748 -0.1% 1.00x (?)
CharIndexing_tweet_unicodeScalars_Backwards 31571 31575 +0.0% 1.00x (?)
CharIndexing_utf16_unicodeScalars 22810 22811 +0.0% 1.00x
CharIndexing_utf16_unicodeScalars_Backwards 22921 22908 -0.1% 1.00x (?)
CharIteration_ascii_unicodeScalars 20774 20760 -0.1% 1.00x (?)
CharIteration_ascii_unicodeScalars_Backwards 15478 15478 +0.0% 1.00x
CharIteration_chinese_unicodeScalars 15727 15710 -0.1% 1.00x (?)
CharIteration_chinese_unicodeScalars_Backwards 11729 11717 -0.1% 1.00x (?)
CharIteration_japanese_unicodeScalars 24870 24842 -0.1% 1.00x
CharIteration_japanese_unicodeScalars_Backwards 18550 18526 -0.1% 1.00x (?)
CharIteration_korean_unicodeScalars 20127 20137 +0.0% 1.00x (?)
CharIteration_korean_unicodeScalars_Backwards 15021 15018 -0.0% 1.00x (?)
CharIteration_punctuatedJapanese_unicodeScalars 3758 3761 +0.1% 1.00x
CharIteration_punctuatedJapanese_unicodeScalars_Backwards 2803 2803 +0.0% 1.00x
CharIteration_punctuated_unicodeScalars 4699 4701 +0.0% 1.00x (?)
CharIteration_punctuated_unicodeScalars_Backwards 3508 3506 -0.1% 1.00x (?)
CharIteration_russian_unicodeScalars 17287 17297 +0.1% 1.00x (?)
CharIteration_russian_unicodeScalars_Backwards 12902 12898 -0.0% 1.00x (?)
CharIteration_tweet_unicodeScalars 40955 40930 -0.1% 1.00x
CharIteration_tweet_unicodeScalars_Backwards 30953 30945 -0.0% 1.00x (?)
CharIteration_utf16_unicodeScalars 27579 27572 -0.0% 1.00x (?)
CharIteration_utf16_unicodeScalars_Backwards 18493 18486 -0.0% 1.00x (?)
CharacterLiteralsLarge 5828 5834 +0.1% 1.00x (?)
CharacterLiteralsSmall 220 220 +0.0% 1.00x
CharacterPropertiesFetch 4528 4487 -0.9% 1.01x (?)
CharacterPropertiesPrecomputed 965 962 -0.3% 1.00x (?)
CharacterPropertiesStashed 1711 1717 +0.4% 1.00x (?)
CharacterPropertiesStashedMemo 1412 1412 +0.0% 1.00x
Chars2 2625 2627 +0.1% 1.00x (?)
ClassArrayGetter2 126 125 -0.8% 1.01x
Combos 493 494 +0.2% 1.00x (?)
DataAccessBytes 1146 1163 +1.5% 0.99x
DataAppendArray 5940 5736 -3.4% 1.04x
DataAppendBytes 5183 5279 +1.9% 0.98x (?)
DataAppendDataLargeToLarge 70258 68172 -3.0% 1.03x (?)
DataAppendDataLargeToMedium 35956 35972 +0.0% 1.00x (?)
DataAppendDataLargeToSmall 34978 34957 -0.1% 1.00x (?)
DataAppendDataMediumToLarge 38337 38189 -0.4% 1.00x (?)
DataAppendDataMediumToMedium 6946 6972 +0.4% 1.00x (?)
DataAppendDataMediumToSmall 6147 6246 +1.6% 0.98x (?)
DataAppendDataSmallToLarge 37611 37960 +0.9% 0.99x (?)
DataAppendDataSmallToMedium 6687 6530 -2.3% 1.02x (?)
DataAppendDataSmallToSmall 6005 5937 -1.1% 1.01x (?)
DataAppendSequence 21535 21594 +0.3% 1.00x (?)
DataCopyBytes 530 530 +0.0% 1.00x
DataCount 37 37 +0.0% 1.00x
DataMutateBytes 3945 3967 +0.6% 0.99x (?)
DataReplaceLarge 36683 37031 +0.9% 0.99x (?)
DataReplaceLargeBuffer 59619 59275 -0.6% 1.01x (?)
DataReplaceMedium 8108 8066 -0.5% 1.01x (?)
DataReplaceMediumBuffer 13992 13462 -3.8% 1.04x
DataReplaceSmall 5809 5787 -0.4% 1.00x (?)
DataReset 2798 2865 +2.4% 0.98x (?)
DataSetCount 585 560 -4.3% 1.04x (?)
DataSubscript 220 220 +0.0% 1.00x
DictOfArraysToArrayOfDicts 798 785 -1.6% 1.02x (?)
Dictionary 497 495 -0.4% 1.00x (?)
Dictionary2 624 623 -0.2% 1.00x (?)
Dictionary2OfObjects 2068 2063 -0.2% 1.00x (?)
Dictionary3 212 212 +0.0% 1.00x
Dictionary3OfObjects 733 732 -0.1% 1.00x (?)
Dictionary4 305 304 -0.3% 1.00x
Dictionary4Legacy 671 671 +0.0% 1.00x
Dictionary4OfObjects 420 421 +0.2% 1.00x
Dictionary4OfObjectsLegacy 902 893 -1.0% 1.01x (?)
DictionaryBridge 1263 1319 +4.4% 0.96x (?)
DictionaryBridgeToObjC_Bridge 19 19 +0.0% 1.00x
DictionaryBridgeToObjC_BulkAccess 167 167 +0.0% 1.00x
DictionaryCompactMapValuesOfCastValue 14071 13608 -3.3% 1.03x
DictionaryCompactMapValuesOfNilValue 6500 6481 -0.3% 1.00x (?)
DictionaryCopy 98836 98304 -0.5% 1.01x (?)
DictionaryFilter 98833 99217 +0.4% 1.00x (?)
DictionaryGroup 201 201 +0.0% 1.00x
DictionaryGroupOfObjects 2068 2069 +0.0% 1.00x (?)
DictionaryKeysContainsCocoa 40 42 +5.0% 0.95x (?)
DictionaryKeysContainsNative 30 30 +0.0% 1.00x
DictionaryLiteral 1841 1860 +1.0% 0.99x (?)
DictionaryOfObjects 2370 2365 -0.2% 1.00x (?)
DictionaryRemove 3711 3717 +0.2% 1.00x (?)
DictionaryRemoveOfObjects 25114 25218 +0.4% 1.00x (?)
DictionarySubscriptDefaultMutation 242 242 +0.0% 1.00x
DictionarySubscriptDefaultMutationArray 600 600 +0.0% 1.00x
DictionarySubscriptDefaultMutationArrayOfObjects 4016 4018 +0.0% 1.00x (?)
DictionarySubscriptDefaultMutationOfObjects 1681 1681 +0.0% 1.00x
DictionarySwap 939 938 -0.1% 1.00x
DictionarySwapAt 6137 6180 +0.7% 0.99x (?)
DictionarySwapAtOfObjects 52470 52123 -0.7% 1.01x
DictionarySwapOfObjects 8605 8581 -0.3% 1.00x (?)
DoubleWidthDivision 0 0 +0.0% 1.00x
DropFirstAnyCollection 76 76 +0.0% 1.00x
DropFirstAnyCollectionLazy 66020 66166 +0.2% 1.00x (?)
DropFirstAnySeqCRangeIter 93 93 +0.0% 1.00x
DropFirstAnySeqCRangeIterLazy 93 93 +0.0% 1.00x
DropFirstAnySeqCntRange 71 71 +0.0% 1.00x
DropFirstAnySeqCntRangeLazy 71 71 +0.0% 1.00x
DropFirstAnySequence 1842 1842 +0.0% 1.00x
DropFirstAnySequenceLazy 1842 1846 +0.2% 1.00x
DropFirstArray 35 35 +0.0% 1.00x
DropFirstArrayLazy 35 35 +0.0% 1.00x
DropFirstCountableRange 29 29 +0.0% 1.00x
DropFirstCountableRangeLazy 29 29 +0.0% 1.00x
DropFirstSequence 2681 2683 +0.1% 1.00x (?)
DropFirstSequenceLazy 2776 2778 +0.1% 1.00x (?)
DropLastAnyCollection 28 28 +0.0% 1.00x
DropLastAnyCollectionLazy 22327 22324 -0.0% 1.00x (?)
DropLastAnySeqCRangeIter 3335 3350 +0.4% 1.00x (?)
DropLastAnySeqCRangeIterLazy 3335 3334 -0.0% 1.00x (?)
DropLastAnySeqCntRange 9 9 +0.0% 1.00x
DropLastAnySeqCntRangeLazy 9 9 +0.0% 1.00x
DropLastAnySequence 4961 4943 -0.4% 1.00x
DropLastAnySequenceLazy 5049 5042 -0.1% 1.00x (?)
DropLastSequence 645 642 -0.5% 1.00x (?)
DropLastSequenceLazy 644 645 +0.2% 1.00x (?)
DropWhileAnyCollection 100 99 -1.0% 1.01x
DropWhileAnyCollectionLazy 147 147 +0.0% 1.00x
DropWhileAnySeqCRangeIter 75 75 +0.0% 1.00x
DropWhileAnySeqCRangeIterLazy 147 147 +0.0% 1.00x
DropWhileAnySeqCntRange 95 95 +0.0% 1.00x
DropWhileAnySeqCntRangeLazy 147 148 +0.7% 0.99x
DropWhileAnySequence 1856 1854 -0.1% 1.00x
DropWhileAnySequenceLazy 1854 1855 +0.1% 1.00x (?)
DropWhileArrayLazy 105 105 +0.0% 1.00x
DropWhileCountableRange 30 30 +0.0% 1.00x
DropWhileCountableRangeLazy 82 82 +0.0% 1.00x
DropWhileSequence 2220 2219 -0.0% 1.00x (?)
DropWhileSequenceLazy 105 105 +0.0% 1.00x
EqualStringSubstring 48 48 +0.0% 1.00x
EqualSubstringString 48 49 +2.1% 0.98x
EqualSubstringSubstring 48 48 +0.0% 1.00x
EqualSubstringSubstringGenericEquatable 48 48 +0.0% 1.00x
ErrorHandling 1182 1184 +0.2% 1.00x (?)
ExclusivityGlobal 5 5 +0.0% 1.00x
ExclusivityIndependent 2 2 +0.0% 1.00x
FatCompactMap 1408 1408 +0.0% 1.00x
FilterEvenUsingReduce 1366 1357 -0.7% 1.01x (?)
FilterEvenUsingReduceInto 161 161 +0.0% 1.00x
FloatingPointPrinting_Double_description_small 21780 21638 -0.7% 1.01x
FloatingPointPrinting_Double_description_uniform 21188 21135 -0.3% 1.00x (?)
FloatingPointPrinting_Double_interpolated 61369 61458 +0.1% 1.00x (?)
FloatingPointPrinting_Float80_description_small 28527 28652 +0.4% 1.00x
FloatingPointPrinting_Float80_description_uniform 27741 27718 -0.1% 1.00x (?)
FloatingPointPrinting_Float80_interpolated 64737 65130 +0.6% 0.99x (?)
FloatingPointPrinting_Float_description_small 5726 5726 +0.0% 1.00x
FloatingPointPrinting_Float_description_uniform 6014 6012 -0.0% 1.00x (?)
FloatingPointPrinting_Float_interpolated 38978 38218 -1.9% 1.02x (?)
FrequenciesUsingReduce 4734 4745 +0.2% 1.00x (?)
FrequenciesUsingReduceInto 1493 1511 +1.2% 0.99x (?)
Hanoi 2145 2156 +0.5% 0.99x (?)
HashTest 934 937 +0.3% 1.00x (?)
Histogram 585 585 +0.0% 1.00x
Integrate 342 342 +0.0% 1.00x
IterateData 1596 1596 +0.0% 1.00x
Join 163 162 -0.6% 1.01x (?)
LazilyFilteredArrayContains 35882 35862 -0.1% 1.00x (?)
LazilyFilteredArrays2 4570 4570 +0.0% 1.00x
LazilyFilteredRange 3772 3770 -0.1% 1.00x (?)
LessSubstringSubstring 48 48 +0.0% 1.00x
LessSubstringSubstringGenericComparable 48 48 +0.0% 1.00x
LinkedList 7572 7572 +0.0% 1.00x
LuhnAlgoEager 442 445 +0.7% 0.99x (?)
LuhnAlgoLazy 440 443 +0.7% 0.99x (?)
MapReduce 397 397 +0.0% 1.00x
MapReduceAnyCollection 370 370 +0.0% 1.00x
MapReduceAnyCollectionShort 1976 1988 +0.6% 0.99x (?)
MapReduceClass 2984 2980 -0.1% 1.00x (?)
MapReduceClassShort 4531 4533 +0.0% 1.00x (?)
MapReduceLazyCollection 13 13 +0.0% 1.00x
MapReduceLazyCollectionShort 31 31 +0.0% 1.00x
MapReduceLazySequence 86 86 +0.0% 1.00x
MapReduceSequence 482 481 -0.2% 1.00x (?)
MapReduceShort 1979 1969 -0.5% 1.01x (?)
MapReduceShortString 20 20 +0.0% 1.00x
MapReduceString 45 45 +0.0% 1.00x
Memset 213 213 +0.0% 1.00x
MonteCarloE 10265 10256 -0.1% 1.00x (?)
MonteCarloPi 42611 42643 +0.1% 1.00x (?)
NSDictionaryCastToSwift 7721 7464 -3.3% 1.03x (?)
NSError 165 164 -0.6% 1.01x (?)
NSStringConversion 687 687 +0.0% 1.00x
NibbleSort 3283 3281 -0.1% 1.00x (?)
NopDeinit 32329 32346 +0.1% 1.00x (?)
ObjectAllocation 132 132 +0.0% 1.00x
ObjectiveCBridgeFromNSArrayAnyObject 26382 27392 +3.8% 0.96x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToString 46525 46052 -1.0% 1.01x (?)
ObjectiveCBridgeFromNSArrayAnyObjectToStringForced 46137 45076 -2.3% 1.02x (?)
ObjectiveCBridgeFromNSDictionaryAnyObject 111650 110767 -0.8% 1.01x (?)
ObjectiveCBridgeFromNSSetAnyObject 50793 50162 -1.2% 1.01x (?)
ObjectiveCBridgeFromNSSetAnyObjectToString 70947 69471 -2.1% 1.02x (?)
ObjectiveCBridgeFromNSString 1249 1258 +0.7% 0.99x
ObjectiveCBridgeFromNSStringForced 2712 2714 +0.1% 1.00x (?)
ObjectiveCBridgeStubDataAppend 6292 6256 -0.6% 1.01x (?)
ObjectiveCBridgeStubDateMutation 400 401 +0.2% 1.00x (?)
ObjectiveCBridgeStubFromNSString 1040 1043 +0.3% 1.00x (?)
ObjectiveCBridgeStubNSDataAppend 2659 2695 +1.4% 0.99x (?)
ObjectiveCBridgeStubToArrayOfNSString2 4041 4201 +4.0% 0.96x
ObjectiveCBridgeStubToNSDate2 1547 1547 +0.0% 1.00x
ObjectiveCBridgeStubToNSString 2349 2348 -0.0% 1.00x (?)
ObjectiveCBridgeStubToNSStringRef 124 124 +0.0% 1.00x
ObjectiveCBridgeStubURLAppendPath2 2862 2836 -0.9% 1.01x (?)
ObjectiveCBridgeStubURLAppendPathRef2 2721 2807 +3.2% 0.97x (?)
ObjectiveCBridgeToNSArray 15332 16095 +5.0% 0.95x
ObjectiveCBridgeToNSDictionary 28426 29272 +3.0% 0.97x
ObjectiveCBridgeToNSSet 18360 18387 +0.1% 1.00x (?)
ObjectiveCBridgeToNSString 452 452 +0.0% 1.00x
ObserverClosure 2152 2138 -0.7% 1.01x (?)
ObserverForwarderStruct 1185 1183 -0.2% 1.00x (?)
ObserverPartiallyAppliedMethod 3704 3693 -0.3% 1.00x (?)
ObserverUnappliedMethod 2468 2462 -0.2% 1.00x (?)
OpaqueConsumingUsers 4182 4180 -0.0% 1.00x (?)
OpenClose 65 65 +0.0% 1.00x
Phonebook 7088 7092 +0.1% 1.00x (?)
PointerArithmetics 31503 31510 +0.0% 1.00x (?)
PolymorphicCalls 25 25 +0.0% 1.00x
PopFrontArray 1790 1797 +0.4% 1.00x (?)
PopFrontArrayGeneric 1808 1815 +0.4% 1.00x
PopFrontUnsafePointer 8637 8636 -0.0% 1.00x (?)
PrefixAnyCollection 76 76 +0.0% 1.00x
PrefixAnyCollectionLazy 66582 66560 -0.0% 1.00x (?)
PrefixAnySeqCRangeIter 31 31 +0.0% 1.00x
PrefixAnySeqCRangeIterLazy 31 31 +0.0% 1.00x
PrefixAnySeqCntRange 71 71 +0.0% 1.00x
PrefixAnySeqCntRangeLazy 71 71 +0.0% 1.00x
PrefixAnySequence 1378 1378 +0.0% 1.00x
PrefixAnySequenceLazy 1378 1378 +0.0% 1.00x
PrefixArray 35 35 +0.0% 1.00x
PrefixArrayLazy 35 35 +0.0% 1.00x
PrefixCountableRange 29 29 +0.0% 1.00x
PrefixCountableRangeLazy 29 29 +0.0% 1.00x
PrefixSequence 2280 2238 -1.8% 1.02x (?)
PrefixSequenceLazy 2277 2276 -0.0% 1.00x (?)
PrefixWhileAnyCollection 146 147 +0.7% 0.99x
PrefixWhileAnyCollectionLazy 89 89 +0.0% 1.00x
PrefixWhileAnySeqCRangeIter 388 386 -0.5% 1.01x
PrefixWhileAnySeqCRangeIterLazy 89 89 +0.0% 1.00x
PrefixWhileAnySequence 1531 1532 +0.1% 1.00x (?)
PrefixWhileAnySequenceLazy 1392 1392 +0.0% 1.00x
PrefixWhileArray 88 88 +0.0% 1.00x
PrefixWhileArrayLazy 70 70 +0.0% 1.00x
PrefixWhileSequence 348 349 +0.3% 1.00x (?)
PrefixWhileSequenceLazy 52 52 +0.0% 1.00x
Prims 910 909 -0.1% 1.00x (?)
PrimsSplit 903 901 -0.2% 1.00x (?)
QueueConcrete 1141 1138 -0.3% 1.00x
QueueGeneric 1131 1130 -0.1% 1.00x (?)
RC4 155 154 -0.6% 1.01x
RGBHistogram 2424 2457 +1.4% 0.99x (?)
RGBHistogramOfObjects 20039 20110 +0.4% 1.00x
Radix2CooleyTukey 12190 12192 +0.0% 1.00x (?)
Radix2CooleyTukeyf 8854 8844 -0.1% 1.00x (?)
RandomDoubleDef 26704 26748 +0.2% 1.00x (?)
RandomDoubleLCG 2175 2177 +0.1% 1.00x
RandomIntegersDef 24489 24534 +0.2% 1.00x (?)
RandomIntegersLCG 178 178 +0.0% 1.00x
RandomShuffleDef2 2572 2583 +0.4% 1.00x
RandomShuffleLCG2 1816 1815 -0.1% 1.00x (?)
RangeAssignment 348 350 +0.6% 0.99x (?)
RangeIterationSigned 200 200 +0.0% 1.00x
RangeReplaceableCollectionPlusDefault 1051 1049 -0.2% 1.00x (?)
RecursiveOwnedParameter 115 115 +0.0% 1.00x
RemoveWhereFilterInts 47 47 +0.0% 1.00x
RemoveWhereFilterString 240 240 +0.0% 1.00x
RemoveWhereFilterStrings 437 435 -0.5% 1.00x
RemoveWhereMoveStrings 708 709 +0.1% 1.00x
RemoveWhereQuadraticInts 1289 1289 +0.0% 1.00x
RemoveWhereQuadraticString 366 371 +1.4% 0.99x (?)
RemoveWhereQuadraticStrings 2749 2751 +0.1% 1.00x (?)
RemoveWhereSwapInts 20 20 +0.0% 1.00x
RemoveWhereSwapStrings 861 862 +0.1% 1.00x (?)
ReversedArray2 200 200 +0.0% 1.00x
ReversedBidirectional 13957 13970 +0.1% 1.00x (?)
ReversedDictionary2 317 317 +0.0% 1.00x
RomanNumbers 89386 89487 +0.1% 1.00x (?)
SequenceAlgosAnySequence 12443 12449 +0.0% 1.00x (?)
SequenceAlgosArray 1581 1578 -0.2% 1.00x (?)
SequenceAlgosContiguousArray 1590 1572 -1.1% 1.01x
SequenceAlgosList 1352 1354 +0.1% 1.00x (?)
SequenceAlgosRange 2577 2576 -0.0% 1.00x (?)
SequenceAlgosUnfoldSequence 1105 1105 +0.0% 1.00x
SetExclusiveOr 4807 4839 +0.7% 0.99x (?)
SetExclusiveOr_OfObjects 11262 11317 +0.5% 1.00x
SetIntersect 577 577 +0.0% 1.00x
SetIntersect_OfObjects 1714 1716 +0.1% 1.00x (?)
SetIsSubsetOf 323 323 +0.0% 1.00x
SetIsSubsetOf_OfObjects 432 432 +0.0% 1.00x
SetUnion 4283 4305 +0.5% 0.99x (?)
SetUnion_OfObjects 9747 9729 -0.2% 1.00x
SevenBoom 843 839 -0.5% 1.00x (?)
Sim2DArray 312 312 +0.0% 1.00x
SortAdjacentIntPyramids 10247 10249 +0.0% 1.00x (?)
SortIntPyramid 8763 8751 -0.1% 1.00x (?)
SortLargeExistentials 5461 5471 +0.2% 1.00x
SortLettersInPlace 955 942 -1.4% 1.01x (?)
SortSortedStrings 702 702 +0.0% 1.00x
SortStrings 1493 1491 -0.1% 1.00x
SortStringsUnicode 2050 2051 +0.0% 1.00x (?)
StackPromo 24363 24359 -0.0% 1.00x (?)
StaticArray 10 10 +0.0% 1.00x
StrComplexWalk 1781 1781 +0.0% 1.00x
StrToInt 3169 3170 +0.0% 1.00x (?)
StringAdder 549 548 -0.2% 1.00x
StringBuilder 490 491 +0.2% 1.00x (?)
StringBuilderLong 1244 1239 -0.4% 1.00x (?)
StringBuilderSmallReservingCapacity 501 501 +0.0% 1.00x
StringComparison_abnormal 770 769 -0.1% 1.00x (?)
StringComparison_ascii 1028 1026 -0.2% 1.00x (?)
StringComparison_emoji 856 855 -0.1% 1.00x
StringComparison_fastPrenormal 852 851 -0.1% 1.00x (?)
StringComparison_latin1 656 656 +0.0% 1.00x
StringComparison_longSharedPrefix 960 960 +0.0% 1.00x
StringComparison_nonBMPSlowestPrenormal 1697 1699 +0.1% 1.00x (?)
StringComparison_slowerPrenormal 1827 1827 +0.0% 1.00x
StringComparison_zalgo 112114 111985 -0.1% 1.00x (?)
StringEdits 169952 168536 -0.8% 1.01x (?)
StringEnumRawValueInitialization 865 863 -0.2% 1.00x
StringEqualPointerComparison 314 315 +0.3% 1.00x
StringFromLongWholeSubstring 21 21 +0.0% 1.00x
StringFromLongWholeSubstringGeneric 21 21 +0.0% 1.00x
StringHasPrefixAscii 2233 2233 +0.0% 1.00x
StringHasPrefixUnicode 99283 99112 -0.2% 1.00x (?)
StringHasSuffixAscii 2291 2290 -0.0% 1.00x (?)
StringHasSuffixUnicode 99455 99835 +0.4% 1.00x (?)
StringHashing_abnormal 1348 1348 +0.0% 1.00x
StringHashing_ascii 34 34 +0.0% 1.00x
StringHashing_emoji 1952 2013 +3.1% 0.97x (?)
StringHashing_fastPrenormal 8437 8537 +1.2% 0.99x (?)
StringHashing_latin1 2570 2566 -0.2% 1.00x (?)
StringHashing_longSharedPrefix 7749 7770 +0.3% 1.00x (?)
StringHashing_nonBMPSlowestPrenormal 2125 2233 +5.1% 0.95x (?)
StringHashing_slowerPrenormal 2814 2821 +0.2% 1.00x (?)
StringHashing_zalgo 3516 3538 +0.6% 0.99x (?)
StringInterpolation 9045 9410 +4.0% 0.96x
StringInterpolationManySmallSegments 17854 17878 +0.1% 1.00x (?)
StringInterpolationSmall 4107 4072 -0.9% 1.01x
StringMatch 12296 12278 -0.1% 1.00x (?)
StringRemoveDupes 469 468 -0.2% 1.00x (?)
StringUTF16Builder 2536 2548 +0.5% 1.00x (?)
StringUTF16SubstringBuilder 5572 5590 +0.3% 1.00x (?)
StringWalk 1547 1546 -0.1% 1.00x (?)
StringWithCString2 1787 1786 -0.1% 1.00x
StringWordBuilder 2269 2278 +0.4% 1.00x (?)
StringWordBuilderReservingCapacity 1611 1620 +0.6% 0.99x (?)
SubstringComparable 12 12 +0.0% 1.00x
SubstringEqualString 620 619 -0.2% 1.00x (?)
SubstringEquatable 1468 1463 -0.3% 1.00x (?)
SubstringFromLongString 10 10 +0.0% 1.00x
SubstringFromLongStringGeneric 74 74 +0.0% 1.00x
SuffixAnyCollection 28 28 +0.0% 1.00x
SuffixAnySeqCRangeIter 3635 3633 -0.1% 1.00x (?)
SuffixAnySeqCRangeIterLazy 3641 3638 -0.1% 1.00x (?)
SuffixAnySeqCntRange 14 14 +0.0% 1.00x
SuffixAnySeqCntRangeLazy 14 14 +0.0% 1.00x
SuffixAnySequence 4914 4920 +0.1% 1.00x (?)
SuffixAnySequenceLazy 5008 5025 +0.3% 1.00x
SuffixSequence 3589 3591 +0.1% 1.00x (?)
SuffixSequenceLazy 3616 3595 -0.6% 1.01x
SumUsingReduce 97 97 +0.0% 1.00x
SumUsingReduceInto 97 97 +0.0% 1.00x
SuperChars 19523 19521 -0.0% 1.00x (?)
TwoSum 1356 1358 +0.1% 1.00x (?)
TypeFlood 0 0 +0.0% 1.00x
UTF8Decode 299 300 +0.3% 1.00x (?)
UTF8Decode_InitDecoding 1351 1352 +0.1% 1.00x (?)
UTF8Decode_InitDecoding_ascii 655 681 +4.0% 0.96x (?)
UTF8Decode_InitFromBytes 1198 1186 -1.0% 1.01x (?)
UTF8Decode_InitFromBytes_ascii 508 504 -0.8% 1.01x (?)
UTF8Decode_InitFromData 1268 1264 -0.3% 1.00x
UTF8Decode_InitFromData_ascii 744 715 -3.9% 1.04x (?)
Walsh 406 407 +0.2% 1.00x (?)
WordCountHistogramASCII 6814 6816 +0.0% 1.00x (?)
WordCountHistogramUTF16 10180 10121 -0.6% 1.01x (?)
WordCountUniqueASCII 2040 2041 +0.0% 1.00x (?)
WordCountUniqueUTF16 4610 4750 +3.0% 0.97x
XorLoop 396 395 -0.3% 1.00x (?)
Hardware Overview
  Model Name: Mac Pro
  Model Identifier: MacPro6,1
  Processor Name: 12-Core Intel Xeon E5
  Processor Speed: 2.7 GHz
  Number of Processors: 1
  Total Number of Cores: 12
  L2 Cache (per Core): 256 KB
  L3 Cache: 30 MB
  Memory: 64 GB

@swift-ci
Copy link
Contributor

Build comment file:

Summary for master full

Unexpected test results, excluded stats for RxSwift, ReactiveCocoa, Wordy, DatabaseKit, ReactiveSwift

Regressions found (see below)

Debug-batch

debug-batch brief

Regressed (0)
name old new delta delta_pct
Improved (0)
name old new delta delta_pct
Unchanged (delta < 1.0% or delta < 100.0ms) (3)
name old new delta delta_pct
Frontend.NumInstructionsExecuted 10,050,842,745,926 10,054,465,079,635 3,622,333,709 0.04%
LLVM.NumLLVMBytesOutput 505,223,080 505,223,104 24 0.0%
time.swift-driver.wall 1150.9s 1154.9s 4.0s 0.35%

debug-batch detailed

Regressed (2)
name old new delta delta_pct
Driver.NumDriverPipePolls 82,626 85,048 2,422 2.93% ⛔
Driver.NumDriverPipeReads 85,569 87,928 2,359 2.76% ⛔
Improved (1)
name old new delta delta_pct
Driver.ChildrenMaxRSS 34,866,294,784 34,458,163,200 -408,131,584 -1.17% ✅
Unchanged (delta < 1.0% or delta < 100.0ms) (86)
name old new delta delta_pct
AST.NumASTBytesAllocated 13,608,828,826 13,608,782,013 -46,813 -0.0%
AST.NumDecls 33,060 33,060 0 0.0%
AST.NumDependencies 88,574 88,574 0 0.0%
AST.NumImportedExternalDefinitions 816,564 816,564 0 0.0%
AST.NumInfixOperators 13,323 13,323 0 0.0%
AST.NumLinkLibraries 0 0 0 0.0%
AST.NumLoadedModules 100,529 100,529 0 0.0%
AST.NumLocalTypeDecls 13 13 0 0.0%
AST.NumObjCMethods 12,906 12,906 0 0.0%
AST.NumPostfixOperators 14 14 0 0.0%
AST.NumPrecedenceGroups 6,996 6,996 0 0.0%
AST.NumPrefixOperators 60 60 0 0.0%
AST.NumReferencedDynamicNames 45 45 0 0.0%
AST.NumReferencedMemberNames 1,899,880 1,899,880 0 0.0%
AST.NumReferencedTopLevelNames 115,797 115,797 0 0.0%
AST.NumSourceBuffers 151,366 151,366 0 0.0%
AST.NumSourceLines 1,198,590 1,198,590 0 0.0%
AST.NumSourceLinesPerSecond 701,704 702,703 999 0.14%
AST.NumTotalClangImportedEntities 2,642,117 2,642,117 0 0.0%
AST.NumUsedConformances 101,090 101,090 0 0.0%
Driver.DriverDepCascadingDynamic 0 0 0 0.0%
Driver.DriverDepCascadingExternal 0 0 0 0.0%
Driver.DriverDepCascadingMember 0 0 0 0.0%
Driver.DriverDepCascadingNominal 0 0 0 0.0%
Driver.DriverDepCascadingTopLevel 0 0 0 0.0%
Driver.DriverDepDynamic 0 0 0 0.0%
Driver.DriverDepExternal 0 0 0 0.0%
Driver.DriverDepMember 0 0 0 0.0%
Driver.DriverDepNominal 0 0 0 0.0%
Driver.DriverDepTopLevel 0 0 0 0.0%
Driver.NumDriverJobsRun 7,072 7,072 0 0.0%
Driver.NumDriverJobsSkipped 0 0 0 0.0%
Driver.NumProcessFailures 0 0 0 0.0%
Frontend.NumInstructionsExecuted 10,050,842,745,926 10,054,465,079,635 3,622,333,709 0.04%
Frontend.NumProcessFailures 0 0 0 0.0%
IRModule.NumIRAliases 26,417 26,417 0 0.0%
IRModule.NumIRBasicBlocks 1,730,602 1,730,602 0 0.0%
IRModule.NumIRComdatSymbols 0 0 0 0.0%
IRModule.NumIRFunctions 950,248 950,248 0 0.0%
IRModule.NumIRGlobals 1,163,441 1,163,441 0 0.0%
IRModule.NumIRIFuncs 0 0 0 0.0%
IRModule.NumIRInsts 20,379,959 20,379,959 0 0.0%
IRModule.NumIRNamedMetaData 34,928 34,928 0 0.0%
IRModule.NumIRValueSymbols 1,829,770 1,829,770 0 0.0%
LLVM.NumLLVMBytesOutput 505,223,080 505,223,104 24 0.0%
Parse.NumFunctionsParsed 63,471 63,471 0 0.0%
SILModule.NumSILGenDefaultWitnessTables 0 0 0 0.0%
SILModule.NumSILGenFunctions 948,428 948,428 0 0.0%
SILModule.NumSILGenGlobalVariables 14,900 14,900 0 0.0%
SILModule.NumSILGenVtables 3,966 3,966 0 0.0%
SILModule.NumSILGenWitnessTables 18,802 18,802 0 0.0%
SILModule.NumSILOptDefaultWitnessTables 0 0 0 0.0%
SILModule.NumSILOptFunctions 713,547 713,547 0 0.0%
SILModule.NumSILOptGlobalVariables 15,334 15,334 0 0.0%
SILModule.NumSILOptVtables 7,636 7,636 0 0.0%
SILModule.NumSILOptWitnessTables 36,779 36,779 0 0.0%
Sema.AccessLevelRequest 924,796 924,796 0 0.0%
Sema.DefaultAndMaxAccessLevelRequest 21,506 21,506 0 0.0%
Sema.EnumRawTypeRequest 7,688 7,688 0 0.0%
Sema.ExtendedNominalRequest 1,479,508 1,479,508 0 0.0%
Sema.InheritedDeclsReferencedRequest 54,526,921 54,526,921 0 0.0%
Sema.InheritedTypeRequest 26,183 26,183 0 0.0%
Sema.IsDynamicRequest 725,819 725,819 0 0.0%
Sema.IsObjCRequest 649,667 649,667 0 0.0%
Sema.NamedLazyMemberLoadFailureCount 14,826 14,826 0 0.0%
Sema.NamedLazyMemberLoadSuccessCount 2,202,306 2,202,306 0 0.0%
Sema.NominalTypeLookupDirectCount 15,566,808 15,566,813 5 0.0%
Sema.NumConformancesDeserialized 1,914,033 1,914,033 0 0.0%
Sema.NumConstraintScopes 7,336,400 7,336,400 0 0.0%
Sema.NumConstraintsConsideredForEdgeContraction 13,154,895 13,154,895 0 0.0%
Sema.NumDeclsDeserialized 16,547,353 16,547,353 0 0.0%
Sema.NumDeclsValidated 1,028,574 1,028,574 0 0.0%
Sema.NumFunctionsTypechecked 477,324 477,324 0 0.0%
Sema.NumGenericSignatureBuilders 776,445 776,445 0 0.0%
Sema.NumLazyGenericEnvironments 3,076,544 3,076,544 0 0.0%
Sema.NumLazyGenericEnvironmentsLoaded 308,975 308,975 0 0.0%
Sema.NumLazyIterableDeclContexts 2,801,566 2,801,566 0 0.0%
Sema.NumTypesDeserialized 6,859,108 6,859,108 0 0.0%
Sema.NumTypesValidated 870,165 870,165 0 0.0%
Sema.NumUnloadedLazyIterableDeclContexts 1,906,147 1,906,147 0 0.0%
Sema.OverriddenDeclsRequest 1,497,828 1,497,828 0 0.0%
Sema.SelfBoundsFromWhereClauseRequest 50,582 50,582 0 0.0%
Sema.SetterAccessLevelRequest 56,039 56,039 0 0.0%
Sema.SuperclassDeclRequest 43,421,701 43,421,701 0 0.0%
Sema.SuperclassTypeRequest 15,741 15,741 0 0.0%
Sema.UnderlyingTypeDeclsReferencedRequest 1,561,021 1,561,021 0 0.0%

Release

release brief

Regressed (0)
name old new delta delta_pct
Improved (0)
name old new delta delta_pct
Unchanged (delta < 1.0% or delta < 100.0ms) (3)
name old new delta delta_pct
Frontend.NumInstructionsExecuted 12,224,065,151,375 12,222,116,804,322 -1,948,347,053 -0.02%
LLVM.NumLLVMBytesOutput 478,663,984 478,663,798 -186 -0.0%
time.swift-driver.wall 2168.7s 2167.4s -1.3s -0.06%

release detailed

Regressed (0)
name old new delta delta_pct
Improved (0)
name old new delta delta_pct
Unchanged (delta < 1.0% or delta < 100.0ms) (23)
name old new delta delta_pct
AST.NumImportedExternalDefinitions 146,087 146,087 0 0.0%
AST.NumLoadedModules 6,370 6,370 0 0.0%
AST.NumTotalClangImportedEntities 465,090 465,090 0 0.0%
AST.NumUsedConformances 103,289 103,289 0 0.0%
IRModule.NumIRBasicBlocks 1,708,669 1,708,669 0 0.0%
IRModule.NumIRFunctions 763,500 763,500 0 0.0%
IRModule.NumIRGlobals 883,631 883,631 0 0.0%
IRModule.NumIRInsts 14,703,846 14,703,846 0 0.0%
IRModule.NumIRValueSymbols 1,494,480 1,494,480 0 0.0%
LLVM.NumLLVMBytesOutput 478,663,984 478,663,798 -186 -0.0%
SILModule.NumSILGenFunctions 335,122 335,122 0 0.0%
SILModule.NumSILOptFunctions 452,980 452,980 0 0.0%
Sema.NumConformancesDeserialized 920,295 920,295 0 0.0%
Sema.NumConstraintScopes 7,239,654 7,239,654 0 0.0%
Sema.NumDeclsDeserialized 2,976,790 2,976,790 0 0.0%
Sema.NumDeclsValidated 548,486 548,486 0 0.0%
Sema.NumFunctionsTypechecked 172,322 172,322 0 0.0%
Sema.NumGenericSignatureBuilders 112,836 112,836 0 0.0%
Sema.NumLazyGenericEnvironments 500,917 500,917 0 0.0%
Sema.NumLazyGenericEnvironmentsLoaded 58,075 58,075 0 0.0%
Sema.NumLazyIterableDeclContexts 328,751 328,751 0 0.0%
Sema.NumTypesDeserialized 1,616,647 1,616,647 0 0.0%
Sema.NumTypesValidated 273,787 273,787 0 0.0%

@gottesmm gottesmm merged commit 700da2e into swiftlang:master Aug 18, 2018
@gottesmm gottesmm deleted the pr-400a2e32a349f60ef9499e4d50c6f00b6fae5b80 branch August 18, 2018 00:23
@gottesmm
Copy link
Contributor Author

And may we never speak of missing pass manager notifications... ever again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants