Skip to content

[net11.0] Screenshot baseline mismatches after main merge (Shell, TabbedPage, Image, Flyout) #34586

Description

@PureWeen

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1342062
Build error leg or test failing: Shell, TabbedPage UITests on Android API30
Pull request: #34550

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "Snapshot different than baseline: (VerifyShell_IsVisible|VerifyShell_TabBarBackgroundColor|VerifyShell_TabBarBackgroundColorAndTitleColor|VerifyShell_TabBarBackgroundColorSetToNull|VerifyShell_TabBarDisabledColor|VerifyShell_TabBarForegroundColorAndTitleColor|VerifyShell_TabBarTitleColor|VerifyShell_TabBarTitleColorAndUnSelectedColor|VerifyShell_TabBarUnselectedColor)\\.png",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Description

After merging main → net11.0 (PR #34550), UITests fail with screenshot baseline mismatches. The root cause is the Material3 package (#33450) changing BottomNavigationView.MaxItemCount from 5 → 6 on net11.0, which altered bottom tab layout rendering.

Status

16 of the original 26 snapshots have been fixed by PR #34601, which clamps MaxItemCount back to 5 and updates the affected baselines. Issue16918Test was split to its own Known Build Error (#34624) since it has a different root cause (MacCatalyst flaky, not MaxItemCount). The pattern above now only covers the 9 remaining unfixed VerifyShell_ snapshots*.

Remaining unfixed snapshots (9)

Snapshot Test Platform Notes
VerifyShell_IsVisible.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColorAndTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColorSetToNull.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarDisabledColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarForegroundColorAndTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarTitleColorAndUnSelectedColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarUnselectedColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline

Split to separate Known Build Errors

Fixed by PR #34601 (removed from pattern)

16 snapshots with updated baselines (click to expand)
  • DynamicFontImageSourceColorShouldApplyOnBottomTabIconOnAndroid.png
  • DynamicTabSectionVisibility.png
  • FontImageSourceColorShouldApplyOnBottomTabIconOnAndroid.png
  • ImageDoesNotDisappearWhenSwitchingTab.png
  • Issue32993TabBarUpdatesCorrectlyInRTLMode.png
  • NavigationBarLayoutWithMixedHasNavigationBar.png
  • ShellAppearanceUpdatesWhenChangingBetweenTabs.png
  • ShellAppearanceUpdatesWhenChangingShellSectionToTab_1.png
  • ShellAppearanceUpdatesWhenChangingShellSectionToTab_2.png
  • ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout.png
  • TabBarIconsShouldAutoscaleShell.png
  • TabBarShouldBeVisibleOnMacCatalyst.png
  • VerifyShell_TabBarBackgroundColorAndForegroundColor.png
  • VerifyShell_TabBarForegroundColor.png
  • VerifyShell_TabBarForegroundColorAndUnSelectedColor.png
  • VerifyTabbedPageMenuItemTextColor.png

Resolution

Once PR #34601 merges and the remaining 9 VerifyShell_* snapshots are confirmed passing (or baselines updated), close this issue.

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1342062
Error message validated: [Snapshot different than baseline: (VerifyShell_IsVisible|VerifyShell_TabBarBackgroundColor|VerifyShell_TabBarBackgroundColorAndTitleColor|VerifyShell_TabBarBackgroundColorSetToNull|VerifyShell_TabBarDisabledColor|VerifyShell_TabBarForegroundColorAndTitleColor|VerifyShell_TabBarTitleColor|VerifyShell_TabBarTitleColorAndUnSelectedColor|VerifyShell_TabBarUnselectedColor)\.png]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 3/24/2026 8:07:14 PM UTC

Report

Build Repository Step Name Console log Pull Request
1440405 dotnet/maui Controls (API 30) Shell Log #35463
1438626 dotnet/maui Controls (API 30) Shell Log #35463
1434254 dotnet/maui Controls Shell (API 30) Log #34758
1433825 dotnet/maui Controls Shell Log
Build Repository Test Pull Request
3000537 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1463044 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35597
2999170 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2998980 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_TabBarForegroundColorAndTitleColor
2998833 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2998115 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2997946 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2996913 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1456278 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34600
1456236 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1455559 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34600
2995332 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1453696 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35361
2993279 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2993258 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2992977 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1451012 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34758
2992237 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2991453 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2990403 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2990578 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2990517 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1446272 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1445046 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35585
1444200 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34758
2989385 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1443638 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1437172 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34923
1435911 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35384
2982050 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2981849 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1431117 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35577
1430583 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
2981132 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1429761 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35385
1428024 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
2979787 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2979449 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2979158 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
2978899 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
2978769 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1426317 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35362
1426384 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1426140 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35489
2977978 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(iOS).VerifyShell_IsVisible
1424842 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35475
1424549 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #35447

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 12 51

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions