The latest version of PerfCompare is now live!
New view alert!
The cross-platform view in PerfCompare!
How it started: Matthew Gaudet sought to answer one question that keeps coming up for engineers looking at a performance change: “Do these improvements or regressions agree across platforms?” Until now, answering that meant opening each platform’s results one at a time and comparing them by hand. He saw that gap and filed Bug 2069050 asking for an official cross platform view in PerfCompare.
What we have now and how it works: The new cross-platform subtests view is live now! It shows each subtest as a row and each platform as a column. An Agreement column sums up the result at a glance, like “3/3 improved”, “2/3 regressed” or “Mixed”. Regressions are sorted to the top by default, and you can sort and filter by agreement. You can also click any cell to go to that platform’s detailed results. You get there from the new “Compare across platforms” link in a test’s header, which appears whenever two or more platforms have subtest data.
Please feel free to leave feedback or file bugs through the links below.
Check out the change-log below to see the updates:
Highlights:
[kala-moz]:
-
Bug 2068298 Simple View: match the advanced options selections for both results and subtests page
-
Bug 2067300 Simple view: Persist advanced options in cookies (with URL taking precedence)
-
Bug 2075051 Magnitude filter “Medium” option matches no rows; rows show “Moderate” instead
-
Add a fake Treeherder backend for ?fakedata
[moijes]: Bug-2003889: Show Lando try-push status instead of a blank-revision error
Other changes:
[kala-moz]:
-
Bug 2069050 - prepare code for cross-platform subtests view (#1134)
-
Bug 2082629 Remove unused and phantom fields from Mann-Whitney U types (#1130)
Thank you for the contributions!
Bugs or feature requests can be filed on Bugzilla. The team can also be found on the #perfcompare channel on Matrix. Come and chat!