1328825 - [Stylo] Update reftest-stylo.list and expectations

Status: RESOLVED FIXED

(Core :: CSS Parsing and Computation, defect)

Comment 1

[Shing Lyu [:shinglyu]]

Attachment: Bug 1328825 - Update reftest-stylo.list and expectations.

Review commit: https://reviewboard.mozilla.org/r/102474/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/102474/

Comment 2

[Shing Lyu [:shinglyu]]

What I've done:

* Pull new tests from corresponding reftest.list
* Re-run the previously crashed/disabled tests to make sure if they are fixed yet
* Disable intermittents to reduce noise
* Publish the scripts I used: https://github.com/shinglyu/stylo-reftest-scripts/blob/master/run_all.sh

This is the final all-green result, except a intermittent that rarely happens: https://treeherder.mozilla.org/#/jobs?repo=try&revision=613eb8a8d882780cf72d25c51397debe3d5c54c1

Comment 3

[Cameron McCormack (:heycam)]

Could you upload the lists of crashed and intermittents?

Comment 4

[Cameron McCormack (:heycam)]

Comment on attachment 8823986 [details]
Bug 1328825 - Update reftest-stylo.list and expectations.

https://reviewboard.mozilla.org/r/102474/#review103226

I didn't look closely, but the approach sounds fine to me.  rs=me

Comment 5

[Shing Lyu [:shinglyu]]

This is the summary

passes		5107
expected-fails	8366
disabled	905
total		14378

Comment 6

[Shing Lyu [:shinglyu]]

The crashes are uploaded to https://bugzilla.mozilla.org/show_bug.cgi?id=1289964
The intermittent and timeouts are uploaded to https://bugzilla.mozilla.org/show_bug.cgi?id=1324348

Comment 7

[Shing Lyu [:shinglyu]]

Comment on attachment 8823986 [details]
Bug 1328825 - Update reftest-stylo.list and expectations.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/102474/diff/1-2/

Comment 8

[Shing Lyu [:shinglyu]]

Comment on attachment 8823986 [details]
Bug 1328825 - Update reftest-stylo.list and expectations.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/102474/diff/2-3/

Comment 9

[Shing Lyu [:shinglyu]]

Comment on attachment 8823986 [details]
Bug 1328825 - Update reftest-stylo.list and expectations.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/102474/diff/3-4/

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/e3839190a63a
Update reftest-stylo.list and expectations. r=heycam

Comment 11

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/e3839190a63a

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/cb1597c6fb36
Followup to fix one reftest-stylo.list line. r=me

Comment 13

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/cb1597c6fb36