1121505 - test_bug159346.xul, test_bug703150.xul, test_scrollbar.xul all fail on osx 10.10 with default "automatically" scrollbar prefs

Status: NEW

(Core :: Widget: Cocoa, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

we are working on getting osx 10.10 running unit tests.  There are always a handful of tests that need attention, in this case we have a failure.

test are available on cedar for right now:
https://treeherder.mozilla.org/#/jobs?repo=cedar&revision=f5947d58ab02&filter-platform=10-10

specifically in mochitest-other (opt):
http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/cedar-macosx64/1421100530/cedar_yosemite_test-mochitest-other-bm106-tests1-macosx-build2.txt.gz

we have these failures:
04:49:51     INFO -  1719 INFO TEST-OK | layout/style/test/chrome/test_moz_document_rules.html | took 2615ms
04:49:51     INFO -  1720 INFO TEST-START | layout/xul/test/test_bug159346.xul
04:49:51     INFO -  1721 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by mousedown #1 - expected PASS
04:49:52     INFO -  1722 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by auto repeat #1 - expected PASS
04:49:53     INFO -  1723 INFO TEST-PASS | layout/xul/test/test_bug159346.xul | scrollbar changed curpos after mouseup #1
04:49:53     INFO -  1724 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by mousedown #2 - expected PASS
04:49:54     INFO -  1725 INFO TEST-PASS | layout/xul/test/test_bug159346.xul | scrollbar changed curpos by auto repeat when cursor is outside of scrollbar button #2
04:49:55     INFO -  1726 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by mousemove after cursor is back on the scrollbar button #2 - expected PASS
04:49:55     INFO -  1727 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by mousedown #3 - expected PASS
04:49:56     INFO -  1728 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by auto repeat when cursor is outside of scrollbar button #3 - expected PASS
04:49:57     INFO -  1729 INFO TEST-UNEXPECTED-FAIL | layout/xul/test/test_bug159346.xul | scrollbar didn't change curpos by mousemove after cursor is back on the scrollbar button #3 - expected PASS
04:49:57     INFO -  1730 INFO MEMORY STAT vsize after test: 3901591552
04:49:57     INFO -  1731 INFO MEMORY STAT residentFast after test: 735236096
04:49:57     INFO -  1732 INFO MEMORY STAT heapAllocated after test: 144775896
04:49:57     INFO -  1733 INFO TEST-OK | layout/xul/test/test_bug159346.xul | took 6078ms
04:49:57     INFO -  1734 INFO TEST-START | layout/xul/test/test_bug372685.xul

Comment 1

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

Masayuki- I know you are tired of hearing from me on yet another test case issue- just pretend I am someone famous and it will at least cheer you up a bit.  I see you are the original test author of this testcase, can you comment as to why this might be failing on osx 10.10?  Any thoughts on what to try, who else to bring in, etc.?

Comment 2

[Masayuki Nakano [:masayuki] (he/him)(JST, +0900)(sick)]

Hmm, I'm not sure.

Steven, is the behavior of scrollbar changed on 10.10? The test sets scrollbar style itself, therefore, it tests scrollbar's button behavior on all platforms. I guess that Gecko does something different only on 10.10 at creating or styling scrollbars.

Comment 3

[Steven Michaud [:smichaud] (Retired)]

> Steven, is the behavior of scrollbar changed on 10.10?

I'm not aware of any big, visible changes.  But there could easily have been small ones that escaped my notice.

Sorry I couldn't be more help.

Comment 4

[Masayuki Nakano [:masayuki] (he/him)(JST, +0900)(sick)]

No problem, thank you for your reply.

Comment 5

[Phil Ringnalda (:philor)]

You can now run 10.10 tests on try, e.g. try: -b d -p macosx64 -u mochitest-o[10.6,10.8,10.10] -t none

Comment 6

[Phil Ringnalda (:philor)]

I can reproduce this same pattern of failures locally with the default Automatic setting for scrollbars, but they all pass with Always set. Did bug 1033650 maybe get reverted, or not actually work?

Comment 7

[Kim Moir [:kmoir] ET]

It seems there is a problem with bug 1033650, testing a fix now

Comment 8

[Phil Ringnalda (:philor)]

And indeed, now that we're actually successfully setting the pref for always-on scrollbars, these tests pass and no longer block deploying 10.10, but it would still be nice to someday see these tests pass with the default scrollbars, so we don't have to tell every single new Mac developer "oh, you have to set a system pref to a non-default value to be able to have tests actually pass locally."

Comment 9

[Stephen A Pohl [:spohl]]

(In reply to Phil Ringnalda (:philor) from comment #8)
> it would still be nice to someday see these tests pass with the default
> scrollbars

Agreed. Bug 1035274.