1414124 - Intermittent devtools/client/debugger/new/test/mochitest/browser_dbg-toggling-tools.js | Test timed out -

Status: RESOLVED FIXED

(DevTools :: Debugger, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=141835792&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/bxaIZ7x5RbCvwfM5wUR1yQ/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Eliza Balazs [:ebalazs_]]

Starting with 2nd of Nov there were 31 failures.

Most of them occur on Linux x64 (enabled and disabled) and the rest of them on Windows 7, Windows 10-64, OS X 10.10.

The affected build types are debug, opt, pgo, asan

A recent log example: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=142199459&lineNumber=3544

And a relevant part of the log where the test failed:
23:53:50     INFO -  117 INFO TEST-START | devtools/client/debugger/new/test/mochitest/browser_dbg_keyboard_navigation.js
3624
23:54:35     INFO -  Not taking screenshot here: see the one that was previously logged
3625
23:54:35     INFO -  Buffered messages logged at 23:53:50
3626
23:54:35     INFO -  118 INFO Entering test bound
3627
23:54:35     INFO -  119 INFO Adding a new tab with URL: http://example.com/browser/devtools/client/debugger/new/test/mochitest/examples/doc-scripts.html
3628
23:54:35     INFO -  Buffered messages finished
3629
23:54:35    ERROR -  120 INFO TEST-UNEXPECTED-FAIL | devtools/client/debugger/new/test/mochitest/browser_dbg_keyboard_navigation.js | Test timed out -
3630
23:54:35     INFO -  121 INFO Removing tab.
3631
23:54:35     INFO -  122 INFO Waiting for event: 'TabClose' on [object XULElement].
3632
23:54:35     INFO -  123 INFO Got event: 'TabClose' on [object XULElement].
3633
23:54:35     INFO -  124 INFO Tab removed and finished closing
3634
23:54:35     INFO -  GECKO(2808) | MEMORY STAT | vsize 1013MB | vsizeMaxContiguous 391MB | residentFast 302MB | heapAllocated 97MB
3635
23:54:35     INFO -  125 INFO TEST-OK | devtools/client/debugger/new/test/mochitest/browser_dbg_keyboard_navigation.js | took 45061ms
3636
23:54:35     INFO -  126 INFO checking window state
3637
23:54:36     INFO -  GECKO(2808) | Completed ShutdownLeaks collections in process 2704
3638
23:54:36     INFO -  GECKO(2808) | Completed ShutdownLeaks collections in process 2860
3639
23:54:36     INFO -  GECKO(2808) | Completed ShutdownLeaks collections in process 1012
3640
23:54:36     INFO -  GECKO(2808) | Completed ShutdownLeaks collections in process 4276
3641
23:54:37     INFO -  GECKO(2808) | Completed ShutdownLeaks collections in process 2808

:jlast, Can you please take a look?

Comment 2

[Intermittent Failures Robot]

43 failures in 857 pushes (0.05 failures/push) were associated with this bug in the last 7 days. 

This is the #40 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 20
* mozilla-inbound: 18
* mozilla-central: 3
* mozilla-beta: 2

Platform breakdown:
* windows7-32: 17
* linux64: 12
* windows10-64: 7
* linux64-stylo-disabled: 4
* osx-10-10: 2
* windows7-32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414124&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 3

[Intermittent Failures Robot]

17 failures in 138 pushes (0.123 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 7
* mozilla-inbound: 5
* mozilla-central: 3
* try: 1
* mozilla-beta: 1

Platform breakdown:
* windows7-32: 7
* windows10-64: 3
* osx-10-10: 3
* linux64: 2
* linux64-stylo-disabled: 1
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414124&startday=2017-11-06&endday=2017-11-06&tree=all

Comment 4

[Intermittent Failures Robot]

24 failures in 174 pushes (0.138 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 10
* autoland: 10
* mozilla-central: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* windows7-32: 10
* linux64: 6
* osx-10-10: 4
* windows10-64: 2
* linux64-stylo-disabled: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414124&startday=2017-11-07&endday=2017-11-07&tree=all

Comment 5

[Intermittent Failures Robot]

188 failures in 849 pushes (0.221 failures/push) were associated with this bug in the last 7 days. 

This is the #3 most frequent failure this week.   

** This test has failed more than 200 times in the last 30 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* autoland: 90
* mozilla-inbound: 44
* mozilla-central: 38
* try: 8
* pine: 5
* mozilla-beta: 3

Platform breakdown:
* windows7-32: 64
* linux64: 55
* linux64-stylo-disabled: 26
* osx-10-10: 16
* windows10-64: 15
* linux32: 5
* linux64-ccov: 4
* windows7-32-nightly: 1
* windows10-64-nightly: 1
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414124&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 6

[Cristian Brindusan [:cbrindusan]]

In the last 7 days there were 170 failures. If this continues to have a high failure rate, it will be in danger of being disabled.

:jlast Do you have any updates on this?

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/128a413ff980
Disable devtools/client/debugger/new/test/mochitest/browser_dbg-toggling-tools.js on all configs for frequent failures. r=me, a=testonly

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

this has been disabled, please remember to enable it while working on a patch

Comment 9

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/128a413ff980

Comment 10

[Jason Laster [:jlast]]

Thanks for disabling earlier. I'll look into a fix soon.

Comment 11

[Jason Laster [:jlast]]

I created an issue in github to track it https://github.com/devtools-html/debugger.html/issues/4722

:ebalazs_ is it possible to see if this test failed when keyboard_navigation succeeded?

Comment 12

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/c2b80a6294c5

Comment 13

[Intermittent Failures Robot]

10 failures in 762 pushes (0.013 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 8
* try: 1
* autoland: 1

Platform breakdown:
* windows7-32: 2
* windows10-64: 2
* linux64: 2
* windows7-32-nightly: 1
* windows7-32-devedition: 1
* macosx64-nightly: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414124&startday=2017-11-13&endday=2017-11-19&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 822 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414124&startday=2018-03-20&endday=2018-03-26&tree=trunk

Comment 15

[Intermittent Failures Robot]

1 failures in 782 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414124&startday=2018-04-16&endday=2018-04-22&tree=trunk

Comment 16

[Intermittent Failures Robot]

1 failures in 718 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1414124&startday=2018-06-25&endday=2018-07-01&tree=trunk