#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
Issue created automatically to collect these failures.
Example (log):
--- FAIL: TestNeedmDeadlock (5.11s)
testenv.go:459: [/data/golang/workdir/tmp/go-build4218498514/testprogcgo.exe NeedmDeadlock] exit status: exit status 1
crash_cgo_test.go:714: want OK
, got Hung for 5 seconds
Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2022-10-20 22:16 linux-s390x-ibm go@4725c71b runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (5.11s) testenv.go:459: [/data/golang/workdir/tmp/go-build4218498514/testprogcgo.exe NeedmDeadlock] exit status: exit status 1 crash_cgo_test.go:714: want OK , got Hung for 5 secondsComment From: mknyszek
In triage I think we want to see more failures. For context, needm is used on the C -> Go call path to get an m for the C thread. Seems like it might be similar to #43625?
If it happens again on s390x I'll loop in the s390x folks.
Comment From: mknyszek
This continues to be the only failure in recent memory. At the end of the cycle we should put this into the backlog if we don't see any more issues.
Comment From: cherrymui
Seems no new failure for quite a while. Move to backlog.
Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-01-09 20:25 openbsd-amd64-71 go@0bbd67e5 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (1.20s) exec.go:146: test timed out while running command: /tmp/workdir/tmp/go-build2241571717/testprogcgo.exe NeedmDeadlock crash_test.go:58: /tmp/workdir/tmp/go-build2241571717/testprogcgo.exe NeedmDeadlock: signal: quit crash_cgo_test.go:714: want OK , gotComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-01-26 07:17 darwin-amd64-10_15 go@cea70301 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.01s) crash_test.go:58: /tmp/buildlet/tmp/go-build4119296738/testprogcgo.exe NeedmDeadlock: signal: segmentation fault crash_cgo_test.go:716: want OK , got2023-01-26 07:17 darwin-amd64-11_0 go@cea70301 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.01s) crash_test.go:58: /tmp/buildlet/tmp/go-build2556092564/testprogcgo.exe NeedmDeadlock: signal: segmentation fault crash_cgo_test.go:716: want OK , got2023-01-26 10:15 darwin-amd64-10_15 go@4df10fba runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.01s) crash_test.go:58: /tmp/buildlet/tmp/go-build1310876794/testprogcgo.exe NeedmDeadlock: signal: segmentation fault crash_cgo_test.go:716: want OK , got2023-01-26 10:15 darwin-amd64-11_0 go@4df10fba runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.02s) crash_test.go:58: /tmp/buildlet/tmp/go-build4292740019/testprogcgo.exe NeedmDeadlock: signal: segmentation fault crash_cgo_test.go:716: want OK , gotComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-02-28 01:46 linux-s390x-ibm go@aaace6dd runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (5.48s) crash_test.go:58: /data/golang/workdir/tmp/go-build1781243837/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:716: want OK , got Hung for 5 secondsComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-03-24 16:00 netbsd-arm-bsiegert go@ef0dedce runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.08s) crash_cgo_test.go:716: /var/gobuilder/buildlet/tmp/go-build3741504798/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:719: want OK , got signal 11 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x174cb5, 0x20}) /var/gobuilder/buildlet/go/src/runtime/panic.go:1076 +0x4c fp=0x43cc90 sp=0x43cc7c pc=0x4f6ac runtime.noSignalStack(0xb) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:1032 +0x68 fp=0x43cc9c sp=0x43cc90 pc=0x69b5c runtime.adjustSignalStack(0xb, 0x42e000, 0x43cce4) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:590 +0x254 fp=0x43cccc sp=0x43cc9c pc=0x68b24 runtime.sigtrampgo(0xb, 0x43cd38, 0x43cdb8) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:480 +0xc4 fp=0x43cd04 sp=0x43cccc pc=0x6870c runtime.sigtramp() /var/gobuilder/buildlet/go/src/runtime/sys_netbsd_arm.s:306 +0x2c fp=0x43cd18 sp=0x43cd04 pc=0x88d1cComment From: cherrymui
The failure on 2023-03-24 is due to CL 392854 and is fixed with CL 479255.
Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-03-24 18:14 netbsd-arm-bsiegert go@2716dfd9 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.02s) crash_cgo_test.go:716: /var/gobuilder/buildlet/tmp/go-build1118342320/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:719: want OK , got panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x0]Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-03-24 17:48 netbsd-arm-bsiegert go@59d7c693 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.09s) crash_cgo_test.go:716: /var/gobuilder/buildlet/tmp/go-build632147128/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:719: want OK , got signal 11 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x174cb5, 0x20}) /var/gobuilder/buildlet/go/src/runtime/panic.go:1076 +0x4c fp=0x43cc90 sp=0x43cc7c pc=0x4f6ac runtime.noSignalStack(0xb) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:1032 +0x68 fp=0x43cc9c sp=0x43cc90 pc=0x69b5c runtime.adjustSignalStack(0xb, 0x42e000, 0x43cce4) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:590 +0x254 fp=0x43cccc sp=0x43cc9c pc=0x68b24 runtime.sigtrampgo(0xb, 0x43cd38, 0x43cdb8) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:480 +0xc4 fp=0x43cd04 sp=0x43cccc pc=0x6870c runtime.sigtramp() /var/gobuilder/buildlet/go/src/runtime/sys_netbsd_arm.s:306 +0x2c fp=0x43cd18 sp=0x43cd04 pc=0x88d1cComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-03-31 19:15 linux-arm-aws go@99276aeb runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.01s) crash_cgo_test.go:722: /workdir/tmp/go-build590000508/testprogcgo.exe NeedmDeadlock: signal: segmentation fault (core dumped) crash_cgo_test.go:725: want OK , gotComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-03-31 19:15 netbsd-arm-bsiegert go@99276aeb runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.07s) crash_cgo_test.go:722: /var/gobuilder/buildlet/tmp/go-build646227022/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:725: want OK , got signal 11 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x176019, 0x20}) /var/gobuilder/buildlet/go/src/runtime/panic.go:1076 +0x4c fp=0x43cc90 sp=0x43cc7c pc=0x4f6e0 runtime.noSignalStack(0xb) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:1036 +0x68 fp=0x43cc9c sp=0x43cc90 pc=0x69b6c runtime.adjustSignalStack(0xb, 0x42e000, 0x43cce4) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:590 +0x254 fp=0x43cccc sp=0x43cc9c pc=0x68b28 runtime.sigtrampgo(0xb, 0x43cd38, 0x43cdb8) /var/gobuilder/buildlet/go/src/runtime/signal_unix.go:480 +0xc4 fp=0x43cd04 sp=0x43cccc pc=0x68710 runtime.sigtramp() /var/gobuilder/buildlet/go/src/runtime/sys_netbsd_arm.s:306 +0x2c fp=0x43cd18 sp=0x43cd04 pc=0x8934cComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-05-31 19:15 linux-s390x-ibm go@3cea9e68 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (5.05s) crash_cgo_test.go:745: /data/golang/workdir/tmp/go-build1347411103/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:748: want OK , got Hung for 5 secondsComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-08-22 19:18 linux-s390x-ibm-race go@3e73802c runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (5.77s) crash_cgo_test.go:749: /data/golang/workdir/tmp/go-build111191324/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:752: want OK , got Hung for 5 seconds panic: test timed out after 6m0s running tests: TestGoroutineParallelism2 (2m44s) goroutine 23830 [running]: ... goroutine 23842 [running]: goroutine running on other thread; stack unavailable created by runtime_test.testGoroutineParallelism2.func2 in goroutine 23791 /data/golang/workdir/go/src/runtime/proc_test.go:213 +0x92 goroutine 23793 [running]: goroutine running on other thread; stack unavailable created by runtime_test.testGoroutineParallelism2.func2 in goroutine 23791 /data/golang/workdir/go/src/runtime/proc_test.go:213 +0x92Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-09-12 17:08 netbsd-arm-bsiegert go@4f9fe6d5 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.00s) crash_cgo_test.go:749: building testprogcgo []: exit status 1 # runtime/testdata/testprogcgo In file included from /usr/include/ucontext.h:36:0, from stackswitch.c:16: /usr/include/sys/ucontext.h:44:2: error: unknown type name 'stack_t' stack_t uc_stack; /* the stack used by this context */ ^~~~~~~ stackswitch.c: In function 'stackSwitchThread': stackswitch.c:68:22: error: request for member 'ss_sp' in something not a structure or union uctx_switch.uc_stack.ss_sp = stack1; ^ stackswitch.c:69:22: error: request for member 'ss_size' in something not a structure or union uctx_switch.uc_stack.ss_size = STACK_SIZE; ^ stackswitch.c:82:22: error: request for member 'ss_sp' in something not a structure or union uctx_switch.uc_stack.ss_sp = stack2; ^ stackswitch.c:83:22: error: request for member 'ss_size' in something not a structure or union uctx_switch.uc_stack.ss_size = STACK_SIZE; ^2023-09-12 18:14 netbsd-arm-bsiegert go@5cc1e99f runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.00s) crash_cgo_test.go:749: building testprogcgo []: exit status 1 # runtime/testdata/testprogcgo In file included from /usr/include/ucontext.h:36:0, from stackswitch.c:16: /usr/include/sys/ucontext.h:44:2: error: unknown type name 'stack_t' stack_t uc_stack; /* the stack used by this context */ ^~~~~~~ stackswitch.c: In function 'stackSwitchThread': stackswitch.c:68:22: error: request for member 'ss_sp' in something not a structure or union uctx_switch.uc_stack.ss_sp = stack1; ^ stackswitch.c:69:22: error: request for member 'ss_size' in something not a structure or union uctx_switch.uc_stack.ss_size = STACK_SIZE; ^ stackswitch.c:82:22: error: request for member 'ss_sp' in something not a structure or union uctx_switch.uc_stack.ss_sp = stack2; ^ stackswitch.c:83:22: error: request for member 'ss_size' in something not a structure or union uctx_switch.uc_stack.ss_size = STACK_SIZE; ^Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2023-09-12 17:47 netbsd-arm-bsiegert go@9f5a2cf6 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.00s) crash_cgo_test.go:749: building testprogcgo []: exit status 1 # runtime/testdata/testprogcgo In file included from /usr/include/ucontext.h:36:0, from stackswitch.c:16: /usr/include/sys/ucontext.h:44:2: error: unknown type name 'stack_t' stack_t uc_stack; /* the stack used by this context */ ^~~~~~~ stackswitch.c: In function 'stackSwitchThread': stackswitch.c:68:22: error: request for member 'ss_sp' in something not a structure or union uctx_switch.uc_stack.ss_sp = stack1; ^ stackswitch.c:69:22: error: request for member 'ss_size' in something not a structure or union uctx_switch.uc_stack.ss_size = STACK_SIZE; ^ stackswitch.c:82:22: error: request for member 'ss_sp' in something not a structure or union uctx_switch.uc_stack.ss_sp = stack2; ^ stackswitch.c:83:22: error: request for member 'ss_size' in something not a structure or union uctx_switch.uc_stack.ss_size = STACK_SIZE; ^Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2024-01-10 17:35 netbsd-arm-bsiegert go@e9b3ff15 runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.14s) crash_cgo_test.go:750: /scratch/gobuilder/buildlet/tmp/go-build2263110711/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:753: want OK , got signal 20 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x18e5c1, 0x20}) /scratch/gobuilder/buildlet/go/src/runtime/panic.go:1023 +0x4c fp=0x444c8c sp=0x444c78 pc=0x53f54 runtime.noSignalStack(0x14) ... runtime.gopark(0x193ea4, 0x490000, 0x13, 0xe, 0x1) /scratch/gobuilder/buildlet/go/src/runtime/proc.go:402 +0x104 fp=0x4307a4 sp=0x430790 pc=0x57430 time.Sleep(0x12a05f200) /scratch/gobuilder/buildlet/go/src/runtime/time.go:195 +0x158 fp=0x4307c0 sp=0x4307a4 pc=0x8fb0c main.NeedmDeadlock.func1() /scratch/gobuilder/buildlet/go/src/runtime/testdata/testprogcgo/needmdeadlock.go:89 +0x24 fp=0x4307ec sp=0x4307c0 pc=0x150c54 runtime.goexit({}) /scratch/gobuilder/buildlet/go/src/runtime/asm_arm.s:859 +0x4 fp=0x4307ec sp=0x4307ec pc=0x91d44 created by main.NeedmDeadlock in goroutine 1 /scratch/gobuilder/buildlet/go/src/runtime/testdata/testprogcgo/needmdeadlock.go:88 +0x1cComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2024-02-17 06:03 netbsd-arm-bsiegert go@86a32d6d runtime.TestNeedmDeadlock (log)
--- FAIL: TestNeedmDeadlock (0.13s) crash_cgo_test.go:750: /scratch/gobuilder/buildlet/tmp/go-build1471636622/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:753: want OK , got signal 20 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x18e14c, 0x20}) /scratch/gobuilder/buildlet/go/src/runtime/panic.go:1021 +0x4c fp=0x444c24 sp=0x444c10 pc=0x539ec runtime.noSignalStack(0x14) ... runtime.gopark(0x193a30, 0x580000, 0x13, 0xe, 0x1) /scratch/gobuilder/buildlet/go/src/runtime/proc.go:402 +0x104 fp=0x4307a4 sp=0x430790 pc=0x56ec0 time.Sleep(0x12a05f200) /scratch/gobuilder/buildlet/go/src/runtime/time.go:195 +0x158 fp=0x4307c0 sp=0x4307a4 pc=0x8f8ec main.NeedmDeadlock.func1() /scratch/gobuilder/buildlet/go/src/runtime/testdata/testprogcgo/needmdeadlock.go:89 +0x24 fp=0x4307ec sp=0x4307c0 pc=0x150920 runtime.goexit({}) /scratch/gobuilder/buildlet/go/src/runtime/asm_arm.s:859 +0x4 fp=0x4307ec sp=0x4307ec pc=0x91b24 created by main.NeedmDeadlock in goroutine 1 /scratch/gobuilder/buildlet/go/src/runtime/testdata/testprogcgo/needmdeadlock.go:88 +0x1cComment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2024-11-11 20:08 gotip-netbsd-arm go@6051da46 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:745: /home/swarming/.swarming/w/ir/x/t/go-build4289271618/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:748: want OK , got signal 20 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x19b6d1, 0x20}) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1084 +0x34 fp=0x44ac9c sp=0x44ac88 pc=0x8a9d0 runtime.noSignalStack(...) ... time.Sleep(0x12a05f200) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/time.go:300 +0x130 fp=0x43b7c0 sp=0x43b7a8 pc=0x8de38 main.NeedmDeadlock.func1() /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/testdata/testprogcgo/needmdeadlock.go:89 +0x24 fp=0x43b7ec sp=0x43b7c0 pc=0x1594b0 runtime.goexit({}) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm.s:884 +0x4 fp=0x43b7ec sp=0x43b7ec pc=0x90c70 created by main.NeedmDeadlock in goroutine 1 /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/testdata/testprogcgo/needmdeadlock.go:88 +0x1c --- FAIL: TestNeedmDeadlock (0.09s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2024-12-09 18:41 gotip-netbsd-arm go@6705ac68 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:745: /home/swarming/.swarming/w/ir/x/t/go-build1513781350/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:748: want OK , got signal 20 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x1a229d, 0x20}) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1099 +0x34 fp=0x44abfc sp=0x44abe8 pc=0x8c0e0 runtime.noSignalStack(...) ... time.Sleep(0x12a05f200) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/time.go:338 +0x1f4 fp=0x43b7c0 sp=0x43b78c pc=0x8f78c main.NeedmDeadlock.func1() /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/testdata/testprogcgo/needmdeadlock.go:89 +0x24 fp=0x43b7ec sp=0x43b7c0 pc=0x15dd58 runtime.goexit({}) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm.s:884 +0x4 fp=0x43b7ec sp=0x43b7ec pc=0x92620 created by main.NeedmDeadlock in goroutine 1 /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/testdata/testprogcgo/needmdeadlock.go:88 +0x1c --- FAIL: TestNeedmDeadlock (0.04s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-04-03 15:45 gotip-netbsd-arm64 go@9326d9d0 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:763: /home/swarming/.swarming/w/ir/x/t/go-build3773235150/testprogcgo.exe NeedmDeadlock: exit status 2 crash_cgo_test.go:766: want OK , got signal 20 received on thread with no signal stack fatal error: non-Go code disabled sigaltstack runtime stack: runtime.throw({0x20028a210?, 0x0?}) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:1089 +0x34 fp=0x4000066800 sp=0x40000667d0 pc=0x200174674 runtime.noSignalStack(...) ... time.Sleep(0x12a05f200) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/time.go:349 +0x150 fp=0x4000054f80 sp=0x4000054f20 pc=0x200177e10 main.NeedmDeadlock.func1() /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/testdata/testprogcgo/needmdeadlock.go:89 +0x28 fp=0x4000054fd0 sp=0x4000054f80 pc=0x20022e038 runtime.goexit({}) /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/asm_arm64.s:1266 +0x4 fp=0x4000054fd0 sp=0x4000054fd0 pc=0x20017be14 created by main.NeedmDeadlock in goroutine 1 /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/testdata/testprogcgo/needmdeadlock.go:88 +0x24 --- FAIL: TestNeedmDeadlock (0.06s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-16 17:05 gotip-linux-arm64-asan-clang15 go@ea00461b runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build1531540011/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (6.32s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-16 22:48 gotip-linux-arm64-asan-clang15 go@d0582546 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build1378831152/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (7.33s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-18 18:34 gotip-linux-arm64-asan-clang15 go@4c756729 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build831742992/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (6.54s)2025-06-18 19:30 gotip-linux-arm64-asan-clang15 go@8552bcf7 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build243174585/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (10.69s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-20 18:09 gotip-linux-arm64-asan-clang15 go@8ed23a29 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build1132438588/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (9.23s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-20 19:29 gotip-linux-arm64-asan-clang15 go@49cdf0c4 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build2186917506/testprogcgo.exe NeedmDeadlock (8.048595896s): ok crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (8.05s)2025-06-23 15:16 gotip-linux-arm64-asan-clang15 go@1cf6386b runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3646251105/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (13.36s)2025-06-23 19:03 gotip-linux-arm64-asan-clang15 go@456a90aa runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build2249002099/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (12.86s)2025-06-23 22:35 gotip-linux-arm64-asan-clang15 go@4506796a runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build1894662063/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (9.55s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-23 23:36 gotip-linux-arm64-asan-clang15 go@f77a0aa6 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3261599058/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (10.42s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-24 01:27 gotip-linux-arm64-asan-clang15 go@ed781572 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build392715999/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (7.22s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-24 16:40 gotip-linux-arm64-asan-clang15 go@62deaf4f runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3312847020/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (10.97s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-24 17:18 gotip-linux-arm64-asan-clang15 go@fcb98508 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3558402448/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (7.62s)2025-06-24 17:32 gotip-linux-arm64-asan-clang15 go@6e618cd4 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3332024176/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (13.42s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-24 20:33 gotip-linux-arm64-asan-clang15 go@47b941f4 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3744889238/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (9.71s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-25 15:55 gotip-linux-arm64-asan-clang15 go@f069a829 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build2430421565/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (8.36s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-25 20:56 gotip-linux-arm64-asan-clang15 go@0b4d2eab runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build89525581/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (6.21s)2025-06-25 20:56 gotip-linux-arm64-asan-clang15 go@b5d55599 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build2816835055/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (6.90s)2025-06-26 17:24 gotip-linux-arm64-asan-clang15 go@988a20c8 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build2910246840/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (10.56s)Comment From: dmitshur
This test has started to fail very often on the gotip-linux-arm64-asan-clang15 linux specifically recently. As visible in its history, it was consistently passing recently:
linux/arm64 is a first class port and this looks like a recent occurrence, so adding release-blocker for now. Though it only happens on the asan builder, not other linux/arm64 ones.
Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-27 15:23 gotip-linux-arm64-asan-clang15 go@fdc076ce runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build606505419/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (9.26s)2025-06-27 17:59 gotip-linux-arm64-asan-clang15 go@742fda95 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build1735106544/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (7.48s)2025-06-27 20:38 gotip-linux-arm64-asan-clang15 go@2a22aefa runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build3002051089/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (5.20s)2025-06-27 20:56 gotip-linux-arm64-asan-clang15 go@e81c6246 runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build2752089549/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (6.72s)Comment From: cherrymui
I fetched the test timing data for this test on the gotip-linux-arm64-asan-clang15 builder, plotted as below
There are clearly two transitions
...
bd299852,2025-05-19 17:20:17 +0000 UTC,PASS,0.02,
a74ae952,2025-05-19 17:38:56 +0000 UTC,PASS,0.02,
5afada03,2025-05-19 17:54:45 +0000 UTC,PASS,0.01,
2c929d6f,2025-05-19 18:00:01 +0000 UTC,PASS,3, <---
bc5aa2f7,2025-05-19 18:00:10 +0000 UTC,PASS,2.94,
11c86ddc,2025-05-19 18:20:58 +0000 UTC,PASS,2.84,
...
683810a3,2025-06-13 16:04:49 +0000 UTC,PASS,2.82,
64490589,2025-06-13 16:06:39 +0000 UTC,PASS,2.84,
96a6e147,2025-06-13 16:09:17 +0000 UTC,PASS,2.9,
ea00461b,2025-06-16 17:05:39 +0000 UTC,FAIL,,6.32 <---
816199e4,2025-06-16 22:16:29 +0000 UTC,PASS,4.26,
3254c2bb,2025-06-16 22:21:48 +0000 UTC,PASS,5.35,
d0582546,2025-06-16 22:48:19 +0000 UTC,FAIL,,7.33
...
The first one is at 2c929d6f, "runtime: pass through -asan/-msan/-race to testprog tests". For the ASAN builder, it now runs the test with ASAN, so an increase in time is expected.
The second one is at ea00461b, "internal/trace: make Value follow reflect conventions", which doesn't seem related, as the test doesn't seem to have tracing turned on. The previous and next few commits also don't seem related. Maybe a builder configuration change between 2025-06-13 and 2025-06-16?
Either way, at least for the first one, an increase in time seems expected. The test currently has a 5-second timeout, which is sort of arbitrary. It is long enough in regular mode, but not quite so for configurations like ASAN. I think we should just remove the arbitrary timeout, and use the test's deadline. The ASAN builder probably has a longer test deadline. I'll send a CL.
Comment From: gopherbot
Change https://go.dev/cl/684697 mentions this issue: runtime: remove arbitrary 5-second timeout in TestNeedmDeadlock
Comment From: dmitshur
The only potentially relevant recent builder change I can think of is crrev.com/c/6641842 (CC @mknyszek) which rebalanced test sharding strategy for #65814. Its timing matches. Perhaps this particular test was grouped in a favorable way previously, but less so afterwards. In any case, removing the within-test constant timeout sounds like the right next step. Thanks.
Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"
2025-06-27 23:34 gotip-linux-arm64-asan-clang15 go@f1e6ae2f runtime.TestNeedmDeadlock (log)
=== RUN TestNeedmDeadlock crash_cgo_test.go:878: /home/swarming/.swarming/w/ir/x/t/go-build729356144/testprogcgo.exe NeedmDeadlock: exit status 1 crash_cgo_test.go:881: want OK , got OK Hung for 5 seconds --- FAIL: TestNeedmDeadlock (13.48s)Comment From: gopherbot
Found new dashboard test flakes for:
#!watchflakes
post <- pkg == "runtime" && test == "TestNeedmDeadlock"