Skip to content

azure-pipelines: add nightly scheduled run for flakiness detection - #607

Closed
sigabrtv1-ui wants to merge 1 commit into
sonic-net:masterfrom
sigabrtv1-ui:feat/scheduled-master-runs
Closed

azure-pipelines: add nightly scheduled run for flakiness detection#607
sigabrtv1-ui wants to merge 1 commit into
sonic-net:masterfrom
sigabrtv1-ui:feat/scheduled-master-runs

azure-pipelines: add nightly scheduled run for flakiness detection

61e8aa2
Select commit
Loading
Failed to load commit list.
Azure Pipelines / sonic-net.sonic-gnmi failed Mar 9, 2026 in 33m 5s

Build #20260306.8 had test failures

Details

Tests

  • Failed: 25 (0.70%)
  • Passed: 3,500 (98.56%)
  • Other: 26 (0.73%)
  • Total: 3,551
Code coverage

  • 1125 of 1250 lines covered (90.00%)

Annotations

Check failure on line 1717 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sonic-net.sonic-gnmi

Build log #L1717

Bash exited with code '2'.

Check failure on line 23 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sonic-net.sonic-gnmi

Build log #L23

There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.

Check failure on line 1 in TestGnsiCertzServer/Rotate_ConcurrentRPC_ReturnsAborted

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sonic-net.sonic-gnmi

TestGnsiCertzServer/Rotate_ConcurrentRPC_ReturnsAborted

Failed
Raw output
=== RUN   TestGnsiCertzServer/Rotate_ConcurrentRPC_ReturnsAborted
    gnsi_certz_test.go:1146: Expected codes.Aborted for concurrent Rotate, got: rpc error: code = DeadlineExceeded desc = context deadline exceeded
    --- FAIL: TestGnsiCertzServer/Rotate_ConcurrentRPC_ReturnsAborted (5.00s)

Check failure on line 1 in TestGnsiCertzServer

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sonic-net.sonic-gnmi

TestGnsiCertzServer

Failed
Raw output
=== RUN   TestGnsiCertzServer
--- FAIL: TestGnsiCertzServer (8.48s)

Check failure on line 1 in TestTranslSubscribe/ONCE

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sonic-net.sonic-gnmi

TestTranslSubscribe/ONCE

Failed
Raw output
=== RUN   TestTranslSubscribe/ONCE
{AclSet: {}}
{Acl:                 {AclSets:    {AclSet: {{Name:"ONE",Type:1}: {AclEntries: nil,
                                                                   Config:     {Description: nil,
                                                                                Name:        "ONE",
                                                                                Type:        1},
                                                                   Name:       "ONE",
                                                                   State:      nil,
                                                                   Type:       1}}},
                       Config:     nil,
                       Interfaces: nil,
                       State:      nil},
 Components:          nil,
 Interfaces:          nil,
 Lldp:                nil,
 Mclag:               nil,
 ModulesState:        nil,
 Sampling:            nil,
 SonicAcl:            nil,
 SonicDeviceMetadata: nil,
 SonicInterface:      nil,
 SonicMacsec:         nil,
 SonicMclag:          nil,
 SonicMgmtPort:       nil,
 SonicMgmtVrf:        nil,
 SonicMirrorSession:  nil,
 SonicPolicer:        nil,
 SonicPort:           nil,
 SonicPortchannel:    nil,
 SonicSflow:          nil,
 SonicVlan:           nil,
 SonicVnet:           nil,
 SonicVrf:            nil,
 SonicVxlan:          nil,
 System:              nil}
{{Name:"ONE",Type:1}: {AclEntries: nil,
                       Config:     {Description: nil,
                                    Name:        "ONE",
                                    Type:        1},
                       Name:       "ONE",
                       State:      nil,
                       Type:       1}}

Check failure on line 1 in TestMain

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sonic-net.sonic-gnmi

TestMain

Failed
Raw output
ERROR: logging before flag.Parse: I0309 17:52:18.826195   22374 db_lock.go:234] ConfigDBClearLock:
ERROR: logging before flag.Parse: W0309 17:52:18.826246   22374 db_redis_opts.go:164] _DBRedisOptsConfig:reconfigure: flags not parsed!
ERROR: logging before flag.Parse: I0309 17:52:18.826261   22374 db_redis_opts.go:174] _DBRedisOptsConfig:reconfigure: Handling signal.
ERROR: logging before flag.Parse: I0309 17:52:18.827473   22374 db_lock.go:134] unlock: Already Unlocked
ERROR: logging before flag.Parse: I0309 17:52:18.827526   22374 db_lock.go:242] ConfigDBClearLock: Lock Absent
ERROR: logging before flag.Parse: I0309 17:52:18.829478   22374 emitjson_select.go:68] Marker file /var/run/gnmi_server.test/use_ygot_emitjson not found (err = stat /var/run/gnmi_server.test/use_ygot_emitjson: no such file or directory). Will use internal EmitJSON
ERROR: logging before flag.Parse: I0309 17:52:19.430910   22374 xlate_utils.go:1384] [transformer.go:92]init.2 Yang model List: [sonic-acl.yang sonic-extensions.yang sonic-interface.yang sonic-mclag.yang sonic-port.yang sonic-portchannel.yang sonic-sflow.yang sonic-show-techsupport.yang sonic-showtech-annot.yang sonic-types.yang sonic-vlan.yang sonic-vrf.yang openconfig-acl-annot.yang openconfig-acl.yang openconfig-if-aggregate.yang openconfig-if-ethernet.yang openconfig-if-ip.yang openconfig-interfaces-annot.yang openconfig-interfaces.yang openconfig-mclag-annot.yang openconfig-mclag.yang openconfig-sampling-sflow-annot.yang openconfig-sampling-sflow.yang openconfig-system-annot.yang openconfig-vlan.yang gnsi-authz.yang gnsi-pathz.yang gnsi-certz.yang gnsi-credentialz.yang]
ERROR: logging before flag.Parse: I0309 17:52:20.041652   22374 xspec.go:150] xspec init done ...
ERROR: logging before flag.Parse: I0309 17:52:20.041745   22374 app_interface.go:117] Registering for path =/openconfig-acl:acl
ERROR: logging before flag.Parse: I0309 17:52:20.041776   22374 app_interface.go:117] Registering for path =/sonic-
ERROR: logging before flag.Parse: I0309 17:52:20.041790   22374 app_interface.go:117] Registering for path =*
ERROR: logging before flag.Parse: I0309 17:52:20.041819   22374 lldp_app.go:62] Init called for LLDP modules module
ERROR: logging before flag.Parse: I0309 17:52:20.041841   22374 app_interface.go:117] Registering for path =/openconfig-lldp:lldp
ERROR: logging before flag.Parse: I0309 17:52:20.041867   22374 pfm_app.go:42] Init called for Platform module
ERROR: logging before flag.Parse: I0309 17:52:20.041891   22374 app_interface.go:117] Registering for path =/openconfig-platform:components
ERROR: logging before flag.Parse: I0309 17:52:20.041937   22374 sys_app.go:54] SysApp: Init called for System module
ERROR: logging before flag.Parse: I0309 17:52:20.041964   22374 app_interface.go:117] Registering for path =/openconfig-system:system
ERROR: logging before flag.Parse: I0309 17:52:20.042747   22374 version.go:144] *** Yang bundle version = 1.0.0
ERROR: logging before flag.Parse: I0309 17:52:20.042809   22374 version.go:145] *** Yang base version   = 1.0.0
ERROR: logging before flag.Parse: I0309 17:52:20.042835   22374 app_interface.go:117] Registering for path =/ietf-yang-library:modules-state
panic: test timed out after 20m0s

goroutine 12845 [running]:
testing.(*M).startAlarm.func1()
	/usr/lib/go-1.19/src/testing/testing.go:2036 +0xbb
created by time.goFunc
	/usr/lib/go-1.19/src/time/sleep.go:176 +0x48

goroutine 1 [chan receive, 5 minutes]:
testing.(*T).Run(0xc000e4f380, {0x1f53b66, 0x13}, 0x1ff2710)
	/usr/lib/go-1.19/src/testing/testing.go:1494 +0x789
testing.runTests.func1(0x0?)
	/usr/lib/go-1.19/src/testing/testing.go:1846 +0x9a
testing.tRunner(0xc000e4f380, 0xc00002dab0)
	/usr/lib/go-1.19/src/testing/testing.go:1446 +0x217
testing.runTests(0xc0001d1b80?, {0x2e0f700, 0x77, 0x77}, {0x4e596b?, 0x0?, 0x2f23d60?})
	/usr/lib/go-1.19/src/testing/testing.go:1844 +0x7ed
testing.(*M).Run(0xc0001d1b80)
	/usr/lib/go-1.19/src/testing/testing.go:1726 +0xa85
github.com/sonic-net/sonic