Upstream kernel installation failure with op-test on RHEL 9.6

[vpuliyal]

I ran the latest op-test on my RHEL 9.6 upstream LPAR, and I am unable to install the latest upstream kernel due to the following error:

Command 'cat /etc/os-release' exited with '-1'

Although the command returns valid output identifying the OS as RHEL 9.6, op-test treats it as a failure and aborts the kernel installation.

Error Output :

Traceback (most recent call last):
  File "/var/lib/jenkins/workspace/LTC/op-test/testcases/InstallUpstreamKernel.py", line 57, in setUp
    self.host_distro_name = self.util.distro_name()
  File "/var/lib/jenkins/workspace/LTC/op-test/common/OpTestUtil.py", line 2227, in distro_name
    res = host.host_run_command("cat /etc/os-release")
  File "/var/lib/jenkins/workspace/LTC/op-test/common/OpTestHost.py", line 211, in host_run_command
    return self.ssh.run_command(i_cmd, timeout, retry)
  File "/var/lib/jenkins/workspace/LTC/op-test/common/OpTestSSH.py", line 225, in run_command
    return self.util.run_command(self, command, timeout, retry)
  File "/var/lib/jenkins/workspace/LTC/op-test/common/OpTestUtil.py", line 1820, in run_command
    raise cf
  File "/var/lib/jenkins/workspace/LTC/op-test/common/OpTestUtil.py", line 1815, in run_command
    output = self.try_command(term_obj, command, timeout)
  File "/var/lib/jenkins/workspace/LTC/op-test/common/OpTestUtil.py", line 1890, in try_command
    raise CommandFailed(command, res, echo_rc)
common.Exceptions.CommandFailed: Command 'cat /etc/os-release' exited with '-1'.
Output
['\x1b[?2004l', 'NAME="Red Hat Enterprise Linux"', 'VERSION="9.6 (Plow)"', 'ID="rhel"', 'ID_LIKE="fedora"', 'VERSION_ID="9.6"', 'PLATFORM_ID="platform:el9"', 'PRETTY_NAME="Red Hat Enterprise Linux 9.6 (Plow)"', 'ANSI_COLOR="0;31"', 'LOGO="fedora-logo-icon"', 'CPE_NAME="cpe:/o:redhat:enterprise_linux:9::baseos"', 'HOME_URL="https://www.redhat.com/"', 'DOCUMENTATION_URL="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9"', 'BUG_REPORT_URL="https://issues.redhat.com/"', '', 'REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 9"', 'REDHAT_BUGZILLA_PRODUCT_VERSION=9.6', 'REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"', 'REDHAT_SUPPORT_PRODUCT_VERSION="9.6"', '\x1b[?2004h']

Is it a known issue ?

[abdhaleegit]

@vpuliyal Please run these 2 commands from your linux lpar

echo "set enable-bracketed-paste off" > .inputrc
bind 'set enable-bracketed-paste off'

and restart the run again.. this is due to extra console characters ['\x1b[?2004l'

[vpuliyal]

I've modify the op-test/common/OpTestUtil.py so that it not failing.

res = output_list
if echo_rc not in [0, -1]:
    raise CommandFailed(command, res, echo_rc)
return res

 #if echo_rc != 0:
        #    raise CommandFailed(command, res, echo_rc)
        #return res

Meaning

1. echo_rc == 0 → command succeeded

2. echo_rc == -1 → SSH/pexpect could not determine exit code

This happens due to ANSI escape sequences (\x1b[?2004h/l)

[vpuliyal]

@vpuliyal Please run these 2 commands from your linux lpar

echo "set enable-bracketed-paste off" > .inputrc bind 'set enable-bracketed-paste off'

and restart the run again.. this is due to extra console characters ['\x1b[?2004l'

Sure. I will give a try. Thanks

[vpuliyal]

Hi @abdhaleegit

As per your suggestion, I ran the following commands on my LPAR and then restarted op-test. After that, I was able to install the latest upstream kernel successfully:

echo "set enable-bracketed-paste off" > .inputrc
bind 'set enable-bracketed-paste off'

[vpuliyal]

Hi @abdhaleegit ,

In the op-test Jenkins job, I see the following code in the post-processing stage. However, I do not see the postprocess.py script in the op-test repository.

finally {
    stage('Post Process') {
        sh '''#!/bin/bash
            set -x
            /usr/bin/python2.7 /var/lib/jenkins/userContent/korg/scripts/linuxci/lib/postprocess.py \
              --id ${sid} --git ${linux_repo} --branch ${linux_branch} \
              --tests "${tests}" --result PASS
            echo "Post Process"
        '''
    }
}

Could you please let me know where this postprocess.py script is located and how it is maintained?
Is it part of the Jenkins node setup (userContent) or available in a separate repository?

[vpuliyal]

@vrbagalkote Thanks for the link.