Jira server process is unexpectedly terminated in Linux (hardware memory corruption fault on Linux)

お困りですか?

アトラシアン コミュニティをご利用ください。

コミュニティに質問

プラットフォームについて: Server および Data Center のみ。この記事は、Server および Data Center プラットフォームのアトラシアン製品にのみ適用されます。

Support for Server* products ended on February 15th 2024. If you are running a Server product, you can visit the Atlassian Server end of support announcement to review your migration options.

*Fisheye および Crucible は除く

   

要約

The Jira application is being terminated unexpectedly in a Linux environment. When using Jira Data Center, this issue might occur on a specific node only.

環境

Any Jira Server/Data Center version.

診断

  • When checking the Jira application logs <JIRA-HOME>/log/atlassian-jira.log, we can see that the Jira process is being terminated unexpectedly. There is no clean shutdown process, and we see a big time gap in the logs:

    2021-10-26 01:49:54,218+0300 http-nio-8051-exec-154 url:/rest/dev-status/1.0/issue/summary username:XXXXX WARN XXXXX 109x8773607x4 1ycojow XXX.XXX.XX.XX,XX.XXX.XX.XXX /rest/dev-status/1.0/issue/summary [c.a.j.p.devstatus.provider.DefaultCoordinator] fisheye4 (not_configured)
    2021-10-26 03:59:09,185+0300 localhost-startStop-1 INFO      [c.a.jira.startup.JiraHomeStartupCheck] The jira.home directory '/opt/eejira/datacenter/jira.home' is validated and locked for exclusive use by this instance.
    2021-10-26 03:59:09,220+0300 localhost-startStop-1 INFO      [c.a.jira.startup.JiraStartupLogger] 
        
        ****************
        Jira starting...
        ****************
        
    2021-10-26 03:59:09,272+0300 localhost-startStop-1 INFO      [c.a.jira.startup.JiraStartupLogger] 
        
        ___ Environment _____________________________
  • The same gap can be observed in the Tomcat Logs in <JIRA_INSTALL>/logs/catalina.out
  • The following appears in the /var/log/messages, /var/log/syslog, or the systemd kernel journal of the Linux server where the Jira application was terminated:

    Oct 26 01:49:56 esjirp82 systemd: Removed slice User Slice of root.
    Oct 26 01:49:57 esjirp82 kernel: Disabling lock debugging due to kernel taint
    Oct 26 01:49:57 esjirp82 kernel: mce: [Hardware Error]: Machine check events logged
    Oct 26 01:49:57 esjirp82 kernel: mce: Uncorrected hardware memory error in user-access at fef7d0cc0
    Oct 26 01:49:57 esjirp82 kernel: MCE 0xfef7d0: Killing java:51745 due to hardware memory corruption
    Oct 26 01:49:57 esjirp82 kernel: MCE 0xfef7d0: dirty LRU page recovery: Recovered
    Oct 26 01:49:57 esjirp82 kernel: MCE: Killing http-nio-8051-e:22979 due to hardware memory corruption fault at 14935d0000
    Oct 26 01:49:57 esjirp82 kernel: MCE: Killing http-nio-8051-e:22979 due to hardware memory corruption fault at 14935d0000
    Oct 26 01:49:57 esjirp82 kernel: MCE: Killing http-nio-8051-e:22979 due to hardware memory corruption fault at 14935d0000
    Oct 26 01:49:57 esjirp82 kernel: MCE: Killing http-nio-8051-e:22979 due to hardware memory corruption fault at 14935d0000
    Oct 26 01:49:57 esjirp82 kernel: MCE: Killing http-nio-8051-e:22979 due to hardware memory corruption fault at 14935d0000
    Oct 26 01:49:57 esjirp82 kernel: MCE: Killing http-nio-8051-e:22979 due to hardware memory corruption fault at 14935d0000 
    Oct 26 01:49:57 esjirp82 abrt-hook-ccpp: Process 51745 (java) of user 1001 killed by SIGABRT - dumping core

原因

This problem usually occurs when there is a hardware memory issue on the Linux server. As mentioned in this HP support article:

原因

The Linux kernel will kill the application that is using memory that experiences an uncorrected error (UCE)

ソリューション

When encountering an uncorrected hardware error, the Linux kernel reacts in one of two ways

•    UCE in kernel space -> Kernel Panic.
•    UCE in application space -> Application killed by Kernel.


ソリューション

Since this issue is specific to the Linux server outside of the Jira application control, we recommend you to reach out to your Linux OS Administrator and share with them the error found in the /var/log/syslog file.

最終更新日 2021 年 11 月 2 日

この内容はお役に立ちましたか?

はい
いいえ
この記事についてのフィードバックを送信する
Powered by Confluence and Scroll Viewport.