服务器内核启动后出现恐慌,不知道该怎么做日志

我们刚刚收到一台全新的双CPU服务器,在启动后不久发生内核崩溃,甚至在操作系统设置空闲时发生。 我能够安装操作系统,并启用mcelog来尝试和了解发生了什么,虽然我不知道如何使输出。 在线阅读让我觉得这可能是其中一个套接字(1)上有缺陷的DIMM,但我跑了几遍memtest,发现没有错误。 有没有可能这是一个软件问题呢? 我已经尝试了2个操作系统,两者都发生了相同的事情,尽pipe在Debian / Proxmox中发生的事情比CentOS更常见。

服务器规格:

双Intel 8核Xeon E5-2620v4

2个DIMM 32GB DDR4 2400MHz RECC DDR4

MB SuperMicro X10DRL-i

这不是CPU散热问题,因为在memtest或操作系统安装过程中,这些温度从未超过35ºC。 在CPU崩溃之前,我也能够在CPU上运行一些短裤基准,而且临时工也没问题。

我怎么知道这里发生了什么? 我可以访问服务器几分钟才发生,我已经下载了vmcore转储,但我不知道如何处理它。

这是引导后50秒,然后坠毁mce日志:

[ 56.367615] mce: [Hardware Error]: Machine check events logged [ 70.420914] mce: [Hardware Error]: Machine check events logged [ 71.886789] Disabling lock debugging due to kernel taint [ 71.886894] mce: [Hardware Error]: CPU 24: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.887009] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.887122] mce: [Hardware Error]: TSC 206cc7cd362 [ 71.887184] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 11 microcode b00001d [ 71.887289] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.889392] mce: [Hardware Error]: CPU 30: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.889489] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.889595] mce: [Hardware Error]: TSC 206cc7cd11d [ 71.889657] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 1d microcode b00001d [ 71.889760] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.891804] mce: [Hardware Error]: CPU 14: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.891901] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.892007] mce: [Hardware Error]: TSC 206cc7cd10e [ 71.892068] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 1c microcode b00001d [ 71.892171] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.894217] mce: [Hardware Error]: CPU 13: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.894314] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.894420] mce: [Hardware Error]: TSC 206cc7cd23c [ 71.894480] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 1a microcode b00001d [ 71.894585] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.896634] mce: [Hardware Error]: CPU 29: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.896730] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.896835] mce: [Hardware Error]: TSC 206cc7cd194 [ 71.896896] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 1b microcode b00001d [ 71.897000] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.899053] mce: [Hardware Error]: CPU 28: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.899150] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.899256] mce: [Hardware Error]: TSC 206cc7cd719 [ 71.899335] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 19 microcode b00001d [ 71.899438] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.901485] mce: [Hardware Error]: CPU 12: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.901582] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.901687] mce: [Hardware Error]: TSC 206cc7cd720 [ 71.901748] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 18 microcode b00001d [ 71.901851] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.903934] mce: [Hardware Error]: CPU 10: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.904031] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.904136] mce: [Hardware Error]: TSC 206cc7cd851 [ 71.904197] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 14 microcode b00001d [ 71.904300] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.906306] mce: [Hardware Error]: CPU 26: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.906403] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.906508] mce: [Hardware Error]: TSC 206cc7cd863 [ 71.906569] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 15 microcode b00001d [ 71.909482] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.914367] mce: [Hardware Error]: CPU 11: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.917304] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.920287] mce: [Hardware Error]: TSC 206cc7cd515 [ 71.923159] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 16 microcode b00001d [ 71.926031] mce: [Hardware Error]: Run the above through 'mcelog --ascii' [ 71.930820] mce: [Hardware Error]: CPU 27: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.933685] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.936557] mce: [Hardware Error]: TSC 206cc7cd449 [ 71.939384] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 17 microcode b00001d [ 71.944180] mce: [Hardware Error]: CPU 9: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.947059] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.949956] mce: [Hardware Error]: TSC 206cc7cd766 [ 71.952786] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 12 microcode b00001d [ 71.957580] mce: [Hardware Error]: CPU 25: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.960480] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.963366] mce: [Hardware Error]: TSC 206cc7cd751 [ 71.966210] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 13 microcode b00001d [ 71.971031] mce: [Hardware Error]: CPU 31: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.973919] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.976817] mce: [Hardware Error]: TSC 206cc7cd7f7 [ 71.979690] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 1f microcode b00001d [ 71.984474] mce: [Hardware Error]: CPU 15: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 71.987371] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 71.990290] mce: [Hardware Error]: TSC 206cc7cd803 [ 71.993151] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 1e microcode b00001d [ 71.997992] mce: [Hardware Error]: CPU 8: Machine Check Exception: 5 Bank 20: fa00004000020e0f [ 72.000918] mce: [Hardware Error]: RIP !INEXACT! 10:<ffffffff8138fb97> {intel_idle+0xd7/0x160} [ 72.003828] mce: [Hardware Error]: TSC 206cc7cd374 [ 72.006692] mce: [Hardware Error]: PROCESSOR 0:406f1 TIME 1487438906 SOCKET 1 APIC 10 microcode b00001d [ 72.011533] mce: [Hardware Error]: Machine check: Processor context corrupt [ 72.014436] Kernel panic - not syncing: Fatal machine check