内核模块将不会加载NFS / RoCE Ubuntu 16.04与最新的驱动程序/软件

在Ubuntu 16.04上使用最新的OFED软件包MellanoxMLNX_OFED_LINUX-3.3-1.0.4.0-ubuntu16.04-x86_64.tgz ), 我在NFS上遇到了麻烦 。 我的卡是Mellanox 10Gbe,并启用了RoCE v1。

使用收件箱驱动程序/软件,但与最新的OFED不无关系

我设法使用Inbox驱动程序/软件(附带在Ubuntu 16.04中)跟随本站点上的文档,使NFS与RoCE协同工作。 我有一些小问题,我知道Ubuntu的东西是相当过时的,所以我想安装最新的OFED / mlx4驱动程序,等等…根据build议mellanox.com。 所以我做到了。 一切按计划进行。 IPfunction都在那里,RDMA工具/testing都可以工作。 一切似乎都很好。 除了一件事。

svcrdma和xprtrdma模块将不会加载。 所以没有RDMA对我的NFS支持。 我得到以下错误。 如果我只从Mellanox站点安装最新的mlx4驱动程序,并将剩下的软件包单独安装,我也会得到同样的错误。

我有一种感觉,可以通过重新编译内核模块等方式来解决这个问题,但是现在已经过去了。 或者,也许我只是搞砸了(交叉手指)? 谁能帮忙?

有人在这篇Mellanox社区文章中评论说 ,他们与Ubuntu 14.04相同的问题 : https : //community.mellanox.com/docs/DOC-2132根据一篇文章,CentOS 7应该可以正常工作。有什么区别?

我想要的最终结果是在NFS上使用最新的驱动程序和软件(最好)在Ubuntu 16.04上使用NFS。 如果不是最新的OFED包,至less是最新的mlx4驱动。 我读了一些地方,更新的内核版本将更新驱动程序和RDMA代码(我忘了我读的大部分)。 如果这不起作用,我的答案可能是等待一个更新的Ubuntu发行版。

谢谢

加载模块时出现错误消息

NFS服务器:

 # modprobe svcrdma modprobe: ERROR: could not insert 'rpcrdma': Invalid argument 

dmesg错误:

 [105699.696980] rpcrdma: Unknown symbol rdma_event_msg (err 0) [105699.697056] rpcrdma: disagrees about version of symbol ib_create_cq [105699.697059] rpcrdma: Unknown symbol ib_create_cq (err -22) [105699.697069] rpcrdma: disagrees about version of symbol rdma_resolve_addr [105699.697071] rpcrdma: Unknown symbol rdma_resolve_addr (err -22) [105699.697183] rpcrdma: Unknown symbol ib_event_msg (err 0) [105699.697213] rpcrdma: disagrees about version of symbol ib_dereg_mr [105699.697215] rpcrdma: Unknown symbol ib_dereg_mr (err -22) [105699.697224] rpcrdma: disagrees about version of symbol ib_query_qp [105699.697226] rpcrdma: Unknown symbol ib_query_qp (err -22) [105699.697236] rpcrdma: disagrees about version of symbol rdma_disconnect [105699.697238] rpcrdma: Unknown symbol rdma_disconnect (err -22) [105699.697245] rpcrdma: disagrees about version of symbol ib_alloc_fmr [105699.697247] rpcrdma: Unknown symbol ib_alloc_fmr (err -22) [105699.697294] rpcrdma: disagrees about version of symbol ib_dealloc_fmr [105699.697295] rpcrdma: Unknown symbol ib_dealloc_fmr (err -22) [105699.697301] rpcrdma: disagrees about version of symbol rdma_resolve_route [105699.697303] rpcrdma: Unknown symbol rdma_resolve_route (err -22) [105699.697398] rpcrdma: disagrees about version of symbol rdma_bind_addr [105699.697400] rpcrdma: Unknown symbol rdma_bind_addr (err -22) [105699.697441] rpcrdma: disagrees about version of symbol rdma_create_qp [105699.697443] rpcrdma: Unknown symbol rdma_create_qp (err -22) [105699.697479] rpcrdma: Unknown symbol ib_map_mr_sg (err 0) [105699.697487] rpcrdma: disagrees about version of symbol ib_destroy_cq [105699.697489] rpcrdma: Unknown symbol ib_destroy_cq (err -22) [105699.697494] rpcrdma: disagrees about version of symbol rdma_create_id [105699.697496] rpcrdma: Unknown symbol rdma_create_id (err -22) [105699.697582] rpcrdma: disagrees about version of symbol rdma_listen [105699.697584] rpcrdma: Unknown symbol rdma_listen (err -22) [105699.697587] rpcrdma: disagrees about version of symbol rdma_destroy_qp [105699.697589] rpcrdma: Unknown symbol rdma_destroy_qp (err -22) [105699.697597] rpcrdma: disagrees about version of symbol ib_query_device [105699.697599] rpcrdma: Unknown symbol ib_query_device (err -22) [105699.697606] rpcrdma: disagrees about version of symbol ib_get_dma_mr [105699.697607] rpcrdma: Unknown symbol ib_get_dma_mr (err -22) [105699.697617] rpcrdma: disagrees about version of symbol ib_alloc_pd [105699.697618] rpcrdma: Unknown symbol ib_alloc_pd (err -22) [105699.697673] rpcrdma: Unknown symbol ib_alloc_mr (err 0) [105699.697734] rpcrdma: disagrees about version of symbol rdma_connect [105699.697736] rpcrdma: Unknown symbol rdma_connect (err -22) [105699.697769] rpcrdma: Unknown symbol ib_wc_status_msg (err 0) [105699.697842] rpcrdma: disagrees about version of symbol rdma_destroy_id [105699.697844] rpcrdma: Unknown symbol rdma_destroy_id (err -22) [105699.697872] rpcrdma: disagrees about version of symbol rdma_accept [105699.697874] rpcrdma: Unknown symbol rdma_accept (err -22) [105699.697882] rpcrdma: disagrees about version of symbol ib_destroy_qp [105699.697883] rpcrdma: Unknown symbol ib_destroy_qp (err -22) [105699.697964] rpcrdma: disagrees about version of symbol ib_dealloc_pd [105699.697965] rpcrdma: Unknown symbol ib_dealloc_pd (err -22) 

NFS客户端:

 # modprobe xprtrdma modprobe: ERROR: could not insert 'rpcrdma': Invalid argument 

dmesg错误:

 [106055.692454] rpcrdma: Unknown symbol rdma_event_msg (err 0) [106055.692480] rpcrdma: disagrees about version of symbol ib_create_cq [106055.692481] rpcrdma: Unknown symbol ib_create_cq (err -22) [106055.692484] rpcrdma: disagrees about version of symbol rdma_resolve_addr [106055.692485] rpcrdma: Unknown symbol rdma_resolve_addr (err -22) [106055.692520] rpcrdma: Unknown symbol ib_event_msg (err 0) [106055.692529] rpcrdma: disagrees about version of symbol ib_dereg_mr [106055.692530] rpcrdma: Unknown symbol ib_dereg_mr (err -22) [106055.692532] rpcrdma: disagrees about version of symbol ib_query_qp [106055.692533] rpcrdma: Unknown symbol ib_query_qp (err -22) [106055.692536] rpcrdma: disagrees about version of symbol rdma_disconnect [106055.692536] rpcrdma: Unknown symbol rdma_disconnect (err -22) [106055.692538] rpcrdma: disagrees about version of symbol ib_alloc_fmr [106055.692539] rpcrdma: Unknown symbol ib_alloc_fmr (err -22) [106055.692552] rpcrdma: disagrees about version of symbol ib_dealloc_fmr [106055.692553] rpcrdma: Unknown symbol ib_dealloc_fmr (err -22) [106055.692554] rpcrdma: disagrees about version of symbol rdma_resolve_route [106055.692555] rpcrdma: Unknown symbol rdma_resolve_route (err -22) [106055.692565] rpcrdma: disagrees about version of symbol rdma_bind_addr [106055.692565] rpcrdma: Unknown symbol rdma_bind_addr (err -22) [106055.692573] rpcrdma: disagrees about version of symbol rdma_create_qp [106055.692574] rpcrdma: Unknown symbol rdma_create_qp (err -22) [106055.692583] rpcrdma: Unknown symbol ib_map_mr_sg (err 0) [106055.692585] rpcrdma: disagrees about version of symbol ib_destroy_cq [106055.692585] rpcrdma: Unknown symbol ib_destroy_cq (err -22) [106055.692587] rpcrdma: disagrees about version of symbol rdma_create_id [106055.692587] rpcrdma: Unknown symbol rdma_create_id (err -22) [106055.692613] rpcrdma: disagrees about version of symbol rdma_listen [106055.692614] rpcrdma: Unknown symbol rdma_listen (err -22) [106055.692615] rpcrdma: disagrees about version of symbol rdma_destroy_qp [106055.692615] rpcrdma: Unknown symbol rdma_destroy_qp (err -22) [106055.692617] rpcrdma: disagrees about version of symbol ib_query_device [106055.692618] rpcrdma: Unknown symbol ib_query_device (err -22) [106055.692619] rpcrdma: disagrees about version of symbol ib_get_dma_mr [106055.692620] rpcrdma: Unknown symbol ib_get_dma_mr (err -22) [106055.692622] rpcrdma: disagrees about version of symbol ib_alloc_pd [106055.692623] rpcrdma: Unknown symbol ib_alloc_pd (err -22) [106055.692638] rpcrdma: Unknown symbol ib_alloc_mr (err 0) [106055.692657] rpcrdma: disagrees about version of symbol rdma_connect [106055.692658] rpcrdma: Unknown symbol rdma_connect (err -22) [106055.692668] rpcrdma: Unknown symbol ib_wc_status_msg (err 0) [106055.692690] rpcrdma: disagrees about version of symbol rdma_destroy_id [106055.692690] rpcrdma: Unknown symbol rdma_destroy_id (err -22) [106055.692698] rpcrdma: disagrees about version of symbol rdma_accept [106055.692699] rpcrdma: Unknown symbol rdma_accept (err -22) [106055.692701] rpcrdma: disagrees about version of symbol ib_destroy_qp [106055.692701] rpcrdma: Unknown symbol ib_destroy_qp (err -22) [106055.692724] rpcrdma: disagrees about version of symbol ib_dealloc_pd [106055.692725] rpcrdma: Unknown symbol ib_dealloc_pd (err -22)