[feature] How to configure fio with standalone gpudirect rdma?

[lvjing421]

I tried to follow gpudirect-rdmaio-client/server.fio or rdmaio-client/server.fio in examples with fio 3.40, but didn't succeed. It would be good to add one example for fio with standalone gpudirect rdma.

[sitsofe]

@lvjing421 I'm not a user of such hardware so I can't offer anything useful but if you have gotten it to work we would be happy to accept patches.

@yufeiren, @sbates130272 as you've touched this ioengine do have any hints?

[sbates130272]

@lvjing421 based on this message in your image (can you send actual text in future as images are hard to work with) it looks like you are not using the correct address to connect the rdma client and server. Did you adjust the hostname and bindname arguments to match your network?

fio: rdma_resolve_addr: -1

[lvjing421]

The script is intended for rdma standalone mode, but based on example for rdma client/server mode. It would be appreciated to share relevant experience.

I have also tried with libcufile-cufile.fio in examples with fio 3.40, where /mnt/nfs is mounted with proto rdma. It could work but not sure if it uses mem=malloc or cudamalloc, and is it just the rdma standalone mode?

[lvjing421]

@lvjing421 based on this message in your image (can you send actual text in future as images are hard to work with) it looks like you are not using the correct address to connect the rdma client and server. Did you adjust the hostname and bindname arguments to match your network?

fio: rdma_resolve_addr: -1

gpudirect-rdmaio-client/server.fio or rdmaio-client/server.fio in fio 3.40 examples does not apply to standalone gpudirect rdma, please refer to #1925.