i have a linux cluster (10 node)..having OSCAR.
now MPI and other communication r using same n/w.
i want to make MPI use different n/w alltogether (diff set of n/w
cards) and other communications (ssh,etc) diff n/w. so that
communication gets faster.
i dunno feasibilty of this project ??
This can easily be done if you give all your machines in your cluster
two different IP addresses for the two physical networks. (I presume you
_have_ two physical LANs for your cluster, right?)
Once you have two disjoint subnets for the two sets of IP addresses of
your cluster, you can set up routing tables such that any communication
attempted to Addr1 of host A will go over one physical network, and any
communication to Addr2 of the same host A will go over the other network.
This can be trivially done, so feasibily appears certain. As far as
the individual nodes on the cluster are concerned, they'll treat two
different IP addresses for host A as two different computers; only you
will know they both lead to the same place.
But do you have an application which saturates modern 100MHz Ethernet?
The NSE PRISM system works in real-time handling complex work in one of
the world's five largest exchanges (the NSE:)) in terms of number of
trades, and we don't saturate it. PRISM uses MPI.
Shuvam "built the PRISM MPI-based app for NSE" Misra :)