<div dir="ltr">Hi,<div><br></div><div>I still cannot create the routing table. Here is what I did and the error report:</div><div><br></div><div>1: I do the "empty" run to dump the topology and only get the file: fattree.dot.0, which is in attachment</div><div><br></div><div>2: When I run ./simulate.py -s, I get the following result:</div><div><br></div><div><div>patching file Makefile.am</div><div>patching file scripts/scheduler-sar-interface.py</div><div>Step 1...</div><div>Step 2...</div><div>Step 3...</div><div>Step 4...</div><div>Step 5...</div><div>Step 6...</div><div>sed: can't read /home/peixin/simulation/ofed/bin/ibdiagnet: No such file or directory</div><div>...... skipping omnet install .....</div><div>Step 9...</div></div><div><br></div><div>3. Finally I run ~/simulation/scripts/create_static_lft.sh routing_folder dot_file, and get the following result: </div><div><div>peixin@peixin:~/simulation/scripts$ ~/simulation/scripts/create_static_lft.sh /home/peixin/fattree_simulation/routing_folder fattree</div><div>running createIBNet.py</div><div>Selected configuration:</div><div>  Output:  /home/peixin/fattree_simulation/routing_folder/<a href="http://topo.net">topo.net</a></div><div>  Topology:  DOT</div><div>  Number of endpoints:  8</div><div>  Number of ports per endpoints:  1</div><div>  Number of switches:  4</div><div>  Number of ports per switch:  4</div><div>  Dimensions for Mesh/Torus: -1, -1, -1</div><div>  k-ary-n Tree: -1 -ary- -1</div><div>  Kautz K(b,n): K(-1; -1)</div><div>  XGFT(h,m,w): XGFT(-1; -1; -1)</div><div>  Dragonfly(a,p,h) : Dragonfly(-1, -1, -1) with -1 groups</div><div>  Cascade(a,p,h,g) : Cascade(96, 8, 10) with -1 groups</div><div>  Tofu(d1,d2,d3) : Tofu(-1, -1, -1) with -1 groups</div><div><br></div><div>This program also writes an dot-file to plot the graph with Graphviz.</div><div>Try:</div><div>  dot / neato /home/peixin/fattree_simulation/routing_folder/topo.dot -Tpng -o graph.png && evince graph.png</div><div>running simulate.py</div><div>Run ibsim...</div><div>Run opensm...</div><div>Check routing...</div><div>Scan fabric...</div><div>Stop ibsim/opensm...</div><div>Warning: 13526 already dead</div><div>Warning: 13520 already dead</div><div>Check the connectivity of the system...</div><div>mv: cannot stat ‘/home/peixin/fattree_simulation/routing_folder/ofedout/ibdiagnet.fdbs’: No such file or directory</div><div>running post_process_lfts.py</div><div>ERR: file /home/peixin/fattree_simulation/routing_folder/ibdiagnet.fdbs or /home/peixin/fattree_simulation/routing_folder/opensm-subnet.lst does not exist</div></div><div><br></div><div>Thanks,</div><div>Peixin</div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 13, 2017 at 4:39 PM, Nikhil Jain <span dir="ltr"><<a href="mailto:nikhil.jain@acm.org" target="_blank">nikhil.jain@acm.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">routing_folder and dot_file are keywords/parameters in the config file whose values were chosen by you during the topology dump run. It is described in the second step "<font face="Menlo"><span style="font-size:15px">2- Static Routing”.</span></font><div><span class=""><br><div>
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">---</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Nikhil Jain<br>Postdoctoral Fellow, Lawrence Livermore National Laboratory<br><a href="mailto:nikhil.jain@acm.org" target="_blank">nikhil.jain@acm.org</a>, <a href="http://nikhil-jain.github.io/" target="_blank">http://nikhil-jain.github.io/</a></div></div></div></div>
</div>
<br></span><div><div class="h5"><div><blockquote type="cite"><div>On Mar 13, 2017, at 14:25, Peixin Qiao <<a href="mailto:pqiao@hawk.iit.edu" target="_blank">pqiao@hawk.iit.edu</a>> wrote:</div><br class="m_-5155206689362267728Apple-interchange-newline"><div><div dir="ltr">When I run the third step as <span style="font-size:12.8px">README.fattree.txt</span>:<div><br></div><div><div># 3. Choose a routing algorithm which should be used by OpenSM</div><div># (possible options: updn, dnup, ftree, lash, dor, torus-2QoS, dfsssp, sssp)</div><div># export OSM_ROUTING="ftree" </div><div># ~/simulation/scripts/create_<wbr>static_lft.sh routing_folder dot_file</div><div><br></div><div># (here routing_folder and dot_file should be same as the one used during the run used to dump the topology)</div><div><br></div><div># Now, the routing table stored as LFT files should be in the routing_folder.</div></div><div><br></div><div>So what is the routing_folder and dot_file? Is the following correct?</div><div><br></div><div>routing_folder: mkdir routing_folder</div><div>dot_file: python simulate.py createIBNet -t XGFT -xh 3 -xm 18,18,36 -xw 1,18,18 -sp 36 (get 2 files: net.dot and net.txt)</div><div><br></div><div>Thanks,</div><div>Peixin</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 13, 2017 at 1:52 PM, Nikhil Jain <span dir="ltr"><<a href="mailto:nikhil.jain@acm.org" target="_blank">nikhil.jain@acm.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Did the script die or you killed it? If you killed it, after how long? What size system are you generating routing for?<div><br><div>
<div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">---</div><div style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Nikhil Jain<br>Postdoctoral Fellow, Lawrence Livermore National Laboratory<br><a href="mailto:nikhil.jain@acm.org" target="_blank">nikhil.jain@acm.org</a>, <a href="http://nikhil-jain.github.io/" target="_blank">http://nikhil-jain.github.io/</a></div></div></div></div>
</div>

<br><div><blockquote type="cite"><div><div class="m_-5155206689362267728h5"><div>On Mar 13, 2017, at 10:31, Peixin Qiao <<a href="mailto:pqiao@hawk.iit.edu" target="_blank">pqiao@hawk.iit.edu</a>> wrote:</div><br class="m_-5155206689362267728m_-5694460434703487484Apple-interchange-newline"></div></div><div><div><div class="m_-5155206689362267728h5"><div dir="ltr">Hi CODES,<div><br></div><div>When I run the command in README.fattree.txt, I cannot finish creating static routing table. The third step cannot be finished as follows:</div><div><br></div><div><div>peixin@peixin:~/simulation/scr<wbr>ipts/routing_folder$ ls</div><div>net.dot  net.txt</div><div>peixin@peixin:~/simulation/scr<wbr>ipts/routing_folder$ cd ..</div><div>peixin@peixin:~/simulation/scr<wbr>ipts$ ~/simulation/scripts/create_st<wbr>atic_lft.sh /home/peixin/simulation/script<wbr>s/routing_folder/ net</div><div>dot file already exists.</div><div>running createIBNet.py</div><div>Selected configuration:</div><div>  Output:  /home/peixin/simulation/scrip<wbr>ts/routing_folder/<a href="http://topo.net/" target="_blank">topo.net</a></div><div>  Topology:  XGFT</div><div>  Number of endpoints:  8</div><div>  Number of ports per endpoints:  1</div><div>  Number of switches:  4</div><div>  Number of ports per switch:  36</div><div>  Dimensions for Mesh/Torus: -1, -1, -1</div><div>  k-ary-n Tree: -1 -ary- -1</div><div>  Kautz K(b,n): K(-1; -1)</div><div>  XGFT(h,m,w): XGFT(3; 18,18,36; 1,18,18)</div><div>  Dragonfly(a,p,h) : Dragonfly(-1, -1, -1) with -1 groups</div><div>  Cascade(a,p,h,g) : Cascade(96, 8, 10) with -1 groups</div><div>  Tofu(d1,d2,d3) : Tofu(-1, -1, -1) with -1 groups</div><div><br></div><div>This program also writes an dot-file to plot the graph with Graphviz.</div><div>Try:</div><div>  dot / neato /home/peixin/simulation/script<wbr>s/routing_folder/topo.dot -Tpng -o graph.png && evince graph.png</div><div>running simulate.py</div><div>Run ibsim...</div><div>Run opensm...</div><div>^CTraceback (most recent call last):</div><div>  File "/home/peixin/simulation/scrip<wbr>ts/simulate.py", line 1140, in <module></div><div>    app = runSim(options.network, options.routing, options.pattern)</div><div>  File "/home/peixin/simulation/scrip<wbr>ts/simulate.py", line 826, in __init__</div><div>    time.sleep(60)</div><div>KeyboardInterrupt</div><div>peixin@peixin:~/simulation/scr<wbr>ipts$ cd routing_folder/</div><div>peixin@peixin:~/simulation/scr<wbr>ipts/routing_folder$ ls</div><div>log.txt  net.dot  net.txt  ofedout  rootguids.conf  topo.dot  <a href="http://topo.net/" target="_blank">topo.net</a></div><div>peixin@peixin:~/simulation/scr<wbr>ipts/routing_folder$ </div></div><div><br></div><div><br></div><div><br></div><div>How to create fat-tree static routing table with 36-ports switch?</div><div><br></div><div>Thanks,</div><div>Peixin</div><div><br></div></div></div></div>
______________________________<wbr>_________________<br>codes-ross-users mailing list<br><a href="mailto:codes-ross-users@lists.mcs.anl.gov" target="_blank">codes-ross-users@lists.mcs.anl<wbr>.gov</a><br><a href="https://lists.mcs.anl.gov/mailman/listinfo/codes-ross-users" target="_blank">https://lists.mcs.anl.gov/mail<wbr>man/listinfo/codes-ross-users</a><br></div></blockquote></div><br></div></div></blockquote></div><br></div>
</div></blockquote></div><br></div></div></div></div></blockquote></div><br></div>