[Swift-devel] angle-1000 4th run

Tue Nov 6 07:19:40 CST 2007

is running, but slowly:

Same behavior: only 2-3 jobs running in two spot checks.
CLuster size is still low. I must have a math error in my time specs. 
WIll check again.  Clusters are starting every 10 secs but much smaller 
than expected/desired.  Again, maxwalltime is 60 secs and 
swift.poperties cluster settings are:
clustering.enabled=true
clustering.queue.delay=10
clustering.min.time=1200

So I would have expected 20-40 jobs per cluster (2 x (1200/60))

- mike

UC64$ head swift.out
Swift script awf6.swift starting at Tue Nov 6 06:32:46 CST 2007
running on sites: UC-nfs-gt2-ks

Swift v0.3-dev r1456

RunID: 20071106-0632-asuk0my2
angle4 started
...

UC64$ qstat -u wilde

tg-master.uc.teragrid.org:

Req'd  Req'd   Elap
Job ID               Username Queue    Jobname    SessID NDS   TSK 
Memory Time  S Time
-------------------- -------- -------- ---------- ------ ----- --- 
------ ----- - -----
1574316.tg-master.uc wilde    dque     STDIN       20590     1  --    -- 
  00:15 R   --
1574318.tg-master.uc wilde    dque     STDIN       20666     1  --    -- 
  00:15 R   --

UC64$ date
Tue Nov  6 06:58:11 CST 2007

UC64$ grep -i cluster.*size a*.log

2007-11-06 06:34:12,327-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-0-1194352386645 with size 4
2007-11-06 06:34:22,326-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-1-1194352386651 with size 2
2007-11-06 06:35:32,332-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-2-1194352386875 with size 3
2007-11-06 06:35:42,332-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-3-1194352386883 with size 2
2007-11-06 06:35:52,333-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-4-1194352386974 with size 2
2007-11-06 06:36:02,334-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-5-1194352387000 with size 4
2007-11-06 06:36:22,335-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-6-1194352387074 with size 3
2007-11-06 06:36:32,336-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-7-1194352387112 with size 4
2007-11-06 06:36:52,337-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-8-1194352387329 with size 4
2007-11-06 06:37:52,344-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-9-1194352387719 with size 3
2007-11-06 06:38:52,350-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-10-1194352387823 with size 3
2007-11-06 06:39:52,356-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-11-1194352387927 with size 3
2007-11-06 06:40:52,362-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-12-1194352388031 with size 3
2007-11-06 06:41:52,369-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-13-1194352388135 with size 3
2007-11-06 06:42:52,376-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-14-1194352388239 with size 3
2007-11-06 06:43:52,382-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-15-1194352388343 with size 3
2007-11-06 06:45:02,389-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-16-1194352388447 with size 3
2007-11-06 06:46:02,396-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-17-1194352388551 with size 3
2007-11-06 06:47:02,403-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-18-1194352388655 with size 3
2007-11-06 06:48:02,409-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-19-1194352388759 with size 3
2007-11-06 06:49:02,415-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-20-1194352388863 with size 3
2007-11-06 06:50:02,421-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-21-1194352388975 with size 4
2007-11-06 06:51:12,428-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-22-1194352389137 with size 4
2007-11-06 06:51:22,428-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-23-1194352389147 with size 4
2007-11-06 06:52:22,434-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-24-1194352389489 with size 4
2007-11-06 06:52:42,435-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-25-1194352389503 with size 4
2007-11-06 06:52:52,517-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-26-1194352389514 with size 3
2007-11-06 06:53:12,517-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-27-1194352389579 with size 4
2007-11-06 06:53:32,519-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-28-1194352389593 with size 4
2007-11-06 06:53:42,520-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-29-1194352389703 with size 4
2007-11-06 06:54:02,521-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-30-1194352389765 with size 4
2007-11-06 06:54:22,523-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-31-1194352389952 with size 4
2007-11-06 06:54:32,523-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-32-1194352390996 with size 2
2007-11-06 06:54:42,523-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-33-1194352391028 with size 2
2007-11-06 06:54:52,524-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-34-1194352391084 with size 2
2007-11-06 06:55:02,524-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-35-1194352391098 with size 4
2007-11-06 06:55:22,630-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-36-1194352391181 with size 2
2007-11-06 06:55:32,633-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-37-1194352391192 with size 3
2007-11-06 06:55:42,635-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-38-1194352391224 with size 2
2007-11-06 06:55:52,635-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-39-1194352391244 with size 2
2007-11-06 06:56:03,050-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-40-1194352391252 with size 2
2007-11-06 06:56:12,956-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-41-1194352391290 with size 4
2007-11-06 06:56:22,956-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-42-1194352391334 with size 2
2007-11-06 06:56:32,957-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-43-1194352391366 with size 2
2007-11-06 06:56:42,958-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-44-1194352391404 with size 4
2007-11-06 06:57:02,960-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-45-1194352391466 with size 4
2007-11-06 06:57:12,960-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-46-1194352391525 with size 3
2007-11-06 06:57:32,961-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-47-1194352391614 with size 4
2007-11-06 06:57:52,964-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-48-1194352391682 with size 3
2007-11-06 06:58:02,980-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-49-1194352391735 with size 3
2007-11-06 06:58:22,982-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-50-1194352391818 with size 4
2007-11-06 06:58:32,982-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-51-1194352391829 with size 3
2007-11-06 06:58:52,982-0600 INFO  VDSAdaptiveScheduler Creating cluster 
urn:cluster-52-1194352391894 with size 4
UC64$