Comet_rincon_3m

Comet_rincon_3m

First I logged into the xd-login single user 

Next I logged into OpenScienceGrid - this was following Mats instruction given the problem we had with Comet and its head node only allowing so many files to be open at one time.

Tysons-MacBook-Pro:~ tyson_swetnam$ ssh -l tswetnam login.xsede.org

Please login to this system using your XSEDE username and password:
Last login: Sun Nov 27 14:58:30 2016 from 67.1.200.114
#  Welcome to the XSEDE Single Sign-On (SSO) Hub!
# 
#  This system is for use by authorized users only, and is subject to the XSEDE
#  Acceptable Use Policy, described at https://www.xsede.org/usage-policies.
#  All activities on this system may be monitored and logged. 
#  Your storage on this system is limited to 100MB. Backup is not provided.
#
#  From this system, you may login to other XSEDE system login hosts on which
#  you currently have an active account. To see a list of your accounts, visit:
#  https://portal.xsede.org/group/xup/accounts
# 
#  To login to an XSEDE system login host, enter: gsissh <login-host>
#  where <login-host> is the hostname, alias or IP address of the login host.
#  The following default gsissh host aliases have been defined:
# 
#   bridges  comet  darter  gordon  greenfield  mason  maverick  nautilus
#     osg  stampede  supermic  wrangler-iu  wrangler-tacc  xstream
# 
#  For example, to login to the Comet system at SDSC, enter: gsissh comet
# 
#  E-mail help@xsede.org if you require assistance in the use of this system.

[tswetnam@ssohub ~]$ gsissh osg
Last login: Wed Sep  7 15:05:23 2016 from 67-1-198-121.tcso.qwest.net
You have 0 active projects you can charge jobs to.
 Note that you can still charge to a project with a negative balance, as
 long as the project has not reached its end date. A project with a
 negative balance may result in jobs being given lower priority.

 When submitting jobs, please specify what project to charge to with a

 +ProjectName line in your HTCondor submit file. For example:
     +ProjectName = "ExampleProject" 
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
Your current filesystem usages and quotas are:
   /home             3% used (577.7 MB of 20.0 GB)  
   /local-scratch    0% used (712.0 KB of 2.0 TB)  
NOTE: The /local-scratch filesystem automatically deletes files older than
      60 days.
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *

There are now stricter memory limits in place on the compute nodes. The
default is that a job can use up to 2 GBs of RAM. If you need more, please
specify your requirement in the HTCondor submit file. For example, if 
you need 3GBs, add the following line, where the value is in MBs:

request_memory = 3000
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
2016-11-27 20:14:24 UTC [tswetnam@xd-login:~]$ ls
catalina  eemt-workers  kaibab  rincon  submit_osg_workers.sh
eemt      git           mcn     sol     tswetnam@xd-login.opensciencegrid.org

 

 

. /cvmfs/oasis.opensciencegrid.org/osg/modules/lmod/current/init/bash
module load cctools
module load eemt
 
 
time ./run-workflow --name EEMT_Comet -O  /rincon ~/rincon/rincon_crk_3m_utm.tif -s 1000 -e 1000 2>&1 | tee wf.log