Skip to content
This repository has been archived by the owner on Nov 30, 2024. It is now read-only.

toolforge/grid-jobs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

sge-jobs

List tools running on Toolforge Son of Grid Engine exec nodes.

Install

Clone repo and create basic files:

bastion$ become sge-jobs
tools.sge-jobs@bastion:~$ mkdir -p ~/www/python
tools.sge-jobs@bastion:~$ git clone https://phabricator.wikimedia.org/source/tool-grid-jobs.git ~/www/python/src

Create virtualenv inside kubernetes:

tools.sge-jobs@bastion:~$ webservice --backend=kubernetes python shell
tools.sge-jobs@interactive:~$ python3 -m venv ~/www/python/venv
tools.sge-jobs@interactive:~$ source ~/www/python/venv/bin/activate
(venv)tools.sge-jobs@interactive:~$ pip install -U pip
(venv)tools.sge-jobs@interactive:~$ pip install -r ~/www/python/src/requirements.txt

Back to bastion, start the webservice:

tools.sge-jobs@bastion:~$ webservice --backend=kubernetes python start

Creating the list is pretty expensive and we don't need it to be a real time display, so a nice thing to do is setup a cron job to collect new data once an hour:

21 * * * * jstart -N update-cache curl 'https://tools.wmflabs.org/sge-jobs/?purge'

License

GNU GPLv3+

Forked from precise-tools