A simple wrapper for grabbing data for completed and running jobs.
Developed for the HPC systems at University of Arizona. High memory nodes are differentiated from standard nodes with AvailableFeatures=hi_mem.
Termos e acordos Ao iniciar este projeto, você concorda com as diretrizes do Código de Ética e Conduta e do Manual da Pessoa Estudante da Trybe. Boas
Contributors: Uladzislau Kaparykha, Amanda Hahn, Nicholas Waller Hackathon Team Name: N.U.M General Purpose: The general purpose of this program is to
PyQGIS Standalone Script Executer Standalone PyQGIS application that is able to run a custom script, in this case Proximity.py without the need of a G
Poetry Multiproject Plugin This is a Poetry plugin that will make it possible to build projects using custom TOML files. This is especially useful whe
Coinloggr A learning resource and social platform for the coin collecting commun
This is an easy to use Python library which allows you to make your terminal out
python python scripts - mostly automation scripts You can set your environment in various ways bash #!/bin/bash python - locally on remote host #!/bi
hyperskill-SimpleChattyBot-python A simple bot that will help you in your learning and make it more fun. Syntax bot.py Stages Stage #1: Zuhura Bot we
Mending Make after-work Mending More flexible In Python A Lite Package focuses on making project's after-post mending pythonic and flexible. Certainly
Howdy,
Blake J pointed us (UAB Research Computing) to your nice slurm-wrapper repo :-)
While job-history and system-busy work great on our cluster, nodes-busy is crashing on our cluster with the following:
1 Dec 9, 2021
1 Jan 10, 2022
6 Sep 23, 2022
69 Dec 25, 2022
1 Jan 10, 2022
1 Feb 5, 2022
1 Jan 5, 2022
1 Nov 9, 2021
2 Jun 15, 2022
❯ ./bin/nodes-busy
nodes-busy: visualize live system resource usage.
Trouble seeing the output? Try 'nodes-busy --ascii'
Traceback (most recent call last):
File "./bin/nodes-busy", line 766, in <module>
merged = merge(job_data, node_data)
File "./bin/nodes-busy", line 330, in merge
nodes_dictionary[node]["JOBS"][job] = {"CPUs":cpus, "GPUs":jobs_dictionary[job]["GPUAlloc"],"EndTime":jobs_dictionary[job]["EndTime"],"Partition":jobs_dictionary[job]["Partition"],"Restarts":jobs_dictionary[job]["Restarts"]}
KeyError: 'GPUAlloc'
I'm digging through the code, but figured I'd post this for tracking purposes.
Thanks, Mike
Howdy, noticed the following error today when running nodes-busy on our cluster.
> nodes-busy
Traceback (most recent call last):
File "/share/apps/rc/bin/nodes-busy", line 1177, in <module>
job_data = get_scontrol_job_data()
File "/share/apps/rc/bin/nodes-busy", line 370, in get_scontrol_job_data
output = out.decode('utf-8').split("\n")
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xad in position 53196: invalid start byte
I have no idea what's in position 53196, but I fixed the issue with the following addition to output.decode to ignore errors:
diff --git a/bin/nodes-busy b/bin/nodes-busy
index 6fb1744..aee728f 100755
--- a/bin/nodes-busy
+++ b/bin/nodes-busy
@@ -367,7 +367,7 @@ def get_scontrol_job_data(target_job = None):
sys.exit(1)
# Split up space-delimited output into a job dictionary
- output = out.decode('utf-8').split("\n")
+ output = out.decode('utf-8', 'ignore').split("\n")
for job in output:
details = job.split(' ')
for i in details:
Added new argument to past-jobs to support selecting jobs by someone other than the user running the script:
$ past-jobs -d 30 -u flakrat
Jobs submitted by user flakrat in last 30 days.
JobID Start User JobName Partition Account State ExitCode
------------------------------------------------------------------------------------------------
14364561 2022-06-02 flakrat hostname express flakrat CANCELLED 0:0
14385956 2022-06-05 flakrat hostname express flakrat COMPLETED 0:0
14850816 2022-06-12 flakrat hostname express flakrat COMPLETED 0:0
Full Changelog: https://github.com/SaraMWillis/slurm-wrappers/compare/v0.1.0...v0.2.0
Source code(tar.gz)The scripts in this repository have some bits and pieces that are specific to the HPC setup at University of Arizona. These parts are being cleaned up.
Source code(tar.gz)sardana-jupyter Sardana integration into the Jupyter ecosystem.
Advent-of-Code Jack Morgan's Advent of Code Solutions Usage Run . initiate.sh year day To initiate a day. This sets up a template python file, and pul
ASAM Project Guide Important This guide is a work in progress and subject to change! Hosted version available at: ASAM Project Guide (Link) Includes:
Script to change official Kali repository to mirrors. This helps increase packages update and downloading for some user.
Admission-helper About An app to help people apply for admissions on schools/hostels This app is a rewrite of Admission-helper-beta-v5.8.9 and I impor
Welcome to Streamlit 👋 The fastest way to build and share data apps. Streamlit lets you turn data scripts into sharable web apps in minutes, not week
pyRTOS Introduction pyRTOS is a real-time operating system (RTOS), written in Python. The primary goal of pyRTOS is to provide a pure Python RTOS that
QSC-QSYS Launcher Launcher program to select which version of the Q-Sys software to launch. Instructions To use the application simply save the "Q-Sys
FLiP-Meetup-Chat Chat meetup create function bin/pulsar-admin functions create --auto-ack true --jar pulsardjlexample-1.0.jar --classname "dev.pulsarf
MultitaskQueue It's a simple framework based on three composed concepts: Task: A task is the smaller unit of execution or simple a node in the DAG, ev
Browbeat Browbeat is a performance tuning and analysis tool for OpenStack. Browbeat is free, Open Source software. Analyze and tune your Cloud for opt
pybicyclewheel pybicyclewheel calulates the required spoke length for bicycle wheels. (under construcion) - homepage further readings wikipedia bicyc
Enjoyable scripting experience with Python
wrapt The aim of the wrapt module is to provide a transparent object proxy for Python, which can be used as the basis for the construction of function
Astro a faster copy of nell's comet nuker also nell uses external libraries like it's cocaine man never learned to use ansi color codes (ily nell) (On
Watch N Learn About Watch N Learn is an educational platform for students. Watch N Learn incentivizes students to learn with fun activities and reward
aaTools My various assets for Houdini "ms_asset_loader" - Custom importer assets from Quixel Bridge "asset_placer" - Tool for placment sop geometry on
my-small-programs Pequenos programas variados que estou praticando e implementando! Arquivo: automacao Automacao de processos de rotina com código Pyt
Magic-8-Ball To the people who wish to make decisions using a Magic 8 Ball but can't get one? I gotchu. This is a basic python project which replicate
Google Drive VFX Server VFX Pipeline About The Project Quick tutorial to setup a Google Drive Server for multiple machines access, and VFX Pipeline on
1 Dec 23, 2021
1 Dec 10, 2021
2 Mar 17, 2022
2 Nov 29, 2021
3 Apr 24, 2022
22k Jan 06, 2023
96 Dec 30, 2022
2 Sep 28, 2022
1 Dec 09, 2021
4 Dec 09, 2021
83 Dec 14, 2022
0 Aug 24, 2022
8 Jun 08, 2022
1.8k Jan 06, 2023
8 Aug 15, 2022
3 May 04, 2022
9 Dec 19, 2022
43 Nov 22, 2022
3 Jun 24, 2021
17 Jun 27, 2022