User Jobs

GiulioFontana — Wed, 04 Nov 2026 14:33:26 GMT

Options of srun and sbatch

← Older revision		Revision as of 14:33, 4 November 2026
Line 64:		Line 64:

	:;‑‑gres=<gpu_resources>		:;‑‑gres=<gpu_resources>
	:: specifies what GPUs to assign to the job. <code>gpu_resources</code> is a comma-delimited list where each element has the form <code>gpu:<Type>:<amount></code>, where <code><Type></code> is one of the types of GPU available on Mufasa (see [[SLURM#gres syntax\|<code>gres</code> syntax]]) and <code><amount></code> is an integer between 1 and the number of GPUs of such type available to the partition. For instance, <code><gpu_resources></code> may be <code>~~gpu:40gb:1,~~gpu:3g.20gb:1</code>, corresponding to asking for one ~~"full" GPU and 1~~ "small" GPU.		:: specifies what GPUs to assign to the job. <code>gpu_resources</code> is a comma-delimited list where each element has the form <code>gpu:<Type>:<amount></code>, where <code><Type></code> is one of the types of GPU available on Mufasa (see [[SLURM#gres syntax\|<code>gres</code> syntax]]) and <code><amount></code> is an integer between 1 and the number of GPUs of such type available to the partition. For instance, <code><gpu_resources></code> may be <code>gpu:3g.20gb:1</code>, corresponding to asking for one "small" GPU.

	:: ''Important! The <code>‑‑gres</code> parameter is '''mandatory''' if the job is run with a QOS that allows access to the system's GPUs. Differently from other resources (where unspecified requests lead to the assignment of a default amount), GPUs must always be explicitly requested.''		:: ''Important! The <code>‑‑gres</code> parameter is '''mandatory''' if the job is run with a QOS that allows access to the system's GPUs. Differently from other resources (where unspecified requests lead to the assignment of a default amount), GPUs must always be explicitly requested.''

	:;‑‑mem=<mem_resources>		:;‑‑mem=<mem_resources>
	:: specifies the amount of RAM to assign to the job; for instance, <code><mem_resources></code> may be <code>~~200G~~</code>		:: specifies the amount of RAM to assign to the job; for instance, <code><mem_resources></code> may be <code>32G</code>

	:;‑‑cpus-per-task=<cpu_amount>		:;‑‑cpus-per-task=<cpu_amount>

SLURM

GiulioFontana — Wed, 04 Nov 2026 09:13:06 GMT

Elements determining job priority

← Older revision		Revision as of 09:13, 4 November 2026
(30 intermediate revisions by the same user not shown)
Line 277:		Line 277:
	::: Used to provide higher priority to jobs asking for '''less resources'''		::: Used to provide higher priority to jobs asking for '''less resources'''

	: '''Number of CPUs''' requested by the job ~~(also called "job size")~~		: '''Number of CPUs''' requested by the job
	::: Used to provide higher priority to jobs asking for '''a lower number of CPUs'''		::: Used to provide higher priority to jobs asking for '''a lower number of CPUs'''

Line 286:		Line 286:
	::: Used to provide higher priority to jobs by users who '''used Mufasa's resources less than others''' (see [[#How FairShare works\|below]])		::: Used to provide higher priority to jobs by users who '''used Mufasa's resources less than others''' (see [[#How FairShare works\|below]])

	You can understand how the priority of ~~your~~ jobs ~~depends on each~~ of ~~these factors using~~ command		You can understand how each of these elements contributes to the priority of the jobs waiting for execution (both yours and of other users) with command <code>sprio</code>. A tailored version of <code>sprio</code> that only displays the parameters listed above is the following:
	<pre style="color: lightgrey; background: black;">		<pre style="color: lightgrey; background: black;">
	sprio		sprio -o "%6i %9u %.8Y %.10B %.5Q %.9T %.5A %.5F"
	</pre>		</pre>
	Here is an example of the output of ~~<code>sprio</code>~~:
			Here is an example of the output of the command above:
	<pre style="color: lightgrey; background: black;">		<pre style="color: lightgrey; background: black;">
	JOBID ~~PARTITION~~ PRIORITY ~~SITE AGE~~ ASSOC ~~FAIRSHARE JOBSIZE~~ QOS		JOBID USER PRIORITY ASSOC QOS TRES AGE FAIRS
	~~5193 jobs 5677 0 905~~ 2500 ~~39 2155 78~~		5790 amoglia 3495 2500 375 cpu=-800 933 487
	~~5202 jobs 3966~~ ~~0 186 625 844~~ ~~2155 156~~		5791 qliu 3010 2500 375 cpu=-800 916 19
	~~5203 jobs 5223 0~~ ~~166 2500 325 2155 78~~		5817 mzoccola 2336 625 750 cpu=-800 495 1266
	~~5204 jobs 3744 0 158~~ 625 ~~649 2155 156~~		5822 fbottazzi 2235 625 750 cpu=-600 467 994
	~~5205 jobs 5186 0 141~~ 2500 ~~312 2155 78~~		5837 lpassoni 2508 2500 750 cpu=-800 0 58
	~~5232 jobs 4078 0 26~~ 625 ~~857 2414 156~~		5838 bagostini 4437 625 3000 cpu=-200 0 1013
	~~5236 jobs 4746~~ 0 ~~0 2500 13 2155 78~~		5839 flazzaro 1549 625 750 cpu=-800 0 974
	~~5237 jobs 4834 0 10 2500 13 2155~~ ~~156~~
	~~5238 jobs 5860~~ 0 ~~10 2500 312 2414 625~~
	</pre>		</pre>
	In it, column ~~ASSOC (i.e~~., ~~association)~~ corresponds to user category. ~~Column PRIORITY provides~~ the ~~overall~~ priority of ~~each~~ job.		In it, column PRIORITY provides the overall priority of each job. Each priority value is the sum of the five values to its right; in particular, column ASSOC corresponds to user category, while column TRES corresponds to the number of CPUs. Note that the contribution of TRES to priority is ''negative'', i.e. it is a penalty; its value is proportional to the number of CPUs requested by the job.

			'''Things to consider when using <code>sprio</code>'''
			* Its output is only relevant for jobs ''not yet in execution''. For an already running job, the values shown by <code>sprio</code> correspond to the priority that the job would get if evaluated now, which generally differs from its actual priority.
			* Jobs listed by <code>sprio</code> may temporarily differ from jobs listed by <code>squeue</code>: this is due to the fact that SLURM updates its internal data with a periodicity of a few minutes.

	=== How FairShare works ===		=== How FairShare works ===
Line 329:		Line 332:
	:: Usually, code exploits multiple CPUs only if specifically designed to do so: if unsure, only ask for 1 CPU		:: Usually, code exploits multiple CPUs only if specifically designed to do so: if unsure, only ask for 1 CPU
	:: The fewer resources your job asks for, the less it will wait before they become available		:: The fewer resources your job asks for, the less it will wait before they become available
			:: The more CPUs your job asks for, the stronger the penalty to its priority
	:: Asking for fewer CPUs and/or less RAM improves your FairShare		:: Asking for fewer CPUs and/or less RAM improves your FairShare

Line 421:		Line 425:
	AllowGroups=ALL AllowAccounts=ALL AllowQos=nogpu,gpulight,gpu,gpuwide,gpuheavy-20,gpuheavy-40		AllowGroups=ALL AllowAccounts=ALL AllowQos=nogpu,gpulight,gpu,gpuwide,gpuheavy-20,gpuheavy-40
	AllocNodes=ALL Default=YES QoS=N/A		AllocNodes=ALL Default=YES QoS=N/A
	=> DefaultTime=01:00:00 DisableRootJobs=NO ExclusiveUser=NO ExclusiveTopo=NO GraceTime=0 Hidden=NO		DefaultTime=01:00:00 DisableRootJobs=NO ExclusiveUser=NO ExclusiveTopo=NO GraceTime=0 Hidden=NO
	MaxNodes=UNLIMITED MaxTime=3-00:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED		MaxNodes=UNLIMITED MaxTime=3-00:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED MaxCPUsPerSocket=UNLIMITED
	Nodes=gn01		Nodes=gn01
Line 428:		Line 432:
	State=UP TotalCPUs=48 TotalNodes=1 SelectTypeParameters=NONE		State=UP TotalCPUs=48 TotalNodes=1 SelectTypeParameters=NONE
	JobDefaults=(null)		JobDefaults=(null)
	=> DefMemPerNode=4096 MaxMemPerNode=UNLIMITED		DefMemPerNode=4096 MaxMemPerNode=UNLIMITED
	TRES=cpu=48,mem=1011435M,node=1,billing=49,gres/gpu=13,gres/gpu:3g.20gb=5,gres/gpu:40gb=3,gres/gpu:4g.20gb=5		TRES=cpu=48,mem=1011435M,node=1,billing=49,gres/gpu=13,gres/gpu:3g.20gb=5,gres/gpu:40gb=3,gres/gpu:4g.20gb=5
	TRESBillingWeights=cpu=1.0,gres/gpu:3g.20gb=6.0,gres/gpu:4g.20gb=6.0,gres/gpu:40gb=6.0,mem=0.05g		TRESBillingWeights=cpu=1.0,gres/gpu:3g.20gb=6.0,gres/gpu:4g.20gb=6.0,gres/gpu:40gb=6.0,mem=0.05g
	</pre>		</pre>

	In the ~~example, we have highlighted with '''=~~>~~'''~~ the most relevant default values for Mufasa users~~, i.e.~~:		In the output of <code>scontrol show partition</code> the most relevant default values for Mufasa users are:

	;<code>DefaultTime</code>		;<code>DefaultTime</code>

Mufasa (BioHPC) - Recent changes [en]

User Jobs

SLURM