sinfo(1) Slurm Commands sinfo(1) (NAME) sinfo - Slurm. (SYNOPSIS) sinfo [OPTIONS...] (DESCRIPTION) sinfo Slurm . (OPTIONS) -a, --all . . -M, --clusters= . . 'all' . slurmdbd FederationParameters=fed_display --federation . --local . -d, --dead . POWERED_DOWN . -e, --exact . CPU "+" ( "250+"). --federation . -F, --future FUTURE. -o, --format= sinfo . -h, --noheader . sinfo : default "%#P %.5a %.10l %.6D %.6t %N" --summarize "%#P %.5a %.10l %.16F %N" --long "%#P %.5a %.10l %.10s %.4r %.8h %.10g %.6D %.11T %.11i %N" --Node "%#N %.6D %#P %6t" --long --Node "%#N %.6D %#P %.11T %.4c %.8z %.6m %.8d %.6w %.8f %20E" --list-reasons "%20E %9u %19H %N" --long --list-reasons "%20E %12U %19H %6t %N" "#" . sinfo . "#" . "%[[.]size]type[suffix]" . size . . . . . suffix . type : %all (|) . %a / . %A "allocated/idle". ("%t" "%T") . %b %f . %B CPU . %c CPU . %C CPU "allocated/idle/other/total". ("%t" "%T") . %d (mebibytes). %D . %e MiB . . %E ( down drained draining). %f %b . %F "allocated/idle/other/total". ("%t" "%T") . %g . %G (gres) . %h OverSubscribe . %H . %i . %I . %l "days-hours:minutes:seconds" %L "days-hours:minutes:seconds" %m . %M PreemptionMode. %n (hostnames) . %N . %o . %O (CPU load) . %p . %P "*" %R . %r root "yes" "no". %R %P . %s . %S . %t . %T . %u . %U uid . %v slurmd. . %V . %w . %X . %Y . %Z (threads) . %z : (S:C:T) . -O, --Format= . -o --format= ( ). . "type[:[.][size][suffix]]" size . . . . . suffix . type : All -o (pipe) . AllocMem . AllocNodes . Available / . Cluster . Comment . ( ) Cores . CPUs CPU . CPUsLoad (CPU load) . CPUsState CPU "allocated/idle/other/total". ("%t" "%T") . DefaultTime "days-hours:minutes:seconds". Disk (mebibytes). Extra . Features . features_act . features_act . features . FreeMem (MiB) . . Gres (gres) . GresUsed (gres) . GRES https://slurm.schedmd.com/gres.html#Shared_GRES_Usage . Groups . MaxCPUsPerNode CPU . Memory . NodeAddr . NodeAI "allocated/idle". ("%t" "%T") . NodeAIOT "allocated/idle/other/total". ("%t" "%T") . NodeHost (hostnames) . NodeList . Nodes . OverSubscribe (oversubscribe) ( CPU) . Partition "*" %R . PartitionName %P . Port () TCP . PreemptMode (Preemption). PriorityJobFactor priority/multifactor . PriorityTier Priority (scheduling tier) . Reason ( down drained draining). Root root "yes" "no". Size . SocketCoreThread : (S:C:T) . Sockets . StateCompact . StateLong . StateComplete "idle+cloud+power" Threads . Time "days-hours:minutes:seconds". TimeStamp (timestamp) . User . UserLong (uid) . Version slurmd. . Weight . --help sinfo. --hide . . . -i, --iterate= . . (header) . --json, --json=list, --json= JSON data_parser data_parser . . . -R, --list-reasons down drained fail failing . Slurm "reason" . reason down drained draining failing . ( -r -d -t -n) down drained failing . -l . --local . ( ) . --federation . -l, --long . --format . --noconvert ( 2048M 2G ). -N, --Node . - . --partition . . --format ..IP -n, --nodes= () . ( "linux[00-17]"). . -h, --noheader (header) . -p, --partition= () () . . -T, --reservation Slurm. : sinfo . -r, --responding . --dead . -S, --sort= . . . "+" "-" () . "P" "#" Slurm slurm.conf . "+P,-m" . "#P,-t" ( ). --Node "N" ( ) . -t, --states= () . . '+' . '~' . ( ): ALLOC ALLOCATED BLOCKED CLOUD COMP COMPLETING DOWN DRAIN ( DRAINING DRAINED) DRAINED DRAINING FAIL FUTURE FUTR IDLE MAINT MIX MIXED NO_RESPOND PLANNED POWER_DOWN POWERING_DOWN POWERED_DOWN POWERING_UP REBOOT_ISSUED REBOOT_REQUESTED RESV RESERVED UNK UNKNOWN. . --dead --responding . -s, --summarize . --format . --usage sinfo. -v, --verbose . -V, --version . --yaml, --yaml=list, --yaml= YAML data_parser data_parser . . . AVAIL . up down drain inact ( INACTIVE) . State slurm.conf(5) . CPUS (CPU) . S:C:T (S) (C) (T) . SOCKETS . CORES . THREADS . GROUPS . all . JOB_SIZE . . infinite . TIMELIMIT days-hours:minutes:seconds (-::). infinite . MEMORY (RAM) . NODELIST . NODES . NODES(A/I) "allocated/idle" (/). NODES(A/I/O/T) "allocated/idle/other/total" (///). PARTITION . "*" . PORT TCP slurmd . ROOT root () yes no. OVERSUBSCRIBE ( SelectTypeParameters) . NO: . YES:n: --oversubscribe n . FORCE:n: n ( ). STATE . : allocated blocked completing down drained draining fail failing future idle maint mixed planned power_down power_up reserved unknown. : alloc block comp down drain drng fail failg futr idle maint mix plnd pow_dn pow_up resv unk. : "*" . TMP_DISK . . . : * . DOWN ( COMPLETING DRAINED DRAINING FAIL FAILING). ~ . # . ! . % . $ "maintenance" . @ . ^ . - backfill . ALLOCATED . ALLOCATED+ (COMPLETING) . BLOCKED . COMPLETING (COMPLETING) . epilog ( ) . COMPLETING . Epilog slurm.conf(5) . DOWN . Slurm . . Slurm . ReturnToService SlurmdTimeout slurm.conf(5) . DRAINED . update node scontrol(1) slurm.conf(5) . DRAINING . DRAINED . . update node scontrol(1) slurm.conf(5) . FAIL . update node scontrol(1) slurm.conf(5) . FAILING . update node scontrol(1) slurm.conf(5) . FUTURE . IDLE . INVAL (controller) . slurm.conf . ( slurmd ). MAINT "maintenance" . REBOOT_ISSUED (agent) . REBOOT_REQUESTED . MIXED CPU ALLOCATED IDLE . TRES ( ) . PLANNED backfill . POWER_DOWN . POWERED_DOWN ..IP POWERING_DOWN . POWERING_UP . RESERVED . UNKNOWN Slurm . (PERFORMANCE) sinfo (RPC) slurmctld . sinfo Slurm slurmctld slurmctld (denial of service) . sinfo Slurm slurmctld . sinfo . (ENVIRONMENT VARIABLES) sinfo . . : . SINFO_ALL -a, --all SINFO_FEDERATION --federation SCONTROL_FUTURE -F, --future SINFO_FORMAT -o , --format= SINFO_LOCAL --local SINFO_PARTITION -p , --partition= SINFO_SORT -S , --sort= SLURM_CLUSTERS --clusters SLURM_CONF Slurm. SLURM_DEBUG_FLAGS (debug flags) sinfo. DebugFlags slurm.conf(5) . slurm.conf . SLURM_JSON JSON: compact JSON . pretty JSON (pretty) . SLURM_TIME_FORMAT . standard "year-month-dateThour:minute:second" . relative "hour:minute:second" . "hour:minute" "Tomorr" () "Ystday" () ( "Mon" "Tue" ) ( "25 Apr") . ( "6 Jun 2012"). . strftime() . "%a %T" ( "Mon 12:34:56"). SLURM_YAML YAML: compact YAML . pretty YAML (pretty) . : $ sinfo PARTITION AVAIL TIMELIMIT NODES STATE NODELIST batch up infinite 2 alloc adev[8-9] batch up infinite 6 idle adev[10-15] debug* up 30:00 8 idle adev[0-7] : $ sinfo -s PARTITION AVAIL TIMELIMIT NODES(A/I/O/T) NODELIST batch up infinite 2/6/0/8 adev[8-15] debug* up 30:00 0/8/0/8 adev[0-7] debug: $ sinfo --long --partition=debug PARTITION AVAIL TIMELIMIT JOB_SIZE ROOT OVERSUBS GROUPS NODES STATE NODELIST debug* up 30:00 8 no no all 8 idle dev[0-7] DRAINED : $ sinfo --states=drained PARTITION AVAIL NODES TIMELIMIT STATE NODELIST debug* up 2 30:00 drain adev[6-7] : $ sinfo -Nel NODELIST NODES PARTITION STATE CPUS MEMORY TMP_DISK WEIGHT FEATURES REASON adev[0-1] 2 debug* idle 2 3448 38536 16 (null) (null) adev[2,4-7] 5 debug* idle 2 3384 38536 16 (null) (null) adev3 1 debug* idle 2 3394 38536 16 (null) (null) adev[8-9] 2 batch allocated 2 246 82306 16 (null) (null) adev[10-15] 6 batch idle 2 246 82306 16 (null) (null) down drained draining (reason) : $ sinfo -R REASON NODELIST Memory errors dev[0,5] Not Responding dev8 (COPYING) Copyright (C) 2002-2007 The Regents of the University of California. Lawrence Livermore National Laboratory ( DISCLAIMER ). Copyright (C) 2008-2009 Lawrence Livermore National Security. Copyright (C) 2010-2022 SchedMD LLC. Slurm . . Slurm << >> (GNU General Public License) ( ) / . Slurm . << >> ..SH " (SEE ALSO)" scontrol(1), squeue(1), slurm_load_ctl_conf (3), slurm_load_jobs (3), slurm_load_node (3), slurm_load_partitions (3), slurm_reconfigure (3), slurm_shutdown (3), slurm_update_job (3), slurm_update_node (3), slurm_update_partition (3), slurm.conf(5) Slurm 26.05 Slurm Commands sinfo(1)