sreport(1) Slurm Commands sreport(1) (NAME) sreport - (SYNOPSIS) sreport [...] [...] (DESCRIPTION) sreport (slurmdbd) . (rollups) . . "Start=01/01 End=03/01" "Start=01/01-03:00 End=03/01" . (OPTIONS) -a, --all_clusters . -M, --cluster () . . . --local . --federation . -h, --help sreport . --local . --federation . -n, --noheader . -p, --parsable '|' '|' . -P, --parsable2 '|' '|' . -Q, --quiet . -t <_> . . Minutes () . time . -T, --tres= (TRES) . CPU ( TRES ). TRES TRES "ALL" TRES . "Reported" Billing TRES Billing TRES . TRESBillingWeights Billing TRES . TRESBillingWeights Billing TRES CPU . TRES (Cluster Utilization) . TRES CPU . node . TRES node . (exclusive node) CPU . -v, --verbose . -V , --version . (COMMANDS) sreport (interactive) . sreport . exit sreport. quit . help sreport. nonparsable parsable parsable2. parsable '|' '|' . parsable2 '|' '|' . quiet . quit sreport. exit . time <_> . . Minutes () . : SecPer / MinPer / HourPer / Seconds Minutes Hours Percent verbose . version sreport. !! . (REPORT TYPES) : cluster job reservation user : cluster AccountUtilizationByUser, AccountUtilizationByQOS, UserUtilizationByAccount, UserUtilizationByWckey, Utilization, WCKeyUtilizationByUser job SizesByAccount, SizesByAccountAndWcKey, SizesByWckey reservation Utilization user TopUsage : OverSubscribe slurm.conf FORCE YES (PreemptMode=OFF) . slurmdbd : "We have more allocated time than is possible." . (REPORT DESCRIPTION) cluster AccountUtilizationByUser (account) . root . 'tree' . : (Idle) / . (association) . . cluster AccountUtilizationByQOS . root . 'tree' . . : . QOS QOS 'normal' . : (reroll) QOS . cluster UserUtilizationByAccount . cluster UserUtilizationByWCKey wckey wckey . cluster Utilization Allocated Down Planned Down Idle Planned . . : IGNORE_JOBS Cluster Utilization / . ( IGNORE_JOBS) . : "Cluster Utilization" : Cluster Allocated Down PlannedDown Idle Planned Reported. OverCommitted TresCount Format . -T, --tres TresName . cluster WCKeyUtilizationByUser wckey WCKey . job SizesByAccount 'grouping=' . root . 'account=' sreport root . job SizesByAccountAndWckey SizesByAccount wckey account account:wckey wckey . job SizesByWckey wckey 'grouping=' . reservation Utilization . : (truncate) . user TopUsage . CPUTime -T, --tres TRES . group . . ... (OPTIONS FOR ALL REPORT TYPES) All_Clusters . . Clusters= . . End= . 23:59:59 . . ... HH:MM[:SS] [AM|PM] MMDD[YY] or MM/DD[/YY] or MM.DD[.YY] MM/DD[/YY]-HH:MM[:SS] YYYY-MM-DD[THH:MM[:SS]] now[{+|-}count[seconds(default)|minutes|hours|days|weeks]] Format= . format %NUMBER . format=name%30 name . -30 . Start= . 00:00:00 . . ... HH:MM[:SS] [AM|PM] MMDD[YY] or MM/DD[/YY] or MM.DD[.YY] MM/DD[/YY]-HH:MM[:SS] YYYY-MM-DD[THH:MM[:SS]] now[{+|-}count[seconds(default)|minutes|hours|days|weeks]] (OPTIONS SPECIFICALLY FOR CLUSTER REPORTS) Accounts= UserUtilizationByAccount AccountUtilizationBy[User|QOS] . . Tree AccountUtilizationBy[User|QOS] . Users= Utilization . . Wckeys= UserUtilizationByWckey WCKeyUtilizationByUser wckey . . (OPTIONS SPECIFICALLY FOR JOB REPORTS) Accounts= . . FlatView AcctAsParent . AcctAsParent SizesbyAccount(*) . root . FlatView . FlatView SizesbyAccount(*) . GID= (GID) . . Grouping= . ( 50,100,150 CPU 1-49 50-99 100-149 > 150 ). grouping=individual . Jobs= / . . Nodes= . . Partitions= . . PrintJobCount Sizes . Users= . . Wckeys= wckey . . SizesbyWckey . Users= . (OPTIONS SPECIFICALLY FOR RESERVATION REPORTS) Names= . . Nodes= . . (OPTIONS SPECIFICALLY FOR USER REPORTS) Accounts= . . Group . . TopCount= TopUsage . . . Users= . . (FORMAT OPTIONS FOR EACH REPORT) (FORMAT OPTIONS FOR CLUSTER REPORTS) AccountUtilizationByUser Accounts, Cluster, Login, QOS, Proper, TresCount, Used AccountUtilizationByQOS Accounts, Cluster, QOS, TresCount, Used UserUtilizationByAccount Accounts, Cluster, Login, Proper, TresCount, Used UserUtilizationByWckey Cluster, Login, Proper, TresCount, Used, Wckey Utilization Allocated, Cluster, Down, Idle, OverCommitted, PlannedDown, Reported, Planned, TresCount, TresName WCKeyUtilizationByUser Cluster, Login, Proper, TresCount, Used, Wckey (FORMAT OPTIONS FOR JOB REPORTS) SizesByAccount Account, Cluster SizesByAccountAndWckey Account, Cluster SizesByWckey Wckey, Cluster (FORMAT OPTIONS FOR RESERVATION REPORTS) Utilization Allocated, Associations, Cluster, End, Flags, Idle, Name, Nodes, ReservationId, Start, TotalTime, TresCount, TresName, TresTime (FORMAT OPTIONS FOR USER REPORTS) TopUsage Account, Cluster, Login, Proper, Used (case-insensitive). (EXPLANATION OF REPORT FIELDS) Account Allocated : . MAINT IGNORE_JOBS . : Associations (associations) Cluster Down : Down Drained slurmctld ( TrackSlurmctldDown slurmdbd.conf ) End : Energy ( ) Flags : Idle : Allocated Down PlannedDown Planned : Allocated Login (Login) Name : OverCommitted : Planned . Planned Reported . . Planned : Allocated Down PlannedDown . Allocated Planned Reported OverCommitted . (idle) . PlannedDown : MAINT IGNORE_JOBS . FUTURE POWERED_DOWN . Proper Name / Reported : . . ReservationId : Start : TotalTime : TresCount TRES TresName TRES TresTime : TRES Used -TRES Wckey (Workload Characterization Key) (PERFORMANCE) sreport (RPC) slurmdbd . sreport slurmdbd slurmdbd (denial of service) . sreport slurmdbd . sreport . (ENVIRONMENT VARIABLES) sreport . . (: .) SREPORT_CLUSTER -M, --cluster . SREPORT_FEDERATION --federation . SREPORT_LOCAL --local . SREPORT_TRES -t, --tres . SLURM_CONF . (EXAMPLES) : $ sreport job sizesbyaccount Start=11:00 -------------------------------------------------------------------------------- Job Sizes 2024-08-19T11:00:00 - 2024-08-19T11:59:59 (3600 secs) Time reported in Minutes -------------------------------------------------------------------------------- Cluster Account 0-49 CPUs 50-249 CPUs 250-499 CPUs 500-999 CPUs >= 1000 CPUs % of cluster --------- --------- ------------- ------------- ------------- ------------- ------------- ------------ minesofm+ root 770 0 0 0 0 100.00% : $ sreport cluster utilization Start=11:00 -------------------------------------------------------------------------------- Cluster Utilization 2024-08-19T11:00:00 - 2024-08-19T11:59:59 Usage reported in CPU Minutes -------------------------------------------------------------------------------- Cluster Allocate Down Planned Idle Planned Reported --------- -------- -------- -------- -------- -------- -------- minesofm+ 770 120 239 3791 239 4920 : $ sreport user top Start=11:00 -------------------------------------------------------------------------------- Top 10 Users 2024-08-19T11:00:00 - 2024-08-19T11:59:59 (3600 secs) Usage reported in CPU Minutes -------------------------------------------------------------------------------- Cluster Login Proper Name Account Used Energy --------- --------- --------------- --------------- -------- -------- minesofm+ stephen ,,, main 538 0 minesofm+ phteven ,,, main 145 0 minesofm+ phteven ,,, rivendell 45 0 minesofm+ stephen ,,, rivendell 41 0 : $ sreport job sizesbyaccount All_Clusters users=stephen account=main PrintJobCount Start=11:00 -------------------------------------------------------------------------------- Job Sizes 2024-08-19T11:00:00 - 2024-08-19T11:59:59 (3600 secs) Units are in number of jobs ran -------------------------------------------------------------------------------- Cluster Account 0-49 CPUs 50-249 CPUs 250-499 CPUs 500-999 CPUs >= 1000 CPUs % of cluster --------- --------- ------------- ------------- ------------- ------------- ------------- ------------ minesofm+ main 12 0 0 0 0 100.00% : $ sreport cluster AccountUtilizationByUser start=7/10 end=7/11 cluster=minesofmoria user=stephen format=Account,Cluster,TresCount,Login,Proper,Used -------------------------------------------------------------------------------- Cluster/Account/User Utilization 2024-07-10T00:00:00 - 2024-07-10T23:59:59 (86400 secs) Usage reported in CPU Minutes -------------------------------------------------------------------------------- Account Cluster TRES Count Login Proper Name Used --------------- --------- ---------- --------- --------------- -------- main minesofm+ stephen ,,, 38 rivendell minesofm+ stephen ,,, 1 arwen minesofm+ stephen ,,, 1 elrond minesofm+ stephen ,,, 1 : $ sreport cluster AccountUtilizationByUser start=7/23 end=7/24 cluster=minesofmoria account=main -------------------------------------------------------------------------------- Cluster/Account/User Utilization 2024-07-23T00:00:00 - 2024-07-23T23:59:59 (86400 secs) Usage reported in CPU Minutes -------------------------------------------------------------------------------- Cluster Account Login Proper Name Used Energy --------- --------------- --------- --------------- -------- -------- minesofm+ main 148 0 minesofm+ main phteven ,,, 2 0 minesofm+ main stephen ,,, 146 0 : $ sreport user topusage start=11:00 -t percent account=main -------------------------------------------------------------------------------- Top 10 Users 2024-08-19T11:00:00 - 2024-08-19T11:59:59 (3600 secs) Usage reported in Percentage of Total -------------------------------------------------------------------------------- Cluster Login Proper Name Account Used Energy --------- --------- --------------- --------------- -------- -------- minesofm+ stephen ,,, main 10.94% 0.00% minesofm+ phteven ,,, main 2.95% 0.00% (COPYING) Copyright (C) 2009-2010 Lawrence Livermore National Security. Produced at Lawrence Livermore National Laboratory (cf, DISCLAIMER). Copyright (C) 2010-2022 SchedMD LLC. (Slurm) . . << >> (GNU General Public License) << >> ( ) / . << >> << >>. . (SEE ALSO) sacct(1), slurmdbd(8) Slurm 26.05 Slurm Commands sreport(1)