Difference between revisions of "GCHP Timing Tests"

From Geos-chem
Jump to: navigation, search
(Reported Model Runs)
(Performing the Timing Tests)
Line 8: Line 8:
 
== Performing the Timing Tests ==
 
== Performing the Timing Tests ==
  
Follow instructions on [[Getting_Started_With_GCHP|Getting Started with GCHP]] to install GCHP using GEOS-Chem 12.0.0, acquire a run directory using the GEOS-Chem Unit Tester, and compile source code. We are interested in the results of a 7-day c24 GCHP simulation run on a single node with 6, 12, and 24 cores. Feel free to perform additional tests using any number of nodes and cores and for any internal resolution and record your results as supplementary information on this page.  
+
Follow instructions on [[Getting_Started_With_GCHP|Getting Started with GCHP]] to install GCHP using GEOS-Chem 12.0.0, acquire a run directory using the GEOS-Chem Unit Tester, and compile source code. We are interested in the results of a 7-day GCHP simulations run on any number of cores and at any grid resolution.
  
GCHP timing information is displayed at the end of the <tt>GCHP.log</tt> log file. The output can be interpreted as follows:
+
GCHP timing information is displayed at the end of the <tt>GCHP.log</tt> log file. Please report the numbers for items in red below.
  
User time = GCHP Total + ExtData Total + HIST Total + COMM_TOTAL
+
Total time for GEOS-Chem core components, in seconds:
   
+
  Times for GIGCchem
where,
+
  TOTAL                  :  16195.289
*User time is total run time and is in section with “----“ headers
+
INITIALIZE              :      64.237
*GCHP = GIGCchem + Dynamics + GIGCenv (each with their own breakdown sections except GIGCenv)
+
RUN                    :  16010.216
*GIGCchem = the time for GEOS-Chem “classic” code (e.g. DO_CHEMISTRY)
+
FINALIZE                :      0.000
*ExtData is the input and regridding time
+
DO_CHEM                :  15682.849
*HIST is the output time
+
CP_BFRE                :      7.515
*COMM is the communication time listed until total time  
+
CP_AFTR                :    172.251
 +
GC_CONV                :    1062.171
 +
GC_EMIS                :    846.439
 +
GC_DRYDEP              :      5.876
 +
GC_FLUXES              :      0.000
 +
GC_TURB                :    802.816
 +
GC_CHEM                :  12009.869
 +
GC_WETDEP              :    729.897
 +
GC_DIAGN                :      0.000
 +
GenInitTot              :      49.299
 +
--GenInitMine          :      49.299
 +
GenRunTot              :      0.000
 +
--GenRunMine            :      0.000
 +
GenFinalTot            :      35.596
 +
--GenFinalMine          :      35.596
 +
GenRecordTot            :      25.848
 +
--GenRecordMine        :      25.845
 +
GenRefreshTot          :      0.000
 +
  --GenRefreshMine        :      0.000
  
We are most interested in the total time (user time) and the times for ExtData, dynamics (transport), chemistry, emissions, and convection. Please contact the GCST if you have trouble determining what lines to look at for retrieving the times for these components.
+
Total run-time, in seconds:
 +
  -----------------------------------------------------
 +
      Block          User time System Time  Total Time
 +
  -----------------------------------------------------
 +
  TOTAL                    34848.6779      0.0000  34848.6779
 +
  COMM_TOTAL                552.8329      0.0000    552.8329
 +
  COMM_TRAC                  552.8318      0.0000    552.8318
 +
  FV_TP_2D                  6004.5731      0.0000    6004.5731
 +
 
 +
Total time for advection, in seconds:
 +
  Times for DYNAMICS
 +
TOTAL                  :    7645.593
 +
INITIALIZE              :      1.029
 +
RUN                    :    7645.563
 +
FINALIZE                :      0.000
 +
GenInitTot              :      0.012
 +
--GenInitMine          :      0.012
 +
GenRunTot              :      0.000
 +
--GenRunMine            :      0.000
 +
GenFinalTot            :      0.000
 +
--GenFinalMine          :      0.000
 +
GenRecordTot            :      0.008
 +
--GenRecordMine        :      0.006
 +
GenRefreshTot          :      0.000
 +
--GenRefreshMine        :      0.000
 +
 
 +
Total time for MAPL History, in seconds:
 +
  Times for HIST
 +
TOTAL                  :    211.554
 +
Initialize              :      4.994
 +
Finalize                :      0.142
 +
Run                    :    206.592
 +
--Couplers              :      54.423
 +
--I/O                  :    152.310
 +
----IO Create          :      1.789
 +
----IO Write            :    152.310
 +
-----IO Post            :      5.638
 +
-----IO Wait            :      40.447
 +
-----IO Write          :    110.306
 +
-ParserRun              :      0.000
 +
GenInitTot              :      0.000
 +
--GenInitMine          :      0.000
 +
GenRunTot              :      0.000
 +
--GenRunMine            :      0.000
 +
GenFinalTot            :      0.002
 +
--GenFinalMine          :      0.002
 +
GenRecordTot            :      0.000
 +
--GenRecordMine        :      0.000
 +
GenRefreshTot          :      0.000
 +
--GenRefreshMine        :      0.000
 +
 
 +
Total time for MAPL ExtData, in seconds:
 +
  Times for EXTDATA
 +
TOTAL                  :    2840.095
 +
Initialize              :      8.410
 +
Run                    :    2831.698
 +
-Read_Loop              :    2800.662
 +
--CheckUpd              :      6.597
 +
--Read                  :    2702.010
 +
--Swap                  :      1.650
 +
--Bracket              :      99.195
 +
-Interpolate            :      31.540
 +
GenInitTot              :      0.007
 +
--GenInitMine          :      0.006
 +
GenRunTot              :      0.005
 +
--GenRunMine            :      0.003
 +
GenFinalTot            :      0.006
 +
--GenFinalMine          :      0.006
 +
GenRecordTot            :      0.000
 +
--GenRecordMine        :      0.000
 +
GenRefreshTot          :      0.000
 +
--GenRefreshMine        :      0.000
  
 
== Reported Model Runs ==
 
== Reported Model Runs ==

Revision as of 18:02, 29 August 2018

GCHP Home

Overview

This page features reports of user timing tests done with High Performance GEOS-Chem (GCHP). If you are running GCHP please add your own results below. You can sign up for a wiki account to edit this page or you can send your information to the GEOS-Chem Support Team.

Performing the Timing Tests

Follow instructions on Getting Started with GCHP to install GCHP using GEOS-Chem 12.0.0, acquire a run directory using the GEOS-Chem Unit Tester, and compile source code. We are interested in the results of a 7-day GCHP simulations run on any number of cores and at any grid resolution.

GCHP timing information is displayed at the end of the GCHP.log log file. Please report the numbers for items in red below.

Total time for GEOS-Chem core components, in seconds:

 Times for GIGCchem
TOTAL                   :   16195.289
INITIALIZE              :      64.237 
RUN                     :   16010.216
FINALIZE                :       0.000
DO_CHEM                 :   15682.849
CP_BFRE                 :       7.515
CP_AFTR                 :     172.251
GC_CONV                 :    1062.171
GC_EMIS                 :     846.439
GC_DRYDEP               :       5.876
GC_FLUXES               :       0.000
GC_TURB                 :     802.816
GC_CHEM                 :   12009.869
GC_WETDEP               :     729.897
GC_DIAGN                :       0.000
GenInitTot              :      49.299
--GenInitMine           :      49.299
GenRunTot               :       0.000
--GenRunMine            :       0.000 
GenFinalTot             :      35.596
--GenFinalMine          :      35.596
GenRecordTot            :      25.848
--GenRecordMine         :      25.845
GenRefreshTot           :       0.000
--GenRefreshMine        :       0.000

Total run-time, in seconds:

  -----------------------------------------------------
     Block          User time  System Time   Total Time
  -----------------------------------------------------
  TOTAL                    34848.6779       0.0000   34848.6779
  COMM_TOTAL                 552.8329       0.0000     552.8329
  COMM_TRAC                  552.8318       0.0000     552.8318
  FV_TP_2D                  6004.5731       0.0000    6004.5731

Total time for advection, in seconds:

 Times for DYNAMICS
TOTAL                   :    7645.593
INITIALIZE              :       1.029
RUN                     :    7645.563
FINALIZE                :       0.000
GenInitTot              :       0.012
--GenInitMine           :       0.012
GenRunTot               :       0.000
--GenRunMine            :       0.000
GenFinalTot             :       0.000
--GenFinalMine          :       0.000
GenRecordTot            :       0.008
--GenRecordMine         :       0.006
GenRefreshTot           :       0.000
--GenRefreshMine        :       0.000

Total time for MAPL History, in seconds:

 Times for HIST
TOTAL                   :     211.554
Initialize              :       4.994
Finalize                :       0.142
Run                     :     206.592
--Couplers              :      54.423
--I/O                   :     152.310
----IO Create           :       1.789
----IO Write            :     152.310
-----IO Post            :       5.638
-----IO Wait            :      40.447
-----IO Write           :     110.306
-ParserRun              :       0.000
GenInitTot              :       0.000
--GenInitMine           :       0.000
GenRunTot               :       0.000
--GenRunMine            :       0.000
GenFinalTot             :       0.002
--GenFinalMine          :       0.002
GenRecordTot            :       0.000
--GenRecordMine         :       0.000
GenRefreshTot           :       0.000
--GenRefreshMine        :       0.000
  

Total time for MAPL ExtData, in seconds:

 Times for EXTDATA
TOTAL                   :    2840.095
Initialize              :       8.410
Run                     :    2831.698
-Read_Loop              :    2800.662
--CheckUpd              :       6.597
--Read                  :    2702.010
--Swap                  :       1.650
--Bracket               :      99.195
-Interpolate            :      31.540
GenInitTot              :       0.007
--GenInitMine           :       0.006
GenRunTot               :       0.005
--GenRunMine            :       0.003
GenFinalTot             :       0.006
--GenFinalMine          :       0.006
GenRecordTot            :       0.000
--GenRecordMine         :       0.000
GenRefreshTot           :       0.000
--GenRefreshMine        :       0.000

Reported Model Runs

If you are running GCHP we encourage you to report performance in this section. Run settings may vary considerably with the following exceptions:

  • Jobs start on model date 2016/07/01 00:00 GMT.
  • The code was compiled from the standard GCHP run directory (gchp_standard) with the option make compile_clean.

Enter your system information in the top table to the best of your knowledge and your simulation information in the bottom table. Use a unique id to cross-reference between the two.

Enter your system information here:

ID Organization Cluster Partition OS Network interconnect CPU Vendor CPU Model CPU Speed [MHz] Compiler MPI NetCDF Filesystem info
000 Harvard Odyssey huce_intel CentOS 7 Infiniband Intel Xeon 2.10GHz gcc 7.1.0 openmpi 3.1.1 netcdf 4.1.3 LFS
001 Harvard Odyssey huce_intel CentOS 7 Infiniband Intel Xeon 2.10GHz ifort 17 openmpi 3.1.1 netcdf 4.1.3 LFS


Enter your simulation information here:

User ID GEOS-Chem version # nodes # cores Simulation Duration Met source Met res Grid res Dyn timestep [min] Chem timestep [min] # diagnostics Diag freq Diag Duration Total time (s) Dyn time (s) Chem time (s) Hist time (s) ExtData time (s)
Lizzie Lundgren 000 12.0.1 3 48 standard 7 days GEOS-FP 0.25x0.3125 c48 10 20 default 24hr 24hr 34848 7645 16195 211 2840

Graphs of Model Run Times

These will be generated when we have a critical mass of data.