Difference between revisions of "GEOS-Chem v11-02 benchmark history"
(→v11-02b HP 1-month) |
(→v11-02b HP 1-month) |
||
Line 627: | Line 627: | ||
|Meteorology fields: | |Meteorology fields: | ||
|GEOS-FP (72L), '''2x2.5''', July 2013<br> | |GEOS-FP (72L), '''2x2.5''', July 2013<br> | ||
− | '''NOTE: Input 2x2.5 met-fields are regridded to cubed-sphere grid resolution c24 (approximately equivalent to 4x5) within GCHP. In contrast, the GCC simulations in this comparison use input 4x5 met-fields. | + | '''NOTE:''' Input 2x2.5 met-fields are regridded to cubed-sphere grid resolution c24 (approximately equivalent to 4x5) within GCHP. In contrast, the GCC simulations in this comparison use input 4x5 met-fields. |
|- | |- | ||
|Cubed-sphere resolution: | |Cubed-sphere resolution: | ||
Line 652: | Line 652: | ||
# Custom | # Custom | ||
− | The out-of-the-box comparison uses as-is code and run directory settings for both GCHP and GCC. | + | The out-of-the-box comparison uses as-is code and run directory settings for both GCHP and GCC. Each simulation uses restart files regridded from higher resolution 2x2.5. GCHP uses input 2x2.5 met-fields which are regridded to cubed-sphere grid resolution c24 (approximately equivalent to 4x5) within the model. In contrast, the GCC simulations in this comparison use input 4x5 met-fields. GCC is compiled with netcdf diagnostics turned on and binary diagnostics turned off. GCHP output data are regridded from c24 (cubed-sphere grid) to 1x1.25 and GCC output data are regridded from 4x5 to 1x1.25 for comparison plotting. |
The custom comparison includes additional modifications to the GCC code base and run directory to remove certain remaining known differences between GCHP and GCC. These include the following changes to GCC: | The custom comparison includes additional modifications to the GCC code base and run directory to remove certain remaining known differences between GCHP and GCC. These include the following changes to GCC: |
Revision as of 19:16, 13 June 2017
On this page we have posted complete information about all benchmark simulations (both 1-month and 1-year) for GEOS-Chem v11-02.
Contents
1-year full-chemistry benchmarks
v11-02a-Run1
This 1-year benchmark simulation was an unofficial benchmark to validate removal partitioning of NOx biomass burning emissions directly to PAN and HNO3 from v11-02a.
Three GEOS-Chem model versions were compared to each other:
Color | Model Version | Met Type | Year | Updates affecting the benchmark simulation | Annual Mean OH [105 molec/cm3] |
---|---|---|---|---|---|
Red | v11-01k-Run0 | GEOS-FP, 72L, 4x5 |
2013 |
Updates introduced in v11-01h: Updates introduced in v11-01i: Updates introduced in v11-01j:
Updates introduced in v11-01k: |
12.004 |
Green | v11-01-public-release-Run0 | GEOS-FP, 72L, 4x5 |
2013 |
Updates introduced in v11-01 public release: |
12.001 |
Blue | v11-02a-Run1 | GEOS-FP, 72L, 4x5 |
2013 |
Updates introduced in v11-02a:
|
11.829 |
Black | Observations |
The output plots for Run0 may be downloaded from:
ftp ftp.as.harvard.edu cd gcgrid/geos-chem/1yr_benchmarks/v11-02/v11-02a/Run1/output mget *
You may also view the PDF files online by pointing your browser to
http://ftp.as.harvard.edu/gcgrid/geos-chem/1yr_benchmarks/v11-02/v11-02a/Run1/output/
Please also view the following pages comparing this version to past 1-year benchmarks:
--Melissa Sulprizio (talk) 16:37, 1 June 2017 (UTC)
v11-02a-Run0
This 1-year benchmark simulation was approved by the GEOS-Chem Steering Committee on 12 May 2017, with the recommendation to remove partitioning of NOx biomass burning emissions directly to PAN and HNO3.
Three GEOS-Chem model versions were compared to each other:
The output plots for Run0 may be downloaded from:
ftp ftp.as.harvard.edu cd gcgrid/geos-chem/1yr_benchmarks/v11-02/v11-02a/Run0/output mget *
You may also view the PDF files online by pointing your browser to
http://ftp.as.harvard.edu/gcgrid/geos-chem/1yr_benchmarks/v11-02/v11-02a/Run0/output/
Please also view the following pages comparing this version to past 1-year benchmarks:
--Melissa Sulprizio (talk) 18:14, 10 May 2017 (UTC)
1-month benchmarks
v11-02b
This section includes the assessment form for the 1-month benchmark simulation of v11-02b.
New in this version: See also the assessment form for the 1-month benchmark of v11-02b with high performance option (GCHP).
Description | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
New features added into GEOS-Chem |
| ||||||||||||||
Version, resolution, met fields used: | v11-02, GEOS-FP (72L), 4x5, July 2013 | ||||||||||||||
1-month benchmark finished on: | Thurs June 07 23:08:02 EDT 2017 | ||||||||||||||
Performance statistics: |
| ||||||||||||||
Compared to previous benchmark: | v11-02a | ||||||||||||||
This update will impact: (select all that apply with boldface) |
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify): | ||||||||||||||
Unit test results may be viewed at: | http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-02/v11-02b/v11-02b.results.html | ||||||||||||||
Plots may be viewed at: | http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-02/v11-02b/ | ||||||||||||||
Comparison with high performance option enabled: (new in this version) |
We now include a plots subdirectory called gchp_comparison containing 1-month standard simulation output comparisons using the standard "classic" capabilities (GCC) and the high performance option (GCHP). GCHP features the same science as GCC but operates on a cubed-sphere grid and is parallelized using a message-passing interface (MPI) implementation. GCHP improves upon GCC by (1) enabling more accurate transport through elimination of the polar singularity inherent to lat-lon grids, and (2) providing efficient scaling across multiple machines making finer resolution global simulations possible. There is a separate benchmark approval form for the comparison of GCHP and GCC. See the Assessment form for the 1-month benchmark of v11-02b with high performance option. | ||||||||||||||
Metrics | |||||||||||||||
Global mean OH (from log file): | 12.3818817518568 x 105 molec/cm3 | ||||||||||||||
Methyl chloroform lifetime: | 5.0764 years | ||||||||||||||
Did either of these change by more than 5%? | No, both values are identical to values of the previous version. | ||||||||||||||
At the SURFACE, list all species that changed by 10% or more: | none | ||||||||||||||
Comments on SURFACE differences: | none | ||||||||||||||
At 500 hPa, list all species that changed by 10% or more: | none | ||||||||||||||
Comments on 500 hPa differences: | No differences. | ||||||||||||||
In the ZONAL MEAN differences, list all species that changed by 10% or more: | none | ||||||||||||||
Comments on ZONAL MEAN differences: | No differences. | ||||||||||||||
In the EMISSION RATIO maps, list all species that changed by 10% or more: | none | ||||||||||||||
Comments on EMISSION RATIO differences: | none | ||||||||||||||
Additional or summary comments: | As expected, merging in the modifications for GCHP has zero impact on the GEOS-Chem "classic" standard simulation. | ||||||||||||||
Approval | |||||||||||||||
Requires further investigation: | No | ||||||||||||||
Approved by: | Lizzie Lundgren (GCST) | ||||||||||||||
Date of approval: | 13 June 2017 |
--Lizzie Lundgren (talk) 18:54, 13 June 2017 (UTC)
v11-02a
Here is the assessment form for 1-month benchmark simulation v11-02a.
Description | |||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
New features added into GEOS-Chem |
| ||||||||||||||||||||||||||||||||||||||||||||||
Version, resolution, met fields used: | v11-02, GEOS-FP (72L), 4x5, July 2013 | ||||||||||||||||||||||||||||||||||||||||||||||
1-month benchmark finished on: | Sun Apr 16 01:37:36 EDT 2017 | ||||||||||||||||||||||||||||||||||||||||||||||
Performance statistics: |
| ||||||||||||||||||||||||||||||||||||||||||||||
Compared to previous benchmark: | v11-01 public release | ||||||||||||||||||||||||||||||||||||||||||||||
This update will impact: (select all that apply with boldface) |
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify): | ||||||||||||||||||||||||||||||||||||||||||||||
Unit test results may be viewed at: | http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-02/v11-02a/v11-02a.results.html | ||||||||||||||||||||||||||||||||||||||||||||||
Plots may be viewed at: | http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-02/v11-02a/ | ||||||||||||||||||||||||||||||||||||||||||||||
Metrics | |||||||||||||||||||||||||||||||||||||||||||||||
Global mean OH (from log file): | 12.3128108012973 x 105 molec/cm3 | ||||||||||||||||||||||||||||||||||||||||||||||
Methyl chloroform lifetime: | 5.1159 years | ||||||||||||||||||||||||||||||||||||||||||||||
Did either of these change by more than 5%? | No. Mean OH changed by -2.57% and MCF lifetime changed by 2.94%. These changes were primarily caused by two updates:
| ||||||||||||||||||||||||||||||||||||||||||||||
At the SURFACE, list all species that changed by 10% or more: | NO, O3, PAN, CO, ALK4, ISOP, HNO3, H2O2, ACET, MEK, ALD2, RCHO, MVK, MACR, PMN, PPN, R4N2, PRPE, C3H8, CH2O, C2H6, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, CHBr3, MPN, ISOPND, ISOPNB, MOBA, PROPNN, HAC, GLYC, MVKN, MACRN, RIP, IEPOX, MAP, NO2, NO3, HNO2, BrCl, HCl, Cl, ClO, HOCl, ClNO3, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG2, TSOG0, TSOA1, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOG1, ASOG2, ASO3G3, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2 | ||||||||||||||||||||||||||||||||||||||||||||||
Comments on SURFACE differences: |
Below we summarize the notable changes caused by specific updates. Update chemistry rate constants based on JPL Publication 15-10
Monthly mean NEI2011 emissions
Bug fixes in the GEOS-Chem sulfate module:
Fix bug in dry deposition aerodynamic resistance
The following updates impacted species concentrations slightly, but the changes did not amount to >10%. | ||||||||||||||||||||||||||||||||||||||||||||||
At 500 hPa, list all species that changed by 10% or more: | NO, PAN, CO, ALK4, ISOP, HNO3, H2O2, ACET, MEK, ALD2, RCHO, MVK, MACR, PMN, PPN, R4N2, PRPE, C3H8, CH2O, C2H6, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, CHBr3, MPN, ISOPND, ISOPNB, MOBA, PROPNN, HAC, GLYC, MVKN, MACRN, RIP, IEPOX, MAP, NO2, NO3, HNO2, BrCl, Cl, ClO, HOCl, ClNO3, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG2, TSOG0, TSOA1, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOG1, ASOG2, ASO3G3, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2 | ||||||||||||||||||||||||||||||||||||||||||||||
Comments on 500 hPa differences: | See comments on surface differences. | ||||||||||||||||||||||||||||||||||||||||||||||
In the ZONAL MEAN differences, list all species that changed by 10% or more: | NO, PAN, ALK4, ISOP, HNO3, H2O2, MEK, ALD2, RCHO, MVK, MACR, PMN, PPN, PRPE, C3H8, CH2O, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, Br2, Br, BrO, HOBr, HBr, BrNO2, CHBr3, MPN, ISOPND, ISOPNB, MOBA, HAC, GLYC, MVKN, MACRN, RIP, IEPOX, MAP, NO2, NO3, HNO2, BrCl, Cl, ClO, HOCl, ClNO3, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG3, TSOG0, TSOA1, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOG1, ASOG2, ASOG3, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2 | ||||||||||||||||||||||||||||||||||||||||||||||
Comments on ZONAL MEAN differences: | See comments on surface differences. | ||||||||||||||||||||||||||||||||||||||||||||||
In the EMISSION RATIO maps, list all species that changed by 10% or more: |
| ||||||||||||||||||||||||||||||||||||||||||||||
Comments on EMISSION RATIO differences: |
| ||||||||||||||||||||||||||||||||||||||||||||||
Additional or summary comments: | Removal of biomass burning updates
After the 1-month benchmark for v11-02a, the GCSC decided we should remove the code updates for vertically distributed biomass burning emissions (see this wiki post for more details). In addition, after the 1-year benchmark v11-02a-Run0, the GCSC asked that we comment out the partitioning of NOx biomass burning emissions directly to PAN and HNO3 (see this wiki post for more details). An unofficial 1-month benchmark was run for v11-02a to evaluate the model changes with these two biomass burning updates removed. The plots for that run may be viewed at: Results from our v11-02a benchmark using the GNU Fortran Compiler In order to evaluate the performance of GEOS-Chem using the the free and open source GNU Fortran compiler, we performed an additional 1-month benchmark for v11-02a. For this additional benchamark, we used GNU Fortran v6.2.0 to compile GEOS-Chem instead of our usual Intel Fortran Compiler version 11.1.069. For more details, see this post on our GNU Fortran compiler wiki page. Summary: The benchmark using GNU Fortran yielded essentially identical results to the benchmark using Intel Fortran. This is very encouraging, as it will allow GEOS-Chem development to take place on computational platforms that do not have proprietary compilers (such as Intel Fortran or PGI Fortran), which can be prohibitively expensive to purchase. | ||||||||||||||||||||||||||||||||||||||||||||||
Approval | |||||||||||||||||||||||||||||||||||||||||||||||
Requires further investigation: | Yes, a 1-year benchmark simulation | ||||||||||||||||||||||||||||||||||||||||||||||
Approved by: | Emily Fischer, Prasad Kasibhatla, Brian Boys, Daniel Jacob | ||||||||||||||||||||||||||||||||||||||||||||||
Date of approval: | 24 Apr 2017 |
--Melissa Sulprizio (talk) 19:27, 20 April 2017 (UTC)
1-year Rn-Pb-Be benchmarks
TBD
High Performance Option benchmarks
v11-02b HP 1-month
This section includes the assessment form for the 1-month benchmark simulation GEOS-Chem v11-02b with high performance v1.1.0. GCHP features the same science as GCC but operates on a cubed-sphere grid and is parallelized using a message-passing interface (MPI) implementation. GCHP improves upon GCC by (1) enabling more accurate transport through elimination of the polar singularity inherent to lat-lon grids, and (2) providing efficient scaling across multiple machines making finer resolution global simulations possible.
See also the assessment form for the 1-month v11-02b benchmark simulation using the standard "classic" capability..
Description | |
---|---|
New features added: |
As this is the first formal benchmark, new features include the high performance model capability in its entirety. This includes all recent feature updates included in v1.1.0 as well as updates in v1.0.0 that were introduced over many years and are too numerous to list. |
GEOS-Chem version, GCHP version tag: | v11-02, hp_v1.1.0 |
Meteorology fields: | GEOS-FP (72L), 2x2.5, July 2013 NOTE: Input 2x2.5 met-fields are regridded to cubed-sphere grid resolution c24 (approximately equivalent to 4x5) within GCHP. In contrast, the GCC simulations in this comparison use input 4x5 met-fields. |
Cubed-sphere resolution: | c24 |
1-month benchmark finished on: | Thurs June 12 22:01:08 EDT 2017 |
Performance statistics: |
|
Compared to benchmark: | GEOS-Chem v11-02b with "classic" capability |
Additional comments: |
We compared GEOS-Chem with and without the high performance option (GCHP and GCC respectively) for two different scenarios:
The out-of-the-box comparison uses as-is code and run directory settings for both GCHP and GCC. Each simulation uses restart files regridded from higher resolution 2x2.5. GCHP uses input 2x2.5 met-fields which are regridded to cubed-sphere grid resolution c24 (approximately equivalent to 4x5) within the model. In contrast, the GCC simulations in this comparison use input 4x5 met-fields. GCC is compiled with netcdf diagnostics turned on and binary diagnostics turned off. GCHP output data are regridded from c24 (cubed-sphere grid) to 1x1.25 and GCC output data are regridded from 4x5 to 1x1.25 for comparison plotting. The custom comparison includes additional modifications to the GCC code base and run directory to remove certain remaining known differences between GCHP and GCC. These include the following changes to GCC:
NOTE: Non-concentration diagnostics are not yet implemented in GCHP. The v11-02b HP benchmark therefore includes only comparisons of concentrations. A complete set of diagnostics will be available pending implementation of netCDF diagnostics in GEOS-Chem (in progress). |
Plots may be viewed at: | http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-02/v11-02b/gchp_comparisons/ |
Metrics | |
Global mean OH: | Diagnostic not yet implemented. See note in additional comments section above. |
Methyl chloroform lifetime: | Diagnostic not yet implemented. See note in additional comments section above. |
Did either of these change by more than 5%? | N/A |
At the SURFACE, list all species that changed by 10% or more: | |
Comments on SURFACE differences: | |
At 500 hPa, list all species that changed by 10% or more: | |
Comments on 500 hPa differences: | |
In the ZONAL MEAN differences, list all species that changed by 10% or more: | |
Comments on ZONAL MEAN differences: | |
Additional or summary comments: | |
Approval | |
Requires further investigation: | TBD |
Approved by: | TBD |
Date of approval: | TBD |
--Lizzie Lundgren (talk) 18:05, 13 June 2017 (UTC)