Benchmark/GEOS-Chem 12.5.0: Difference between revisions
Line 504: | Line 504: | ||
*GCHP 12.5.0 currently has a slow memory leak due to updates to MAPL ExtData. NASA is aware of the issue and will be developing a fix soon. The memory leak is more pronounced for long simulations and can result in a simulation crashing due to exceeding memory available. Breaking up long runs into smaller consecutive runs avoids the issue but we find that doing so changes the output. Lizzie Lundgren (GCST) is investigating differences in GCHP output that happen when restarting a simulation, which may or may not be a problem with GEOS-Chem Classic as well. We are documenting all single versus multi-run differences at [http://ftp.as.harvard.edu/gcgrid/geos-chem/validation/multi_vs_single_run/ http://ftp.as.harvard.edu/gcgrid/geos-chem/validation/multi_vs_single_run/]. Look there to assess if the scale of the differences would be a problem for you. | *GCHP 12.5.0 currently has a slow memory leak due to updates to MAPL ExtData. NASA is aware of the issue and will be developing a fix soon. The memory leak is more pronounced for long simulations and can result in a simulation crashing due to exceeding memory available. Breaking up long runs into smaller consecutive runs avoids the issue but we find that doing so changes the output. Lizzie Lundgren (GCST) is investigating differences in GCHP output that happen when restarting a simulation, which may or may not be a problem with GEOS-Chem Classic as well. We are documenting all single versus multi-run differences at [http://ftp.as.harvard.edu/gcgrid/geos-chem/validation/multi_vs_single_run/ http://ftp.as.harvard.edu/gcgrid/geos-chem/validation/multi_vs_single_run/]. Look there to assess if the scale of the differences would be a problem for you. | ||
*GCHP 12.5.0 uses online ESMF regridding weights rather than external tile files for regridding. Due to ESMF domain decomposition rules this can result in a MAPL error if an input grid is too coarse for a run’s configured core count. We have seen this problem for 4°x5° input files when using >600 cores. GMAO has fixed this problem in a more recent version of MAPL. All 4°x5° input files are replaced with higher resolution files for GCHP 12.5.0 to avoid this issue. However, users may still run into problems if running with thousands of cores. | *GCHP 12.5.0 uses online ESMF regridding weights rather than external tile files for regridding. Due to ESMF domain decomposition rules this can result in a MAPL error if an input grid is too coarse for a run’s configured core count. We have seen this problem for 4°x5° input files when using >600 cores. GMAO has fixed this problem in a more recent version of MAPL. All 4°x5° input files are replaced with higher resolution files for GCHP 12.5.0 to avoid this issue. However, users may still run into problems if running with thousands of cores. | ||
*There is a positive bias in surface ozone over the | *There is a positive bias in surface ozone over the Southern Ocean in GCHP. It shows in comparisons with both GCC 12.5.0 and GCHP 12.4.0. The issue is resolution-dependent and occurs in FV3. An issue has been created on GEOS github for this: https://github.com/GEOS-ESM/GEOSgcm_GridComp/issues/48. To evaluate this bias at different resolutions, we also ran and GCHP 12.5.0 benchmark at c24. Results from that simulation may be viewed at [http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.5.0/GCHP_c24/plots/ this link]. | ||
|-bgcolor="#cccccc" | |-bgcolor="#cccccc" | ||
!Approval | !Approval |
Revision as of 17:18, 13 September 2019
This page includes information about all benchmark simulations for GEOS-Chem 12.5.0 (DOI: 10.5281/zenodo.3403111).
GEOS-Chem Classic 1-month benchmark
Benchmark plots
Enable PDF bookmarks1 in the files linked below to navigate between species. See the Species in GEOS-Chem wiki page for species definitions and details.
Species Category2 | Plots | Additional Information | ||||
---|---|---|---|---|---|---|
Level Map | Zonal Mean | Emissions | ||||
Oxidants
O3, CO, OH, NOx |
sfc | 500hPa | full column | stratosphere | sfc | |
Aerosols
NH4, NIT, SO4, DST1, DST2, DST3, DST4, BC, OC, AERI, BrSALA, BrSALC, ISALA, ISALC, NITs, SALA, SALC, SO4s, SOA_Simple, SOA_Complex |
sfc | 500hPa | full column | stratosphere | sfc | AOD |
Bromine
Bry, BrOx, Br, Br2, BrCl, BrNO2, BrNO3, BrO, CH4Br, CH2Br2, CH2Br2, CH3Br3, HOBr, HBr |
sfc | 500hPa | full column | stratosphere | sfc | |
Chlorine
Cly, ClOx, Cl, ClO, Cl2, Cl2O2, ClOO, ClNO2, ClNO3, CCl4, CFCs, CH3Cl, CH2Cl2, CH4CCl3, HOCl, HCl, Halons, HCFCs, OClO |
sfc | 500hPa | full column | stratosphere | -- | |
Iodine
Iy, IxOy, I, I2, IBr, ICl, IO, INO2, IONO2, CH3I, CH2I2, CH2ICl, CH2IBr, HI, HOI, OIO |
sfc | 500hPa | full column | stratosphere | sfc | |
Nitrogen
NOy, NOx, HNO2, HNO3, HNO4, IMPN, NIT, NO, NO2, NO3, N2O5, MPN, PAN, PPN, N2O, NHx, NH3, NH4 |
sfc | 500hPa | full column | stratosphere | sfc | |
Primary Organics
ALK4, BENZ, CH4, C2H6, C2H4, C3H8, PRPE, TOLU, XYLE, ISOP, MTPA, MTPO, LIMO, GLYX, HCOOH, MAP, MBO, MOH, RCHO |
sfc | 500hPa | full column | stratosphere | sfc | |
Secondary Organics
ACET, MEK, MVK, ALD2, CH2O, HPALD, MP, ISOPN, IEPOX, ACTA, EOH, MOH |
sfc | 500hPa | full column | stratosphere | sfc | |
Secondary Organic Aerosols
SOAP, SOAS, TSOA0, TSOA1, TSOA2, TSOA3, ISOA1, ISOA2, ISOA3, ASOA1, ASOA2, ASOA3, ASOAN, TSOG0, TSOG1, TSOG2, TSOG3, ISOG1, ISOG2, ISOG3, ASOG1, ASOG2, ASOG3, INDIOL, ISN1OA, LVOCOA, SOAIE, SOAGX, SOAME, SOAMG |
sfc | 500hPa | full column | stratosphere | sfc | |
Sulfur
SOx, DMS, OCS, SO2, SO4 |
sfc | 500hPa | full column | stratosphere | sfc | |
ROy
H2O2, H, H2, H2O, HO2, O1D, OH, RO2 |
sfc | 500hPa | full column | stratosphere | -- | |
J-values | sfc | 500hPa | full column | stratosphere | -- | -- |
Emissions by HEMCO category |
Total, Aircraft, Anthropogenic, Biomass Burning, Biogenic, Lightning, Natural, Ocean, Seabirds, Decaying Plants, Ship, Soil, Degassing Volcanoes, Erupting Volcanoes | |||||
Emission totals | ||||||
Global mass | ||||||
Budget | Ox and CO budgets |
1All plots created with GCPy have PDF bookmarks. If you do not see them in your browser try using a different browser (not Safari) or installing an Adobe Acrobat plug-in.
2Species category and lumped species definitions are simple to adjust. Updating them requires only editing the json files.
Benchmark assessment form
Description | |
---|---|
New features added into GEOS-Chem | |
Version, resolution, met fields used: | GEOS-FP (72L), 4x5, July 2016 |
1-month benchmark finished on: | Wed Aug 28 03:28:34 EDT 2019 |
Performance statistics: |
|
Compared to previous benchmark: | 12.4.0 |
This update will impact: (select all that apply with boldface) |
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Emissions, Photolysis, Chemistry, Other (please specify): Diagnostics |
Unit test results may be viewed at: | http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.5.0/GCC/Plots/GC_12.5.0_Aug08.results.html |
Metrics | |
Global mean OH from log file (% change): | 12.3915975939893 x 105 molec/cm3 (-0.65%) |
Methyl chloroform lifetime (% change): | 4.9487 (1.06%) |
Methane lifetime (% change): | 8.3312 years (1.10%) |
List all SURFACE species, J-Values, and COLUMN AOD values that changed by 10% or more: |
|
List all 500 hPa species and J-Values that changed by 10% or more : |
|
List all ZONAL MEAN species and J-Values that changed by 10% or more: |
|
List all EMISSIONS that changed by 10% or more: |
|
Comments on observed differences: | Below we summarize the notable changes caused by specific updates.
Retire obsolete emission inventories
############################################################################### ### Emissions totals ### ### Ref = GC_12.4.0; Dev = GC_12.5.0 ### ############################################################################### Ref Dev Dev - Ref ACET Anthro : 0.171664 0.069874 -0.101790 Tg C ALD2 Anthro : 0.042310 0.042140 -0.000169 Tg C ALK4 Anthro : 2.407840 2.572299 0.164460 Tg C BCPI Anthro : 0.106725 0.106747 0.000021 Tg BCPO Anthro : 0.426900 0.426986 0.000086 Tg C2H6 Anthro : 0.473419 0.664990 0.191571 Tg C C3H8 Anthro : 0.399813 0.595361 0.195548 Tg C CH2O Anthro : 0.263482 0.235037 -0.028445 Tg CO Anthro : 42.984464 40.778317 -2.206146 Tg HAC Anthro : 0.212160 0.042432 -0.169728 Tg HCOOH Anthro : 0.577087 0.571744 -0.005343 Tg MEK Anthro : 0.043368 0.064733 0.021364 Tg C NH3 Anthro : 4.430414 4.592343 0.161929 Tg NO Anthro : 5.543591 5.293092 -0.250499 Tg OCPI Anthro : 0.628814 0.610537 -0.018278 Tg OCPO Anthro : 0.628815 0.610537 -0.018278 Tg pFe Anthro : 0.006943 0.006628 -0.000315 Tg PRPE Anthro : 0.490600 0.448865 -0.041735 Tg C SO2 Anthro : 6.974655 7.092453 0.117797 Tg SO4 Anthro : 0.218581 0.210372 -0.008208 Tg SOAP Anthro : 2.978745 2.826521 -0.152224 Tg TOLU Anthro : 0.584716 0.553756 -0.030960 Tg C CO Ship : 0.079328 0.059695 -0.019634 Tg HNO3 Ship : 1.484222 1.449563 -0.034659 Tg NO Ship : 0.081681 0.082875 0.001195 Tg NO2 Ship : 0.771094 0.738918 -0.032176 Tg SO2 Ship : 0.805693 0.773045 -0.032648 Tg SOAP Ship : 0.005474 0.004119 -0.001355 Tg
############################################################################### ### Inventory totals for OFFLINEBIOVOC ### ### Ref = GC_12.4.0; Dev = GC_12.5.0 ### ############################################################################### Ref Dev Dev - Ref OFFLINEBIOVOC ACET : 2.677313 2.982478 0.305164 Tg C OFFLINEBIOVOC ALD2 : 1.032241 1.037183 0.004942 Tg C OFFLINEBIOVOC CO : 5.504973 nan nan Tg C OFFLINEBIOVOC EOH : 0.987091 0.991817 0.004726 Tg C OFFLINEBIOVOC ISOP : 35.759849 33.723910 -2.035939 Tg C OFFLINEBIOVOC LIMO : 1.022397 0.976173 -0.046225 Tg C OFFLINEBIOVOC MTPA : nan 8.644930 nan Tg C OFFLINEBIOVOC MTPO : nan 4.000710 nan Tg C OFFLINEBIOVOC PRPE : 2.126864 2.030293 -0.096571 Tg C OFFLINEBIOVOC SOAP : 0.621433 1.467334 0.845901 Tg C OFFLINEBIOVOC SOAS : 0.621433 1.467334 0.845901 Tg C
############################################################################### ### Inventory totals for VOLCANO ### ### Ref = GC_12.4.0; Dev = GC_12.5.0 ### ############################################################################### Ref Dev Dev - Ref VOLCANOerupt SO2 : 0.000000 0.035000 0.035000 Tg VOLCANOdegas SO2 : 1.509524 1.951957 0.442434 Tg
############################################################################### ### Inventory totals for DICEAfrica ### ### Ref = GC_12.4.0; Dev = GC_12.5.0 ### ############################################################################### Ref Dev Dev - Ref DICEAfrica BCPI : 0.004131 0.004153 0.000022 Tg DICEAfrica BCPO : 0.016526 0.016612 0.000086 Tg DICEAfrica CH2O : 0.044793 0.016348 -0.028445 Tg DICEAfrica CO : 5.651943 3.648702 -2.003242 Tg DICEAfrica HAC : 0.212160 0.042432 -0.169728 Tg DICEAfrica HCOOH : 0.006679 0.001336 -0.005343 Tg DICEAfrica NH3 : 0.294221 0.284477 -0.009744 Tg DICEAfrica NO : 0.153533 0.151820 -0.001713 Tg DICEAfrica OCPI : 0.035185 0.016907 -0.018278 Tg DICEAfrica OCPO : 0.035185 0.016907 -0.018278 Tg DICEAfrica PRPE : 0.057572 0.019730 -0.037842 Tg DICEAfrica SOAP : 0.389982 0.251758 -0.138224 Tg DICEAfrica TOLU : 0.054817 0.020857 -0.033960 Tg
############################################################################### ### Inventory totals for AFCID ### ### Ref = GC_12.5.0; Dev = GC_12.5.0 ### ############################################################################### Ref Dev Dev - Ref AFCID DST1 : nan 1.087876 nan Tg
|
Comments on additional differences in GCHP: |
GCHP 12.5.0 uses MAPL version tag "gchp/v1.0.0" released in early 2019. The MAPL library, which is developed by NASA, is a wrapper for the Earth System Modeling Framework (ESMF), and handles not only I/O but also passing of data between components. With this version update GCHP input speed executes roughly 3-4 times faster than previous versions! This speed-up is due to parallelization within input read across one node, and the MAPL updates in this version are just the beginning of improvements to GCHP I/O bottlenecks. While we are encouraged by the improvements to GCHP in 12.5.0, a few issues remain open until the next MAPL update later this year.
|
Approval | |
Requires further investigation: | No |
Approved by: | Jeff Pierce, Daniel Jacob |
Date of approval: | 06 Sep 2019 |
GCHP 1-month benchmark
The following sections contain validation plots for GCHP 12.5.0.
Comparison of GCHP versions
This table contains plots comparing GCHP 12.4.0 (Ref) and GCHP 12.5.0 (Dev) for a 1-month simulation.
Category | Plots | Additional Information | ||||
---|---|---|---|---|---|---|
Level Map | Zonal Mean | Emissions | ||||
Oxidants | sfc | 500hPa | full column | stratosphere | full column | |
Aerosols | sfc | 500hPa | full column | stratosphere | full column | Column AOD |
Bromine | sfc | 500hPa | full column | stratosphere | full column | |
Chlorine | sfc | 500hPa | full column | stratosphere | -- | |
Iodine | sfc | 500hPa | full column | stratosphere | full column | |
Nitrogen | sfc | 500hPa | full column | stratosphere | full column | |
Primary Organics | sfc | 500hPa | full column | stratosphere | full column | |
Secondary Organics | sfc | 500hPa | full column | stratosphere | full column | |
Sulfur | sfc | 500hPa | full column | stratosphere | full column | |
Emissions by HEMCO category |
Aircraft,
Anthro,
Bioburn,
Biogenic, |
Emission totals |
Comparison of GCHP and GEOS-Chem Classic
This table contains plots comparing GEOS-Chem Classic 12.5.0 (Ref) against GCHP 12.5.0 (Dev) for a 1-month simulation.
Category | Plots | Additional Information | ||||
---|---|---|---|---|---|---|
Level Map | Zonal Mean | Emissions | ||||
Oxidants | sfc | 500hPa | full column | stratosphere | full column | |
Aerosols | sfc | 500hPa | full column | stratosphere | full column | Column AOD |
Bromine | sfc | 500hPa | full column | stratosphere | full column | |
Chlorine | sfc | 500hPa | full column | stratosphere | -- | |
Iodine | sfc | 500hPa | full column | stratosphere | full column | |
Nitrogen | sfc | 500hPa | full column | stratosphere | full column | |
Primary Organics | sfc | 500hPa | full column | stratosphere | full column | |
Secondary Organics | sfc | 500hPa | full column | stratosphere | full column | |
Sulfur | sfc | 500hPa | full column | stratosphere | full column | |
Emissions by HEMCO category |
Aircraft,
Anthro,
Bioburn,
Biogenic, |
Emission totals |
GCHP and GEOS-Chem Classic difference of differences
This table contains plots comparing the difference [GCHP 12.5.0 - GCHP 12.4.0] against the difference [GC Classic 12.5.0 - GC Classic 12.4.0], taken from 1-month benchmark simulations.
Category | Plots | |||
---|---|---|---|---|
Level Map | Zonal Mean | |||
Oxidants | sfc | 500hPa | full column | stratosphere |
Aerosols | sfc | 500hPa | full column | stratosphere |
Bromine | sfc | 500hPa | full column | stratosphere |
Chlorine | sfc | 500hPa | full column | stratosphere |
Iodine | sfc | 500hPa | full column | stratosphere |
Nitrogen | sfc | 500hPa | full column | stratosphere |
Primary Organics | sfc | 500hPa | full column | stratosphere |
Secondary Organics | sfc | 500hPa | full column | stratosphere |
Sulfur | sfc | 500hPa | full column | stratosphere |
NOTE: At present, we have only created the diff-of-diffs plots for species concentration. This can be extended to other categories in the future.
Validation of netCDF diagnostics
In this version, we did a complete comparison of the BPCH diagnostics to the netCDF diagnostics in preparation for retiring the old BPCH diagnostics. Comparison plots can be accessed via the links below. A summary of the results may be found on this Google spreadsheet.
NetCDF collection | BPCH equivalent(s) | Plots | |
---|---|---|---|
Level Map | Zonal Mean | ||
AdvFluxMerid | ND25 | sfc | full column |
AdvFluxVert | ND26 | sfc | full column |
AdvFluxZonal | ND24 | sfc | full column |
AerosolMass | ND42 | sfc | full column |
Aerosols | ND21 | sfc | full column |
CloudConvFlux | ND14 | 500hPa | full column |
ConcAfterChem | ND43 | sfc | full column |
DryDep | ND44 | sfc | |
Emissions (i.e. HEMCO diagnostics) |
ND06, ND07, ND08, ND11, ND13, ND28, ND29, ND32, ND34, ND36, ND46 |
sfc | |
JValues (24-hr avg) | ND22 | sfc | full column |
JValuesLocalNoon | ND22 | sfc | full column |
LevelEdgeDiags | ND31, ND66 | 850hPa | full column |
ProdLoss | ND05, ND07, ND65 | sfc | full column |
SpeciesConc | ND45 | sfc | full column |
StateChm | ND73 | sfc | full column |
StateMet | ND57 | sfc | full column |
WetLossConv | ND38, ND37 | 850hPa | full column |
WetLossLS | ND39 | 850hPa | full column |