Benchmark/GEOS-Chem 12.3.2: Difference between revisions

Revision as of 19:07, 10 May 2019

This page includes information about benchmark simulations for GEOS-Chem 12.3.2.

1-month benchmark

NOTE: The GEOS-Chem "Classic" benchmark for 12.3.2 is an unofficial benchmark. GEOS-Chem "Classic" 12.4.0 will be compared against GEOS-Chem "Classic" 12.3.0. We ran this 12.3.2 benchmark so as to facilitate comparison with GCHP and also to test the new GCPy benchmark plotting package.

Benchmark plots

This table contains plots comparing GEOS-Chem Classic 12.3.0 (Ref) vs. GEOS-Chem Classic 12.3.2 (Dev).

Category¹	Plots					Additional Information
	Level Map		Zonal Mean		Emissions
Primary	sfc	500hPa	full column	stratosphere	full column
Aerosols	sfc	500hPa	full column	stratosphere	full column	Column AOD
Bromine	sfc	500hPa	full column	stratosphere	full column
Chlorine	sfc	500hPa	full column	stratosphere	--
Iodine	sfc	500hPa	full column	stratosphere	full column
Nitrogen	sfc	500hPa	full column	stratosphere	full column
Primary Organics	sfc	500hPa	full column	stratosphere	full column
Secondary Organics	sfc	500hPa	full column	stratosphere	full column
ROy	sfc	500hPa	full column	stratosphere	--
Sulfur	sfc	500hPa	full column	stratosphere	full column
Emissions by HEMCO category	Total, Aircraft, Anthro, Bioburn, Biofuel, Biogenic, Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants, Ship, Soil, VolcDegas, VolcErupt,					Emissions tables
J-values	sfc	500hPa	full column	stratosphere	--
Plots/tables still created by GAMAP
Budget	--	--	--	--	--	Ox and CO budgets

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

NOTES:

Category and lumped species definitions are simple to adjust. Updating them requires only editing the json files.
All plots created with GCPy have PDF bookmarks. If you do not see them in your browser try using a different browser (not Safari) or installing an Adobe Acrobat plug-in.

--Bob Yantosca (talk) 18:32, 30 April 2019 (UTC)

Benchmark assessment form

Description

New features added into GEOS-Chem

Feature	Submitted by
Features affecting the full-chemistry simulation:
Fix inconsistency for species H2402 between GCHP and GEOS-Chem "Classic"	Sebastian Eastham (MIT) GCST
Bug fixes for the FAST-JX photolysis mechanism: Remove duplicate entry for species ClNO2 in the FJX_j2j.dat file Species DHDC was not listed as photolyzing in the GEOS-Chem species database	Bob Yantosca (GCST)
Updates and fixes for HEMCO diagnostics, including: Enable saving out fertilizer NOx emissions Lightning NOx emissions are 3D not, 2D HNO3 ship emissions are 2D, not 3D Update and fill in missing inventory diagnostics (currently used in only in benchmark simulations)	Melissa Sulprizio (GCST)
Features NOT affecting the full-chemistry simulation:
Extending the CEDS anthropogenic emissions inventory to include 1750-1949 and additional VOC species	Melissa Sulprizio (GCST)
Features only affecting GCHP:
Disable Br2 offline seasalt emissions to match GEOS-Chem Classic default	Sebastian Eastham (MIT)
Assorted GCHP run directory feature updates Rename Makefile clean and build options Remove deprecated Makefile/build.sh clean and build options Remove aliases from sample run scripts Remove output file runConfig.log; send to gchp.log instead Update benchmark run directory to match GEOS-Chem Classic settings	Lizzie Lundgren (GCST)
Embed GEOS code within select GCHP files	Lizzie Lundgren (GCST)

Version, resolution, met fields used:

GEOS-FP (72L), 4x5, July 2016

1-month benchmark finished on:

Performance statistics:

Compiled with ifort 17.0.4
Ran on 24 CPUs of holy2c12205.rc.fas.harvard.edu (Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz)
Wall time: 09:14
CPU time / wall time: 20.0261
% of ideal performance: 83.44%
Memory: TBD GB

Compared to previous benchmark:

12.3.0

This update will impact:
(select all that apply with boldface)

Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify): HEMCO diagnostic output

Unit test results may be viewed at:

Metrics

Global mean OH from log file (% change):

12.5657321664519 x 10⁵ molec/cm³ (0.27%)

Methyl chloroform lifetime (% change):

4.9303 years (-0.36%)

Methane lifetime (% change):

8.3059 years (-0.39%)

At the SURFACE, list all species that changed by 10% or more:

Primary: O3 OH NOx
Aerosols: NH4 NIT SO4 AERI BrSALA BrSALC ISALA ISALC NITS SO4s SOA_Complex SOA_Simple
Bromine: All Br species EXCEPT ChBr CH2Br2 CHBr3
Chlorine: Cly ClOx Cl ClO Cl2 Cl2O2 ClOO ClNO2 ClNO3 HOCl HCl
Iodine: All species
Nitrogen: NOx NOy HNO2 HNO3 HNO4 IPMN NIT NO NO2 NO3 N2O5 MPN PAN PPN NHx NH4
Primary Organics: PRPE TOLU XYLE ISOP MTPA MTPO LIMO GLYX MAP RCHO
Secondary Organics: MEK MVK CH2O HPALD MP ISOPN IEPOX ACTA
ROy: H2O2 H HO2 O1D OH RO2
Sulfur: SOx SO2 SO4

Comments on SURFACE differences:

As emissions did not change between versions, we can likely attribute these to the updates to FAST-JX.
Many species showed larger percent differences in areas where concentrations were very small.

At 500hPA, list all species that changed by 10% or more:

Same as for surface

Comments on 500 hPa differences:

See comments for surface differences

In ZONAL MEANS, list all species that changed by 10% or more:

Same as for surface

Comments on ZONAL MEAN differences:

See comments for surface differences

In the EMISSION RATIO maps, list all species that changed by 10% or more:

None

Comments on EMISSION RATIO differences:

Emissions in 12.3.2 are 100% identical to 12.3.0

Additional or summary comments:

The bug fixes for FAST-JX resulted in very small changes w/r/t the 12.3.0 1-month benchmark:

Mean OH changed by +0.2782%
MCF lifetime changed by -0.3597%
CH4 lifetime changed by -0.3936%

The fix to make species H2402 consistent between GCHP and GC "Classic" resulted in very minor additional changes on top of the FAST-JX fixes:

Mean OH changed by -0.0002%
MCF lifetime was unchanged
CH4 lifetime changed by +0.0012%

So it appears that most of the changes between 12.3.0 and 12.3.2 are being driven by the bug fixes to FAST-JX.

Comments on additional differences in GCHP:

Additional differences exist for dust (and to a lesser extent other natural sources with resolution dependence) that are driven by emission differences.
- GCST NOTE: We expect these to be resolved by the grid-independent dust emissions in version 12.4.0.
Differences in stratospheric aerosol OD have been noted due to resolution sensitivities in UCX.
The polar chlorine differences are likely due to the (lack of) polar averaging in GCHP and differences in “true” resolution.
Concentrations of marine bromine species improved but remain elevated in GCHP relative to GCC

Approval

Requires further investigation:

Approved by:

Date of approval:

--Bob Yantosca (talk) 19:04, 30 April 2019 (UTC)

GCHP 1-month benchmark

The following sections contain validation plots for GCHP 12.3.2.

Comparison of GCHP versions

This table contains plots comparing GCHP 12.3.0 (Ref) and GCHP 12.3.2 (Dev) for a 1-month simulation.

Category¹	Plots²					Additional Information
	Level Map		Zonal Mean		Emissions
Primary	sfc	500hPa	full column	stratosphere	full column
Aerosols	sfc	500hPa	full column	stratosphere	full column	Column AOD
Bromine	sfc	500hPa	full column	stratosphere	full column
Chlorine	sfc	500hPa	full column	stratosphere	--
Iodine	sfc	500hPa	full column	stratosphere	full column
Nitrogen	sfc	500hPa	full column	stratosphere	full column
Primary Organics	sfc	500hPa	full column	stratosphere	full column
Secondary Organics	sfc	500hPa	full column	stratosphere	full column
Sulfur	sfc	500hPa	full column	stratosphere	full column
Emissions by HEMCO category	Aircraft, Anthro, Bioburn, Biofuel, Biogenic, Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants, Ship, Soil, Total, VolcDegas, VolcErupt,					Emission totals

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

--Bob Yantosca (talk) 17:02, 30 April 2019 (UTC)

Comparison of GCHP and GEOS-Chem Classic

This table contains plots comparing GEOS-Chem Classic 12.3.2 (Ref) against GCHP 12.3.2 (Dev) for a 1-month simulation.

Category¹	Plots²					Additional Information
	Level Map		Zonal Mean		Emissions
Primary	sfc	500hPa	full column	stratosphere	full column
Aerosols	sfc	500hPa	full column	stratosphere	full column	Column AOD
Bromine	sfc	500hPa	full column	stratosphere	full column
Chlorine	sfc	500hPa	full column	stratosphere	--
Iodine	sfc	500hPa	full column	stratosphere	full column
Nitrogen	sfc	500hPa	full column	stratosphere	full column
Primary Organics	sfc	500hPa	full column	stratosphere	full column
Secondary Organics	sfc	500hPa	full column	stratosphere	full column
Sulfur	sfc	500hPa	full column	stratosphere	full column
Emissions by HEMCO category	Aircraft, Anthro, Bioburn, Biofuel, Biogenic, Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants, Ship, Soil, Total, VolcDegas, VolcErupt,					Emission totals

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

--Bob Yantosca (talk) 17:16, 30 April 2019 (UTC)

GCHP and GEOS-Chem Classic difference of differences

This table contains plots comparing the difference [GCHP 12.3.2 - GCHP 12.3.0] against the difference [GC Classic 12.3.2 - GC Classic 12.3.0], taken from 1-month benchmark simulations.

Category¹	Plots²
	Level Map		Zonal Mean
Primary	sfc	500hPa	full column	stratosphere
Aerosols	sfc	500hPa	full column	stratosphere
Bromine	sfc	500hPa	full column	stratosphere
Chlorine	sfc	500hPa	full column	stratosphere
Iodine	sfc	500hPa	full column	stratosphere
Nitrogen	sfc	500hPa	full column	stratosphere
Primary Organics	sfc	500hPa	full column	stratosphere
Secondary Organics	sfc	500hPa	full column	stratosphere
Sulfur	sfc	500hPa	full column	stratosphere

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

NOTES:

At present, we have only created the diff-of-diffs plots for species concentration. This can be extended to other categories in the future.

--Bob Yantosca (talk) 19:00, 1 May 2019 (UTC)

@@ Line 516: / Line 516: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary/Primary_FullColumn_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary/Primary_Strat_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary/Primary_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary/Primary_Emissions.pdf full column]
 |
@@ Line 525: / Line 525: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Aerosols/Aerosols_FullColumn_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Aerosols/Aerosols_Strat_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Aerosols/Aerosols_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Aerosols/Aerosols_Emissions.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Aerosols/Aerosols_ColumnOptDepth.pdf Column AOD]
@@ Line 534: / Line 534: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Bromine/Bromine_FullColumn_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Bromine/Bromine_Strat_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Bromine/Bromine_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Bromine/Bromine_Emissions.pdf full column]
 |
@@ Line 552: / Line 552: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Iodine/Iodine_FullColumn_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Iodine/Iodine_Strat_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Iodine/Iodine_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Iodine/Iodine_Emissions.pdf full column]
 |
@@ Line 561: / Line 561: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Nitrogen/Nitrogen_FullColumn_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Nitrogen/Nitrogen_Strat_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Nitrogen/Nitrogen_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Nitrogen/Nitrogen_Emissions.pdf full column]
 |
@@ Line 570: / Line 570: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary_FullColumn_Organics/Primary_Organics_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary_Strat_Organics/Primary_Organics_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary_Organics/Primary_Organics_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Primary_Organics/Primary_Organics_Emissions.pdf full column]
 |
@@ Line 579: / Line 579: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Secondary_FullColumn_Organics/Secondary_Organics_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Secondary_Strat_Organics/Secondary_Organics_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Secondary_Organics/Secondary_Organics_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Secondary_Organics/Secondary_Organics_Emissions.pdf full column]
 |
@@ Line 588: / Line 588: @@
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Sulfur/Sulfur_FullColumn_ZonalMean.pdf full column]
 |[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Sulfur/Sulfur_Strat_ZonalMean.pdf stratosphere]
-|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Sulfur/Sulfur_Emissions.pdf sfc]
+|[http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.2/GCHP/GCHP_GCC_comparison/Sulfur/Sulfur_Emissions.pdf full column]
 |

Benchmark/GEOS-Chem 12.3.2: Difference between revisions

Revision as of 19:07, 10 May 2019

Contents

1-month benchmark

Benchmark plots

Benchmark assessment form

GCHP 1-month benchmark

Comparison of GCHP versions

Comparison of GCHP and GEOS-Chem Classic

GCHP and GEOS-Chem Classic difference of differences

Navigation menu

Benchmark/GEOS-Chem 12.3.2: Difference between revisions

Revision as of 19:07, 10 May 2019

1-month benchmark

Benchmark plots

Benchmark assessment form

GCHP 1-month benchmark

Comparison of GCHP versions

Comparison of GCHP and GEOS-Chem Classic

GCHP and GEOS-Chem Classic difference of differences

Navigation menu

Search