Benchmark/GEOS-Chem 12.3.2

1-month benchmark

Benchmark plots

This is the first GEOS-Chem benchmark to utilize GCPy. Some benchmark plots created by GAMAP still remain because they have not been recreated in GCPy yet. To view the entirety of the old version of benchmark plots created by GAMAP, visit http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.3.0/GCC/output/.

Category1	Plots					Additional Information
	Level Map		Zonal Mean		Emissions
Primary	sfc	500hPa	full column	stratosphere	sfc
Aerosols	sfc	500hPa	full column	stratosphere	sfc
Bromine	sfc	500hPa	full column	stratosphere	sfc
Chlorine	sfc	500hPa	full column	stratosphere	--
Iodine	sfc	500hPa	full column	stratosphere	sfc
Nitrogen	sfc	500hPa	full column	stratosphere	sfc
Primary Organics	sfc	500hPa	full column	stratosphere	sfc
Secondary Organics	sfc	500hPa	full column	stratosphere	sfc
ROy	sfc	500hPa	full column	stratosphere	--
Sulfur	sfc	500hPa	full column	stratosphere	sfc
Emissions by HEMCO category	Total, Aircraft, Anthro, Bioburn, Biofuel, Biogenic, Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants, Ship, Soil, VolcDegas, VolcErupt,					Emissions tables
Plots still created by GAMAP
AOD	maps	differences	--	--	--
J-values	maps	differences	ratios	--	--
Budget	--	--	--	--	--	Ox and CO budgets

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

NOTES:

1. Category and lumped species definitions are simple to adjust. Updating them requires only editing the json files.
2. All plots created with GCPy have PDF bookmarks. If you do not see them in your browser try using a different browser (not Safari) or installing an Adobe Acrobat plug-in.

--Lizzie Lundgren (talk) 16:43, 1 April 2019 (UTC)

Benchmark assessment form

NOTE: This plot is still being filled out.

Description
New features added into GEOS-Chem	Feature Submitted by Features affecting the full-chemistry simulation: Fix inconsistency for species H2402 between GCHP and GEOS-Chem "Classic" Sebastian Eastham (MIT) GCST Bug fixes for the FAST-JX photolysis mechanism: Remove duplicate entry for species ClNO2 in the FJX_j2j.dat file Species DHDC was not listed as photolyzing in the GEOS-Chem species database Bob Yantosca (GCST) Updates and fixes for HEMCO diagnostics, including: Enable saving out fertilizer NOx emissions Lightning NOx emissions are 3D not, 2D HNO3 ship emissions are 2D, not 3D Update and fill in missing inventory diagnostics (currently used in only in benchmark simulations) Melissa Sulprizio (GCST) Features NOT affecting the full-chemistry simulation: Extending the CEDS anthropogenic emissions inventory to include 1750-1949 and additional VOC species Melissa Sulprizio (GCST) Features only affecting GCHP: Disable Br2 offline seasalt emissions to match GEOS-Chem Classic default Sebastian Eastham (MIT) Assorted GCHP run directory feature updates Rename Makefile clean and build options Remove deprecated Makefile/build.sh clean and build options Remove aliases from sample run scripts Remove output file runConfig.log; send to gchp.log instead Update benchmark run directory to match GEOS-Chem Classic settings Lizzie Lundgren (GCST) Embed GEOS code within select GCHP files Lizzie Lundgren (GCST)
Version, resolution, met fields used:	GEOS-FP (72L), 4x5, July 2016
1-month benchmark finished on:
Performance statistics:	Compiled with ifort 17.0.4 Ran on 24 CPUs of holy2c12205.rc.fas.harvard.edu (Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz) Wall time: 09:14 CPU time / wall time: 20.0261 % of ideal performance: 83.44% Memory: TBD GB
Compared to previous benchmark:	12.3.0
This update will impact: (select all that apply with boldface)	Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify): HEMCO diagnostic output
Unit test results may be viewed at:
Metrics
Global mean OH from log file (% change):	12.5657321664519 x 105 molec/cm3 (0.27%)
Methyl chloroform lifetime (% change):	4.9303 years (-0.36%)
Methane lifetime (% change):	8.3059 years (-0.39%)
At the SURFACE, list all species that changed by 10% or more:
Comments on SURFACE differences:
Comments on 500 hPa differences:	See comments for surface differences
In the ZONAL MEAN differences, list all species that changed by 10% or more:
Comments on ZONAL MEAN differences:	See comments for surface differences
In the EMISSION RATIO maps, list all species that changed by 10% or more:	None
Comments on EMISSION RATIO differences:	Emissions in 12.3.2 are 100% identical to 12.3.0
Additional or summary comments:	The bug fixes for FAST-JX resulted in very small changes w/r/t the 12.3.0 1-month benchmark: Mean OH changed by +0.2782% MCF lifetime changed by -0.3597% CH4 lifetime changed by -0.3936% The fix to make species H2402 consistent between GCHP and GC "Classic" resulted in very minor additional changes on top of the FAST-JX fixes: Mean OH changed by -0.0002% MCF lifetime was unchanged CH4 lifetime changed by +0.0012% So it appears that most of the changes between 12.3.0 and 12.3.2 are being driven by the bug fixes to FAST-JX.
Comments on additional differences in GCHP:	To be filled out by GCHP WG
Approval
Requires further investigation:
Approved by:
Date of approval:

--Bob Yantosca (talk) 20:19, 25 April 2019 (UTC)

GCHP 1-month benchmark

The following sections contain validation plots for GCHP 12.3.2.

Comparison of GCHP versions

This table contains plots comparing GCHP 12.3.0 (Ref) and GCHP 12.3.2 (Dev) for a 1-month simulation.

Category1	Plots2					Additional Information
	Level Map		Zonal Mean		Emissions
Primary	sfc	500hPa	full column	stratosphere	sfc
Aerosols	sfc	500hPa	full column	stratosphere	sfc
Bromine	sfc	500hPa	full column	stratosphere	sfc
Chlorine	sfc	500hPa	full column	stratosphere	--
Iodine	sfc	500hPa	full column	stratosphere	sfc
Nitrogen	sfc	500hPa	full column	stratosphere	sfc
Primary Organics	sfc	500hPa	full column	stratosphere	sfc
Secondary Organics	sfc	500hPa	full column	stratosphere	sfc
Sulfur	sfc	500hPa	full column	stratosphere	sfc
Emissions by HEMCO category	Aircraft, Anthro, Bioburn, Biofuel, Biogenic, Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants, Ship, Soil, Total, VolcDegas, VolcErupt,					Emission totals

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

--Bob Yantosca (talk) 17:02, 30 April 2019 (UTC)

Comparison of GCHP and GEOS-Chem Classic

This table contains plots comparing GEOS-Chem Classic 12.3.2 (Ref) against GCHP 12.3.2 (Dev) for a 1-month simulation.

Category1	Plots2					Additional Information
	Level Map		Zonal Mean		Emissions
Primary	sfc	500hPa	full column	stratosphere	sfc
Aerosols	sfc	500hPa	full column	stratosphere	sfc
Bromine	sfc	500hPa	full column	stratosphere	sfc
Chlorine	sfc	500hPa	full column	stratosphere	--
Iodine	sfc	500hPa	full column	stratosphere	sfc
Nitrogen	sfc	500hPa	full column	stratosphere	sfc
Primary Organics	sfc	500hPa	full column	stratosphere	sfc
Secondary Organics	sfc	500hPa	full column	stratosphere	sfc
Sulfur	sfc	500hPa	full column	stratosphere	sfc
Emissions by HEMCO category	Aircraft, Anthro, Bioburn, Biofuel, Biogenic, Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants, Ship, Soil, Total, VolcDegas, VolcErupt,					Emission totals

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json

--Bob Yantosca (talk) 17:16, 30 April 2019 (UTC)

GCHP and GEOS-Chem Classic difference of differences

This table contains plots comparing the difference [GCHP 12.3.2 - GCHP 12.3.0] against the difference [GC Classic 12.3.2 - GC Classic 12.3.0], taken from 1-month benchmark simulations.

Category1	Plots2
	Level Map		Zonal Mean
Primary	sfc	500hPa	full column	stratosphere
Aerosols	sfc	500hPa	full column	stratosphere
Bromine	sfc	500hPa	full column	stratosphere
Chlorine	sfc	500hPa	full column	stratosphere
Iodine	sfc	500hPa	full column	stratosphere
Nitrogen	sfc	500hPa	full column	stratosphere
Primary Organics	sfc	500hPa	full column	stratosphere
Secondary Organics	sfc	500hPa	full column	stratosphere
Sulfur	sfc	500hPa	full column	stratosphere

¹Benchmark category definitions: benchmark_categories.json
²Lumped species definitions: lumped_species.json