Difference between revisions of "Benchmark/GEOS-Chem 12.5.0"

From Geos-chem
Jump to: navigation, search
(BPCH vs netCDF comparison plots)
(BPCH vs netCDF summary table)
Line 930: Line 930:
 
|Comments on observed differences:
 
|Comments on observed differences:
 
|'''General Comments:'''
 
|'''General Comments:'''
*Minor differences for all species can be attributed to the difference in update frequency between bpch and netCDF diagnostics.  See our ''[[Diagnostic time step]]'' wiki page for a complete description.
+
#Minor differences for all species can be attributed to the difference in update frequency between bpch and netCDF diagnostics.  See our ''[[Diagnostic time step]]'' wiki page for a complete description.
*Some individual bpch diagnostics might not have gotten converted to netCDF.  This may account for several missing quantities.
+
#Some individual bpch diagnostics might not have gotten converted to netCDF.  This may account for several missing quantities.
*The bpch diagnostics contains less species than the netCDF diagnostics.  Therefore, we have only been able to plot those diagnostic quantities that are common to both bpch and netCDF output.
+
#The bpch diagnostics contains less species than the netCDF diagnostics.  Therefore, we have only been able to plot those diagnostic quantities that are common to both bpch and netCDF output.
**In particular, the netCDF diagnostics now archive all species, whereas the bpch diagnostics only archived advected species.   
+
#*In particular, the netCDF diagnostics now archive all species, whereas the bpch diagnostics only archived advected species.   
**This will cause differences in family plots such as NOx and NOy. This is due to the fact that the netCDF diagnostics contain all individual constituents of each family but the bpch diagnostics will not. have all individual species of which the family is composed, but the bpch diagnost
+
#*This will cause differences in family plots such as NOx and NOy. This is due to the fact that the netCDF diagnostics contain all individual constituents of each family but the bpch diagnostics will not. have all individual species of which the family is composed, but the bpch diagnost
  
 
'''J-Values'''
 
'''J-Values'''
*The differences in J-Value plots are a result of the bpch ND22 diagnostic archiving local noontime J-values, whereas the netCDF diagnostics used in the benchmark simulations now archive 24-hour averaged J-values.
+
#The differences in J-Value plots are a result of the bpch ND22 diagnostic archiving local noontime J-values, whereas the netCDF diagnostics used in the benchmark simulations now archive 24-hour averaged J-values.
  
 
'''Emissions:'''
 
'''Emissions:'''
*Most bpch emissions diagnostics were in units of molec/cm2/s.  These were converted to kg/m2/s in post-processing (accounting for those hydrocarbon species carried in equivalent carbons).
+
#Most bpch emissions diagnostics were in units of molec/cm2/s.  These were converted to kg/m2/s in post-processing (accounting for those hydrocarbon species carried in equivalent carbons).
 +
#The differences in MTPA biomass burning might be due to a unit conversion error from the original bpch file.
  
 
|}
 
|}
  
--[[User:Bmy|Bob Yantosca]] ([[User talk:Bmy|talk]]) 21:17, 14 August 2019 (UTC)
+
--[[User:Bmy|Bob Yantosca]] ([[User talk:Bmy|talk]]) 14:14, 15 August 2019 (UTC)

Revision as of 14:14, 15 August 2019


This page includes information about all benchmark simulations for GEOS-Chem 12.5.0.

GEOS-Chem Classic 1-month benchmark

Benchmark plots

Enable PDF bookmarks in the files linked below to navigate between species. See the Species in GEOS-Chem wiki page for species definitions and details.

Species Category1 Plots Additional Information
Level Map Zonal Mean Emissions
Principal

O3, CO, OH, NOx

sfc 500hPa full column stratosphere sfc
Aerosols

NH4, NIT, SO4, DST1, DST2, DST3, DST4, BC, OC, AERI, BrSALA, BrSALC, ISALA, ISALC, NITs, SALA, SALC, SO4s, SOA_Simple, SOA_Complex

sfc 500hPa full column stratosphere sfc AOD
Bromine

Bry, BrOx, Br, Br2, BrCl, BrNO2, BrNO3, BrO, CH4Br, CH2Br2, CH2Br2, CH3Br3, HOBr, HBr

sfc 500hPa full column stratosphere sfc
Chlorine

Cly, ClOx, Cl, ClO, Cl2, Cl2O2, ClOO, ClNO2, ClNO3, CCl4, CFCs, CH3Cl, CH2Cl2, CH4CCl3, HOCl, HCl, Halons, HCFCs, OClO

sfc 500hPa full column stratosphere --
Iodine

Iy, IxOy, I, I2, IBr, ICl, IO, INO2, IONO2, CH3I, CH2I2, CH2ICl, CH2IBr, HI, HOI, OIO

sfc 500hPa full column stratosphere sfc
Nitrogen

NOy, NOx, HNO2, HNO3, HNO4, IMPN, NIT, NO, NO2, NO3, N2O5, MPN, PAN, PPN, N2O, NHx, NH3, NH4

sfc 500hPa full column stratosphere sfc
Primary Organics

ALK4, BENZ, CH4, C2H6, C2H4, C3H8, PRPE, TOLU, XYLE, ISOP, MTPA, MTPO, LIMO, GLYX, HCOOH, MAP, MBO, MOH, RCHO

sfc 500hPa full column stratosphere sfc
Secondary Organics

ACET, MEK, MVK, ALD2, CH2O, HPALD, MP, ISOPN, IEPOX, ACTA, EOH, MOH

sfc 500hPa full column stratosphere sfc
ROy

H2O2, H, H2, H2O, HO2, O1D, OH, RO2

sfc 500hPa full column stratosphere --
Sulfur

SOx, DMS, OCS, SO2, SO4

sfc 500hPa full column stratosphere sfc
Emissions by HEMCO category

Total, Aircraft, Anthro, BioBurn, Biofuel, Biogenic,
Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants,
Ship, Soil, VolcDegas, VolcErupt,

Emissions tables
J-values sfc 500hPa full column stratosphere -- --
Plots still created by GAMAP
Budget -- -- -- -- -- Ox and CO budgets

NOTES:

  1. Species category and lumped species definitions are simple to adjust. Updating them requires only editing the json files.
  2. All plots created with GCPy have PDF bookmarks. If you do not see them in your browser try using a different browser (not Safari) or installing an Adobe Acrobat plug-in.

Benchmark assessment form

Description
New features added into GEOS-Chem
Feature Submitted by
Updates that will affect full-chemistry simulations
Retire obsolete emission inventories Eloise Marais (Leicester)
Emissions and Deposition Working Group
Updated offline biogenic emissions generated with GEOS-Chem 12.3.0 Hongjian Weng (PKU)
Updated volcano emissions to include eruptive emissions through April 2018 Christoph Keller (NASA/GMAO)
Fixes for GFED4 emissions, including:
  • Change the HEMCO cycling flag so that the model crashes if it doesn't find the right GFED year
  • Remove the 27% scaling of POG to POA and emit 1:1 instead
Sidhant Pai (MIT)
Scale DICE-Africa emissions to address errors in inventory Eloise Marais (Leicester)
Separate anthropogenic PM2.5 dust source from the DustDead extension Melissa Sulprizio (GCST)
Corrections for CFCs in the chemistry mechanism Xuan Wang (Harvard)
Fix typo in CLD_PARAMS routine in gckpp_HetRates.F90 Stephen Steenrod (NASA GMAO)
Bug fix: make sure stratospheric BrY concentrations are read properly each month Lyatt Jaeglé (U. Washington)
Updates that will NOT affect full-chemistry simulations
Enable accurate cloud pH diagnostic calculation via post-processing Jonathan Moch (Harvard)
Bug fix for proposed Henry's law constants Jenny Fisher (Wollongong)
Updates that will only affect GCHP
Update GCHP to use MAPL v1.0.0 and ESMF v8.0.0 beta snapshot 28 Lizzie Lundgren (GCST)
Version, resolution, met fields used: GEOS-FP (72L), 4x5, July 2016
1-month benchmark finished on: Sat Aug 10 06:32:29 EDT 2019
Performance statistics:
  • Compiled with ifort 17.0.4
  • Ran on 24 CPUs of holyjacob01.rc.fas.harvard.edu (Intel(R) Xeon(R) CPU E5-2680 v3 "Haswell" @ 2.50 GHz)
  • Wall time: 07:32:26
  • CPU time / wall time: 21.1184
  • % of ideal performance: 87.99%
  • Memory: 13.8486 GB
Compared to previous benchmark: 12.4.0
This update will impact:
(select all that apply with boldface)
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Emissions, Photolysis, Chemistry, Other (please specify): Diagnostics
Unit test results may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/GC_12/12.5.0/GCC/Plots/GC_12.5.0_Aug08.results.html
Metrics
Global mean OH from log file (% change): 12.3699948768189 x 105 molec/cm3 (-0.82%)
Methyl chloroform lifetime (% change): 4.9566 (1.22%)
Methane lifetime (% change): 8.3442 years (1.26%)
List all SURFACE species, J-Values, and COLUMN AOD values that changed by 10% or more:
  • Principal: O3 CO OH NOx
  • Aerosols: NH4 NIT SO4 DST1 AERI BrSALA BrSALC ISALA ISALC NITs SO4s SOA_Complex SOA_Simple
  • Nitrogen: NOy NOx HNO2 HNO3 HNO4 IPMN NIT NO NO2 NO3 N2O5 MPN PAN PPN NHx NH3 NH4
  • ROy: H2O2 H HO2 O1D OH RO2
  • Sulfur: SOx DMS SO2 SO4
  • Iodine: Iy IxOy I I2 IBr ICl IO INO2 IONO2 CH2I2 HI HOI OIO
  • Bromine: Bry BrOx Br Br2 BrCl BrNO2 BrNO3 BrO HOBr HBr
  • Chlorine: Cly ClOx Cl ClO Cl2 Cl2O2 ClOO ClNO2 ClNO3 HOCl HCl HCFCs OClO
  • Primary_Organics: ALK4 BENZ C2H6 C3H8 PRPE TOLU XYLE ISOP MTPA MTPO LIMO GLYX HCOOH MAP RCHO
  • Secondary_Organics: ACET MEK MVK ALD2 CH2O HPALD MP ISOPN IEPOX ACTA EOH
  • J-Values: CCl4 CFC11 CFC113 CFC114 CFC115 CFC12 CH2Cl2 CH3CCl3 CH3Cl HCFC123 HCFC141b HCFC142b N2O O2
  • Column AOD: Dust OCPI SO4 SOA_from_Aqueous_ISOP Total
List all 500 hPa species and J-Values that changed by 10% or more :
  • Principal: OH NOx
  • Aerosols: NH4 NIT SO4 DST1 AERI BrSALA BrSALC ISALC NITs SO4s SOA_Complex
  • Nitrogen: NOx HNO2 HNO4 IPMN NIT NO NO2 NO3 N2O5 MPN PAN PPN NHx NH3 NH4
  • ROy: OH
  • Sulfur: SOx DMS SO2 SO4
  • Iodine: I2 ICl INO2 IONO2 CH2I2 HI OIO
  • Bromine: BrOx Br Br2 BrCl BrNO2 BrNO3 BrO HOBr HBr
  • Chlorine: ClOx Cl ClO Cl2 Cl2O2 ClOO ClNO2 ClNO3 HOCl HCl OClO
  • Primary_Organics: ALK4 BENZ C2H6 C3H8 PRPE TOLU XYLE ISOP MTPA MTPO LIMO GLYX HCOOH MAP RCHO
  • Secondary_Organics: ACET MEK MVK ALD2 HPALD MP ISOPN IEPOX ACTA EOH
  • J-Values: None
List all ZONAL MEAN species and J-Values that changed by 10% or more:
  • Principal: OH NOx
  • Aerosols: NH4 NIT SO4 DST1 BrSALA BrSALC NITs SO4s SOA_Complex
  • Nitrogen: NOy NOx HNO2 HNO3 HNO4 IPMN NIT NO NO2 NO3 N2O5 MPN PAN PPN NH3 NH4
  • ROy: OH RO2
  • Sulfur: SOx SO2 SO4
  • Iodine: I2 IBr ICl INO2 IONO2 CH2I2 HI OIO
  • Bromine: BrOx Br Br2 BrCl BrNO2 BrNO3 BrO HOBr HBr
  • Chlorine: Cly ClOx Cl ClO Cl2 Cl2O2 ClOO ClNO2 ClNO3 HOCl OClO
  • Primary_Organics: ALK4 C2H6 C3H8 PRPE TOLU XYLE ISOP MTPA MTPO LIMO GLYX HCOOH MAP RCHO
  • Secondary_Organics: ACET MEK MVK ALD2 CH2O HPALD ISOPN IEPOX ACTA EOH
  • J-Values: None
List all EMISSIONS that changed by 10% or more:
  • Anthro: ALD2 ALK4 BCPI BCPO C2H6 C3H8 CO HAC MEK NH3 NO pFe PRPE SO2 SO4 SOAP
  • Biogenic: ACET ALD2 EOH ISOP LIMO PRPE SOAP SOAS
  • Monoterp: CO
  • Ship: CO HNO3 NO2 NO O3 SO2 SOAP
  • Total: ACET ALD2 ALK4 BCPI BCPO C2H6 C3H8 CO EOH GLYX ISOP MEK MGLY MTPA NH3 NO pFe PRPE SO2 SO4 SOAP
  • VolcDegas: SO2
Comments on observed differences: TBD
Approval
Requires further investigation: TBD
Approved by:
Date of approval:

GCHP 1-month benchmark

The following sections contain validation plots for GCHP 12.5.0.

Comparison of GCHP versions

This table contains plots comparing GCHP 12.4.0 (Ref) and GCHP 12.5.0 (Dev) for a 1-month simulation.

Category1 Plots2 Additional Information
Level Map Zonal Mean Emissions
Primary sfc 500hPa full column stratosphere full column
Aerosols sfc 500hPa full column stratosphere full column Column AOD
Bromine sfc 500hPa full column stratosphere full column
Chlorine sfc 500hPa full column stratosphere --
Iodine sfc 500hPa full column stratosphere full column
Nitrogen sfc 500hPa full column stratosphere full column
Primary Organics sfc 500hPa full column stratosphere full column
Secondary Organics sfc 500hPa full column stratosphere full column
Sulfur sfc 500hPa full column stratosphere full column
Emissions by HEMCO category

Aircraft, Anthro, Bioburn, Biofuel, Biogenic,
Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants,
Ship, Soil, Total, VolcDegas, VolcErupt,

Emission totals

1Benchmark category definitions: benchmark_categories.json
2Lumped species definitions: lumped_species.json

Comparison of GCHP and GEOS-Chem Classic

This table contains plots comparing GEOS-Chem Classic 12.5.0 (Ref) against GCHP 12.5.0 (Dev) for a 1-month simulation.

Category1 Plots2 Additional Information
Level Map Zonal Mean Emissions
Primary sfc 500hPa full column stratosphere full column
Aerosols sfc 500hPa full column stratosphere full column Column AOD
Bromine sfc 500hPa full column stratosphere full column
Chlorine sfc 500hPa full column stratosphere --
Iodine sfc 500hPa full column stratosphere full column
Nitrogen sfc 500hPa full column stratosphere full column
Primary Organics sfc 500hPa full column stratosphere full column
Secondary Organics sfc 500hPa full column stratosphere full column
Sulfur sfc 500hPa full column stratosphere full column
Emissions by HEMCO category

Aircraft, Anthro, Bioburn, Biofuel, Biogenic,
Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants,
Ship, Soil, Total, VolcDegas, VolcErupt,

Emission totals

1Benchmark category definitions: benchmark_categories.json
2Lumped species definitions: lumped_species.json

GCHP and GEOS-Chem Classic difference of differences

This table contains plots comparing the difference [GCHP 12.5.0 - GCHP 12.4.0] against the difference [GC Classic 12.5.0 - GC Classic 12.4.0], taken from 1-month benchmark simulations.

Category1 Plots2
Level Map Zonal Mean
Primary sfc 500hPa full column stratosphere
Aerosols sfc 500hPa full column stratosphere
Bromine sfc 500hPa full column stratosphere
Chlorine sfc 500hPa full column stratosphere
Iodine sfc 500hPa full column stratosphere
Nitrogen sfc 500hPa full column stratosphere
Primary Organics sfc 500hPa full column stratosphere
Secondary Organics sfc 500hPa full column stratosphere
Sulfur sfc 500hPa full column stratosphere

1Benchmark category definitions: benchmark_categories.json
2Lumped species definitions: lumped_species.json

NOTES:

  1. At present, we have only created the diff-of-diffs plots for species concentration. This can be extended to other categories in the future.

Comparison of bpch vs. netCDF diagnostic output in GEOS-Chem 12.5.0

In order to identify any potential issues with the implementation of the GEOS-Chem "History" diagnostics, we compared the bpch diagnostic output (aka "Ref") vs. the netCDF diagnostic output (aka "Dev") from the 1-month GEOS-Chem 12.5.0 benchmark. The results will inform us as we proceed to remove the bpch diagnostics from GEOS-Chem.

BPCH vs netCDF comparison plots

Enable PDF bookmarks in the files linked below to navigate between species. See the Species in GEOS-Chem wiki page for species definitions and details.

Species Category1 Plots Additional Information
Level Map Zonal Mean Emissions
Principal

O3, CO, OH, NOx

sfc 500hPa full column stratosphere sfc
Aerosols

NH4, NIT, SO4, DST1, DST2, DST3, DST4, BC, OC, AERI, BrSALA, BrSALC, ISALA, ISALC, NITs, SALA, SALC, SO4s, SOA_Simple, SOA_Complex

sfc 500hPa full column stratosphere sfc AOD
Bromine

Bry, BrOx, Br, Br2, BrCl, BrNO2, BrNO3, BrO, CH4Br, CH2Br2, CH2Br2, CH3Br3, HOBr, HBr

sfc 500hPa full column stratosphere sfc
Chlorine

Cly, ClOx, Cl, ClO, Cl2, Cl2O2, ClOO, ClNO2, ClNO3, CCl4, CFCs, CH3Cl, CH2Cl2, CH4CCl3, HOCl, HCl, Halons, HCFCs, OClO

sfc 500hPa full column stratosphere --
Iodine

Iy, IxOy, I, I2, IBr, ICl, IO, INO2, IONO2, CH3I, CH2I2, CH2ICl, CH2IBr, HI, HOI, OIO

sfc 500hPa full column stratosphere sfc
Nitrogen

NOy, NOx, HNO2, HNO3, HNO4, IMPN, NIT, NO, NO2, NO3, N2O5, MPN, PAN, PPN, N2O, NHx, NH3, NH4

sfc 500hPa full column stratosphere sfc
Primary Organics

ALK4, BENZ, CH4, C2H6, C2H4, C3H8, PRPE, TOLU, XYLE, ISOP, MTPA, MTPO, LIMO, GLYX, HCOOH, MAP, MBO, MOH, RCHO

sfc 500hPa full column stratosphere sfc
Secondary Organics

ACET, MEK, MVK, ALD2, CH2O, HPALD, MP, ISOPN, IEPOX, ACTA, EOH, MOH

sfc 500hPa full column stratosphere sfc
ROy

H2O2, H, H2, H2O, HO2, O1D, OH, RO2

sfc 500hPa full column stratosphere --
Sulfur

SOx, DMS, OCS, SO2, SO4

sfc 500hPa full column stratosphere sfc
Emissions by HEMCO category

Total, Aircraft, Anthro, BioBurn, Biofuel, Biogenic,
Lightning, Monoterp, Natural, Ocean, Seabirds, SenescingPlants,
Ship, Soil,

Emissions tables
J-values sfc 500hPa full column stratosphere -- --
Plots still created by GAMAP

NOTES:

  1. Species category and lumped species definitions are simple to adjust. Updating them requires only editing the json files.
  2. All plots created with GCPy have PDF bookmarks. If you do not see them in your browser try using a different browser (not Safari) or installing an Adobe Acrobat plug-in.

BPCH vs netCDF summary table

Description Simulation properties are listed in a previous section
Comparison
  • Ref: Bpch diagnostic output from the 1-month benchmark for GCC 12.5.0
  • Dev: netCDF diagnostic output from the 1-month benchmark for GCC 12.5.0
Metrics Performance statistics are listed in a previous section
List all SURFACE species, J-Values, and COLUMN AOD values that changed by 10% or more:
  • Aerosols: NIT
  • Nitrogen: HNO3 HNO4 NIT NO NO3 NH3
  • ROy: H2O RO2
  • Iodine: I IBr OIO
  • Bromine: BrOx Br Br2 BrCl BrNO2 BrNO3 BrO HOBr HBr
  • Chlorine: Cl ClO Cl2 Cl2O2 ClOO ClNO3 HCl OClO
  • Secondary_Organics: ISOPN
  • J-Values: CH2Br2 H1301
List all 500 hPa species and J-Values that changed by 10% or more :
  • Nitrogen: NO3 NH3
  • ROy: H2O RO2
  • Iodine: I IBr
  • Bromine: Br Br2
  • Chlorine: Cl Cl2O2 ClOO
  • JValues: All (see note below)
List all ZONAL MEAN species and J-Values that changed by 10% or more:
  • Aerosols: NIT
  • Nitrogen: NIT NH3
  • ROy: RO2
  • Iodine: CH2I2
  • Bromine: Br2 BrNO3 HBr
  • Chlorine: Cl2 Cl2O2 ClNO3 OClO
  • JValues: All (see note below)
List all EMISSIONS that changed by 10% or more:
  • Aircraft: SO2
  • BioBurn: MTPA
  • Ocean: DMS
  • PlantDecay: ALD2 EOH
  • Ship: SO2
  • JValues: All (see note below)
Comments on observed differences: General Comments:
  1. Minor differences for all species can be attributed to the difference in update frequency between bpch and netCDF diagnostics. See our Diagnostic time step wiki page for a complete description.
  2. Some individual bpch diagnostics might not have gotten converted to netCDF. This may account for several missing quantities.
  3. The bpch diagnostics contains less species than the netCDF diagnostics. Therefore, we have only been able to plot those diagnostic quantities that are common to both bpch and netCDF output.
    • In particular, the netCDF diagnostics now archive all species, whereas the bpch diagnostics only archived advected species.
    • This will cause differences in family plots such as NOx and NOy. This is due to the fact that the netCDF diagnostics contain all individual constituents of each family but the bpch diagnostics will not. have all individual species of which the family is composed, but the bpch diagnost

J-Values

  1. The differences in J-Value plots are a result of the bpch ND22 diagnostic archiving local noontime J-values, whereas the netCDF diagnostics used in the benchmark simulations now archive 24-hour averaged J-values.

Emissions:

  1. Most bpch emissions diagnostics were in units of molec/cm2/s. These were converted to kg/m2/s in post-processing (accounting for those hydrocarbon species carried in equivalent carbons).
  2. The differences in MTPA biomass burning might be due to a unit conversion error from the original bpch file.

--Bob Yantosca (talk) 14:14, 15 August 2019 (UTC)