Difference between revisions of "GEOS-Chem v11-01 benchmark history"

From Geos-chem
Jump to: navigation, search
(v11-01d)
(v11-01d)
Line 406: Line 406:
 
|-  
 
|-  
 
|Approved by:
 
|Approved by:
|NOT APPROVED
+
|'''NOT APPROVED'''
 
|-
 
|-
 
|Date of approval:
 
|Date of approval:

Revision as of 15:44, 2 December 2015

On this page we have posted complete information about all benchmark simulations (both 1-month and 1-year) for GEOS-Chem v11-01.

1-year benchmarks

v11-01d-RnPbBe

A 1-year Rn-Pb-Be simulation was performed using GEOS-Chem v11-01d. The simulation utilized 4° x 5° GEOS-FP met fields for the year 2013, with a 4-year spinup. For comparison of the Pb-210 and Be-7 budgets to previous versions, please see the following posts on the Rn-Pb-Be simulation wiki page:

  1. Budget of Pb210 from 1-year benchmark simulations
  2. Budget of Be7 from 1-year benchmark simulations

You may view the benchmark plots for the simulation by pointing your browser to:

http://ftp.as.harvard.edu/gcgrid/geos-chem/1yr_benchmarks/v11-01/v11-01d/RnPbBe/output/

--Melissa Sulprizio (talk) 22:00, 30 October 2015 (UTC)

v11-01d-Run0

Three GEOS-Chem model versions were compared to each other:

Color Quantity Plotted Met Type Year Emissions Chemistry mechanism Wet deposition Annual Mean OH
[105 molec/cm3]
Red v10-01-public-release-Run0 GEOS-FP,
72L, 4x5
2013 Same as v10-01i-Run0 Benchmark chemistry mechanism, includes Same as v9-01-03e-Run0 11.723
Green v11-01b-Run0 GEOS-FP,
72L, 4x5
2013 + Update DMS climatology to Lana
+ Improved dust size distribution scheme
+ Density of OA update
+ Update of PMN + O3 reaction products in globchem.dat file
+ Bug fix for black carbon in ucx_mod.F
+ Impaction scavenging for hydrophobic BC
+ Homogeneous IN removal
+ Now treat DST2-DST4 as coarse mode in wet scavenging
12.000
Blue v11-01d-Run0 GEOS-FP,
72L, 4x5
2013 + CO2 direct effect on isoprene emissions
+ Update biomass burning emissions to GFED4.1
+ Fix for reading hourly NEI2011 emissions
+ Criegee intermediates + Quick fix for low Pb tropospheric lifetime against deposition in GEOS-FP and MERRA2 12.567
Black Observations            

The output plots for Run0 may be downloaded from:

ftp ftp.as.harvard.edu
cd gcgrid/geos-chem/1yr_benchmarks/v11-01/v11-01d/Run0/output
mget *

You may also view the PDF files online by pointing your browser to

http://ftp.as.harvard.edu/gcgrid/geos-chem/1yr_benchmarks/v11-01/v11-01d/Run0/output/

--Melissa Sulprizio (talk) 22:00, 30 October 2015 (UTC)

v11-01b-RnPbBe

A 1-year Rn-Pb-Be simulation was performed using GEOS-Chem v11-01b. The simulation utilized 4° x 5° GEOS-FP met fields for the year 2013, with a 4-year spinup. For comparison of the Pb-210 and Be-7 budgets to previous versions, please see the following posts on the Rn-Pb-Be simulation wiki page:

  1. Budget of Pb210 from 1-year benchmark simulations
  2. Budget of Be7 from 1-year benchmark simulations

You may view the benchmark plots for the simulation by pointing your browser to:

http://ftp.as.harvard.edu/gcgrid/geos-chem/1yr_benchmarks/v11-01/v11-01b/RnPbBe/output/

Comments about the 1-year benchmark v11-01b-nPbBe

Daniel Jacob wrote:

Hongyu, please check out the 15-20% decreases in Pb and Be tropospheric lifetimes against deposition due to scavenging of water-soluble aerosol from cold clouds in 11.1b. Be seems to be improved with reference to your canonical 2001 budget but the Pb loading is 25% lower. What do you think?

Hongyu Liu wrote:

The tropospheric 210Pb lifetime against deposition of 6.6 days (G-C/GEOS-FP) is the shortest among G-C versions. Switching from GEOS-5 to GEOS-FP met fields (v9-02r) reduced 210Pb lifetime from 9.3 to 7.7 days. See: http://wiki.seas.harvard.edu/geos-chem/index.php/Rn-Pb-Be_simulation#Budget_of_Pb210.
If v11-01b had been driven by GEOS-5, the 210Pb lifetime may very well be ~8 days.
Wang, Q. et al. [2014] used G-C/GEOS-5 and "find a lifetime of tropospheric 210Pb aerosol against deposition of 8.6 days, as compared to a best estimate of 9 days constrained by observations [Liu et al., 2001]." So it appears that the short 210Pb lifetime (6.6 days) in v11-01b is largely due to switching to GEOS-FP. Wet deposition needs to be re-evaluated and tuned for GEOS-FP.

--Melissa Sulprizio (talk) 13:49, 19 August 2015 (UTC)

v11-01b-Run0

This 1-year benchmark simulation was approved by the developers and the GEOS-Chem Steering Committee on 19 Aug 2015.

Three GEOS-Chem model versions were compared to each other:

Color Quantity Plotted Met Type Year Emissions Chemistry mechanism Wet deposition Annual Mean OH
[105 molec/cm3]
Red v10-01i-Run0 GEOS-FP,
72L, 4x5
2013 HEMCO emissions component fixes:

UCX chemistry mechanism Same as v9-01-03e-Run0 11.125
Green v10-01-public-release-Run0 GEOS-FP,
72L, 4x5
2013 " " Benchmark chemistry mechanism, includes " " 11.723
Blue v11-01b-Run0 GEOS-FP,
72L, 4x5
2013 + Update DMS climatology to Lana
+ Improved dust size distribution scheme
+ Density of OA update
+ Update of PMN + O3 reaction products in globchem.dat file
+ Bug fix for black carbon in ucx_mod.F
+ Impaction scavenging for hydrophobic BC
+ Homogeneous IN removal
+ Now treat DST2-DST4 as coarse mode in wet scavenging
12.000
Black Observations            

The output plots for Run0 may be downloaded from:

ftp ftp.as.harvard.edu
cd gcgrid/geos-chem/1yr_benchmarks/v11-01/v11-01b/Run0/output
mget *

You may also view the PDF files online by pointing your browser to

http://ftp.as.harvard.edu/gcgrid/geos-chem/1yr_benchmarks/v11-01/v11-01b/Run0/output/

--Melissa Sulprizio (talk) 20:24, 11 August 2015 (UTC)

Comments about the 1-year benchmark v11-01b-Run0

Aerosol differences

Colette Heald wrote:

I took a look at the aerosols in the benchmark. There's one thing I don't quite understand: why are the differences between v11-01b and v10-01i so much larger than the differences between v11-01b and v10-01-public at the surface for NIT, NH4, OCPI (see for example the difference plots for Jan or Jul)? According to the table that Melissa linked to the only difference between the two v10-01 runs are bug fixes and the inclusion of UCX and SOA. The NIT/NH4 may be a knock-on effect from changes in SO4 & HNO3, but I'm at a loss for why OCPI changes so significantly. Perhaps I've misunderstood the changes included those simulations?

Melissa Sulprizio wrote:

The large differences in OCPI are due to the fact that biogenic OC emissions are not calculated in the SOA chemistry mechanism. Before HEMCO, we had the following code in carbon_mod.F:
        IF ( LSOA ) THEN

           ! Total HYDROPHILIC OC source [kg]
           ! (Don't use archived TERP_ORGC if LSOA=T)
           OCSRC(I,J,1) = ANTH_ORGC(I,J,1) + 
    &                     BIOF_ORGC(I,J,1) + 
    &                     BIOB_ORGC(I,J,1)

        ELSE

           ! Total HYDROPHILIC OC source [kg]
           ! (Use archived TERP_ORGC for if LSOA=F)
           OCSRC(I,J,1) = ANTH_ORGC(I,J,1) + 
    &                     BIOF_ORGC(I,J,1) + 
    &                     BIOB_ORGC(I,J,1) + 
    &                     TERP_ORGC(I,J)

        ENDIF
Christoph Keller has treated OCPI in the same manner in HEMCO. If SOA is turned in in GEOS-Chem v10-01 and later versions, HEMCO will not calculate biogenic OCPI emissions.
Many of the other differences between v11-01b and v10-01i can be attributed to last-minute fixes that went into v10-01 prior to the public release (see the complete table of fixes and updates). In particular, the following fixes may have contributed to the differences we’re seeing:
  1. Remove Russia from MIX Asia mask file
  2. Switching to the officially released GFED4 data files
  3. Bug fix in I3 field interpolation (affected temperature-dependent emissions)

Jeff Pierce wrote:

Thanks Melissa. Just to be clear, the SOA mass goes to to the OCPI tracer when the interactive SOA is turned off, but SOA mass goes to other, SOA-specific tracers when the interactive SOA is turned on.

Colette Heald wrote:

Thanks for the clarifications Melissa. I believe then, that other than the dust issue that Li has flagged up, the aerosols look fine for v11.1
Dust differences

Li Zhang wrote:

After checking the results, I found that there are some problems with the Dust3 (DST3) concentrations both at the surface and 500 hPa. It is not only different to the 1-month benchmarks that Lizzie sent me, but also different to the results of our simulations based on GEOS-Chem adjoint code. Both in Lizzie's and my results, that the DST3 concentrations are larger after using our dust scheme.
The DST3 should be supposed to increase, especially over the dust source regions after applying our improved dust scheme. From the dust emission map of DST3, I did see this increase in this benchmarks. However I am surprised that it shows decrease in the concentrations both at the surface and 500 hPa. I am not sure it is due to the coding or only the plotting mistake. It would be great that someone can double check it.

Melissa Sulprizio wrote:

The dust differences that we see in the 1-year benchmark plots for v11-01b are a combination of the following updates:
  1. Improved dust size distribution scheme
  2. Now treat DST2-DST4 as coarse mode in wet scavenging
The second item was identified by Duncan Fairley when we implemented his acid uptake on dust scheme (default off) into the standard code.
The improved dust size distribution scheme decreased DST1 and DST2, while it increased DST3 and DST4. The wet scavenging fix to dust decreased DST2 and DST3.

Colette Heald wrote:

Thanks for the clarification. I can see that this makes sense given the changes. I discussed this with Dave, and I'll just note here (more for the benefit of Jeff and Peter) that the net effect of these changes does appear to be moving us in the wrong direction. The model already underestimates dust export/transport and these further reductions will exacerbate that. Something for us to keep an eye out in the future...

David Ridley wrote:

We’ve mainly been focusing on removal in the outflow from Africa, but there seems to be too much removal in general based on the gradient in dust AOD away from source. However, I’m finding a general lack of dust from Asia in GC too, which is contrary to some previous work. Much of low bias we’re seeing (relative to satellite) comes from earlier and later in the year than the Wang et al. (2012) and Ku et al. (2011) studies that I know of – although the latter study shifts dust emissions around, rather than decreasing them substantially. We’ve been looking over a period of several years, so it is tricky to relate that to the above studies that focus on periods of days to weeks.
It sounds like Duncan’s fix makes sense, but it does highlight potential issues with emission and removal of dust in the model.

--Melissa Sulprizio (talk) 13:46, 19 August 2015 (UTC)

1-month benchmarks

v11-01d

Here is the assessment form for 1-month benchmark simulation v11-01d.

NOTE: The v11-01d 1-month benchmark results used in this form included a "quick fix" for low Pb tropospheric lifetime against deposition in GEOS-FP and MERRA2. Due to high impact on aerosols, the GEOS-Chem Steering Committee rejected the "quick fix", and we have subsequently removed it from the version and performed an additional 1-year benchmark simulation with the updated model.

Description
New features added into GEOS-Chem:

Features affecting the full-chemistry simulation in this benchmark:

Features not affecting the full-chemistry simulation in this benchmark:

Developer name(s) and institution(s):
  • CO2 inhibition: Amos Tai (CUHK)
  • Criegee intermediates: Dylan Millet (U. Minnesota), Eloïse Marais (Harvard)
  • GFED4.1: Prasad Kasibhatla (Duke), Christoph Keller (Harvard)
  • Wet dep fix for high concentrations: Viral Shah (UW)
  • Wet dep fix for low Pb lifetimes: Bo Zhang, Hongyu Liu (NIA / NASA Langley)
  • NEI2011 fix: Viral Shah (UW)
  • Brown carbon updates: Melanie Hammer (Dalhousie)
  • Species database: GCST
  • Tagged Ox fixes: GCST
  • Marine POA fix: GCST
  • Offline Dust Aerosols fix: Seb Eastham (Harvard)
Version, resolution, met fields used: v11-01, GEOS-FP (72L), 4x5, July 2013
1-month benchmark finished on: Thu Oct 29 04:51:06 EDT 2015
Performance statistics:
  • Ran on 8 CPUs of holyseas02
  • Wall time: 10:41:39
  • Scalability: 6.1824
Compared to previous benchmark: v11-01c
This update will impact:
(select all that apply with boldface)
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify):
Unit test results may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-01/v11-01d/v11-01d.results.html
  • NOTE: Unit tests for tagged CO were not performed, since this simulation is not yet 100% compatible with HEMCO.
Plots may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-01/v11-01d/
Metrics
Global mean OH (from log file): 12.9458396071682 x 105 molec/cm3
Methyl chloroform lifetime: 4.8665 years
Did either of these change by more than 5%? No. The mean OH differs by 2.39%, and the MCF lifetime differs by -1.83%.
At the SURFACE, list all species that changed by 10% or more: NO, PAN, CO, ALK4, ISOP, HNO3, H2O2, MEK, ALD2, RCHO, MVK, MACR, PMN, PPN, R4N2, PRPE, C3H8, CH2O, C2H6, N2O5, HNO4, DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, DST1, DST2, DST3, DST4, SALA, SALC, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, MOBA, HAC, GLYC, MMN, RIP, IEPOX, MAP, NO2, NO3, HNO2, BrCl, HCl, Cl, ClO, HOCl, ClNO3, ClNO2, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG3, TSOG0, TSOA1, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOG1, ASOG2, ASOG3, ASOGAN, ASOA1, ASOA2, ASOA3, OH, HO2
Comments on SURFACE differences:
  • The biomass burning emissions update to GFED4.1 reduced the concentrations of species in the northern latitudes, particularly over Canada and northern Asia. These species include NO, PAN, CO, ALK4, HNO3, ACET, MEK, ALD2, RCHO, R4N2, PPN, PRPE, C3H8, CH2O, C2H6, N2O5, HNO4, SO2, SO4, NH3, NH4, NIT, BCPI, OCPI, BCPO, OCPO, MPN, ISOP, NO2, HNO2, TSOA0, TSOA2, TSOA3, ISOA1, ISOA2, and ISOA3. There are also increases in the northern latitudes for some species, including H2O2, MP, TSOG2, ASOAN, OH, and HO2.
  • The fix for reading hourly NEI2011 emissions reduced concentrations of species primarily over the United States. These species include: NO, ALK4, MEK, ALD2, RCHO, PPN, R4N2, C3H8, N2O5, DMS, OCPI, BCPO, OCPO, RIP, NO2, NO3, HNO2, TSOA2, TSOA3, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOG1, ASOG2, ASOG3, ASOAN, ASOA1, ASOA2, and ASOA3. Concentrations for NH3 and NIT decreased over the western part of the United States and increased over the eastern part.
  • The wet deposition fix caused widespread increase in concentrations for many species including all aerosols. Species impacted include: NO, ISOP, HNO3, H2O2, MVK, MACR, PMN, PPN, PRPE, N2O5, HNO4, DMS, SO2, SO4, SO4, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, DST1, DST2, DST3, DST4, SALC, SALA, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, GLYC, MMN, MOBA, RIP, IEPOX, NO2, NO3, HNO2, BrCl, HCl, Cl, ClO, ClNO3, HOCl, ClOO, OClO, Cl2, Cl202, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG3, TSOG0, TSOA1, TSOA2, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA3, TOLU, XYLE, ASOG1, ASOG2, ASOG3, ASOAN, ASOA1, ASOA2, ASOA3, OH, and HO2.
  • The addition of Criegee intermediates resulted in widespread increases in MPN but concentrations are all low.
  • Randomly distributed small differences in NH3 and NIT can be attributed to numerical drift caused by ISORROPIA.
  • All other differences can be attributed to small numerical differences when concentrations are very low.
At 500 hPa, list all species that changed by 10% or more: NO, ALK4, ISOP, HNO3, H2O2, MEK, RCHO, MVK, MACR, PMN, R4N2, PRPE, C3H8, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, DST1, DST2, DST3, DST4, SALA, SALC, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, MOBA, HAC, GLYC, MMN, RIP, IEPOX, MAP, NO2, NO3, HNO2, BrCl, HCl, Cl, ClO, HOCl, ClNO3, ClNO2, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG3, TSOG0, TSOA1, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOG1, ASOG2, ASOG3, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2
Comments on 500 hPa differences:
  • See comments for surface differences above
In the ZONAL MEAN differences, list all species that changed by 10% or more: NO, PAN, ISOP, HNO3, H2O2, ALD2, MVK, MACR, PMN,PPN, PRPE, C3H8, N2O5, HNO4, MP,

DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, DST1, DST2, DST3, DST4, SALA, SALC, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, MOBA, HAC, GLYC, MMN, IEPOX, MAP, NO2, NO3, HNO2, BrCl, HCl, Cl, ClO, HOCl, ClNO3, ClNO2, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG3, TSOG0, TSOA1, TSOA2, TSOA3, TSOA0, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ISOA3, TOLU, XYLE, ASOG1, ASOG2, ASOG3, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2

Comments on ZONAL MEAN differences:
  • Most of the differences are explained by the wet deposition fix which impacted the troposphere.
  • Some of the decreases in the zonal mean in the upper latitudes is explained by the GFED and NEI updates.
In the EMISSION RATIO maps, list all species that changed by 10% or more:
  • Anthro emissions: BC, NH3, OC, SO2
  • Anthro + Biofuel emissions: ACET, ALD2, ALK4, C3H8, CH2O, CO, MEK, NO, PRPE, SO4
  • Biomass emissions: C2H6, BC, NH3, OC, ACET, ALD2, ALK4, C3H8, CH2O, CO, MEK, NO, PRPE, SO2
Comments on EMISSION RATIO differences:
Additional or summary comments:
  • The quick fix for wet deposition in GEOS-FP/MERRA2 turns off scavenging of aerosol species where T < 258 K. As explained above, this attributes for some of the increased concentration of aerosol species above 500 hPa in the zonal mean ratio and difference plots.
Approval
Requires further investigation: Peter Adams writes:

"The “quick fix” implemented by Hongyu to wet scavenging has significant effects on aerosols species. Most notably, free tropospheric levels of sulfate and black carbon increase by a factor of ~2. Changes in overall burdens are less, of course, but still significant.

With a change of this magnitude for aerosols, we would much rather proceed with something that has undergone some substantial vetting. Based on our communications with Hongyu, this is very much a “quick fix” – one that his group will be evaluating in much more detail in the next months. We all know that wet deposition lifetimes are the result of a bunch of contributing processes. As far as I can tell, we are not sure that making a change specifically to cold cloud scavenging pushes us in the right direction for the right reasons.

For these reasons, both Colette and I recommend removing – at least for now – Hongyu’s cold cloud fix until it gets more evaluation. To be clear, this is more for the sake of making significant changes to physics only after careful evaluation rather than clear-cut observational evidence that model predictions are better/worse with or without the fix."

Approved by: NOT APPROVED
Date of approval: TBD

--Lizzie Lundgren (talk) 20:12, 22 October 2015 (UTC)
--Bob Y. (talk) 20:44, 29 October 2015 (UTC)

v11-01c

Here is the assessment form for 1-month benchmark simulation v11-01c.

Description
New features added into GEOS-Chem:

Features affecting the full-chemistry simulation in this benchmark:

Features not affecting the full-chemistry simulation in this benchmark:

Developer name(s) and institution(s):
  • Sea salt alkalinity fix: Johan Schmidt (Harvard)
  • ND21 fix: Sebastian Eastham (MIT)
  • ND46 fix: Jared Brewer (CSU)
  • PAH updates: Carey Friedman (MIT)
  • Hg MLD fixes: Amanda Giang (MIT)
  • Hg ocean rates: Shaojie Song (MIT)
  • Hg Arctic updates: Jenny Fisher (Wollongong)
  • Hg emission updates: Yanxu Zhang (Harvard), Amanda Giang (MIT)
  • GEOS-5 OTD-LIS fix: Christoph Keller (Harvard), Lu Hu (Harvard)
  • Custom nested grid fix: Shannon Koplitz (Harvard), GCST
  • GC Timers: Matt Yannetti (GCST)
  • MERRA2: Bob Yantosca (GCST)
Version, resolution, met fields used: v11-01, GEOS-FP (72L), 4x5, July 2013
1-month benchmark finished on: Thu Sep 10 02:22:53 EDT 2015
Performance statistics:
  • Ran on 8 CPUs of holy2a11201
  • Wall time: 8:27:55
  • Scalability: 6.7299
Compared to previous benchmark: v11-01b
This update will impact:
(select all that apply with boldface)
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify): Diagnostics, Mercury simulation, POPs simulation
Unit test results may be viewed at: ftp://ftp.as.harvard.edu/pub/exchange/mpayer/1mo_quick_look/v11-01c/v11-01c.results.html
  • NOTE: Unit tests for tagged CO were not performed, since this simulation is not yet 100% compatible with HEMCO.
Plots may be viewed at: ftp://ftp.as.harvard.edu/pub/exchange/mpayer/1mo_quick_look/v11-01c/
Metrics
Global mean OH (from log file): 12.6434767011206 x 105 molec/cm3
Methyl chloroform lifetime: 4.9570 years
Did either of these change by more than 5%? No. The mean OH differs by -0.01%, and the MCF lifetime differs by 0.02%.
At the SURFACE, list all species that changed by 10% or more: HNO3, N2O5, SO2, SO4, SO4s, NH3, NH4, NIT, NITs
Comments on SURFACE differences:
At 500 hPa, list all species that changed by 10% or more: SO4s, NH3, NH4, NIT, NITs
Comments on 500 hPa differences:
  • See comments for SURFACE DIFFERENCES above.
In the ZONAL MEAN differences, list all species that changed by 10% or more: HNO3, SO2, SO4, SO4s, NH3, NH4, NIT, NITs, LIMO
Comments on ZONAL MEAN differences:
  • See comments for SURFACE DIFFERENCES above.
  • Differences in LIMO can be attributed to small number differences where concentrations are very low.
In the EMISSION RATIO maps, list all species that changed by 10% or more: None
Comments on EMISSION RATIO differences:
  • Differences in MONX, APIN, BPIN, LIMO, SABI, MYRC, CARE, OCIM, OMON, FARN, BCAR, and OSQT in the v11-01c.emission.fullchem file are caused by the bug fix for the ND46 diagnostic.
Additional or summary comments:
  • The GEOS-5 Hg unit test return inconsistent differences in the HG-SRCE diagnostic and the ocean restart files when using multiple processors vs a single processor. For more information see this wiki post.
  • Peter Adams wrote:
Benchmarks look good to me. As Daniel noted, there are relatively large reductions in HNO3, SO2, sulfate in the oceans (esp SH) of around 25-50% - consistent with the described bug fix for sea salt alkalinity. There are very large (ratio) increases in sea-salt associated sulfate and nitrate (SO4s and NITs) that partly compensate. The absolute magnitude of the sulfate decrease is ~0.1 ug/m3 or less, so these are unlikely to change comparisons to obs much.
Approval
Requires further investigation: No
Approved by: Johan Schmidt, Peter Adams, Daniel Jacob
Date of approval: 14 Sep 2015

--Melissa Sulprizio (talk) 21:36, 11 September 2015 (UTC)

v11-01b

Here is the assessment form for 1-month benchmark simulation v11-01b.

Description
New features added into GEOS-Chem:

Features affecting the full-chemistry simulation in this benchmark:

Features not affecting the full-chemistry simulation in this benchmark:

Developer name(s) and institution(s):
  • Lana DMS: Tom Breider (Harvard)
  • Impaction scavenging for BCPO: Qiaoqiao Wang (Max Planck Institute)
  • Homogeneous IN removal: Qiaoqiao Wang (Max Planck Institute)
  • Density of OA: Melanie Hammer (Dalhousie), Eloïse Marais (Harvard)
  • Improved dust distribution: Li Zhang (Colorado U.), Daven Henze (Colorado U.)
  • Dust fix for wet scavenging: T. Duncan Fairlie (NASA/LARC)
  • globchem.dat fix: Dylan Millet (UMN)
  • UCX fix for BC: Sebastian Eastham
  • BrC UV absorption: Melanie Hammer (Dalhousie)
  • Acid uptake on dust: T. Duncan Fairlie (NASA/LARC)
  • Marine POA: Brett Gantt (NCSU), Matthew Johnson (NASA Ames)
  • RRTMG fixes: Sebastian Eastham (MIT), David Ridley (MIT)
  • PGI compiler fix: GEOS-Chem Support Team
Version, resolution, met fields used: v11-01, GEOS-FP (72L), 4x5, July 2013
1-month benchmark finished on: Mon Jul 27 18:27:44 2015
Performance statistics:
  • Ran on 8 CPUs of bench@titan-10.as.harvard.edu (2.659 GHz x 8 CPU)
  • Wall time: 7:56:50
  • Scalability: 6.7733
Compared to previous benchmark: v11-0a
This update will impact:
(select all that apply with boldface)
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify):
Unit test results may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-01/v11-01b/v11-01b.results.html
  • NOTE: Unit tests for tagged CO were not performed, since this simulation is not yet 100% compatible with HEMCO.
Plots may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-01/v11-01b/
Metrics
Global mean OH (from log file): 12.6447244306942 x 105 molec/cm3
Methyl chloroform lifetime: 4.9562 years
Did either of these change by more than 5%? No. The mean OH differs by 0.57%, and the MCF lifetime differs by -0.73%.
At the SURFACE, list all species that changed by 10% or more: NO, PAN, ALK4, ISOP, HNO3, H2O2, MEK, ALD2, RCHO, MVK, MACR, PMN, PPN, R4N2, PRPE, C3H8, CH2O, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, MSA, NH3, NIT, NITs, BCPI, OCPI, BCPO, OCPO, DST1, DST2, DST3, DST4, SALA, SALC, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, MOBA, HAC, GLYC, MMN, RIP, IEPOX, MAP, NO2, NO3, HNO2, BrCl, Cl, ClO, HOCl, ClNO3, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TSOG1, TSOG3, TSOG0, TSOA1, TSOA2, TSOA3, ISOG2, ISOA1, ISOA2, ISOA3, BENZ, TOLU, XYLE, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2
Comments on SURFACE differences:
  • Differences in NO, PAN, ALK4, ISOP, R4N2, PRPE, C3H8, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, NO2, BrCl, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTOP, TSOG1, TSOG3, TSOA1, TSOA2, TSOA3, TSOA0, ISOA1, XYLE, ASOAN, ASOA1, ASOA2, and ASOA3 over oceans or the poles are mainly small number differences where concentrations are very low, especially ISOP and its related species
  • The impaction scavenging for hydrophobic BC and homogeneous IN removal updates contributes to changes in N2O5, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, SALA, SALC, Br2, Br, BrO, HBr, BrNO3, Cl, TSOG0, TSOA0-3, ISOA1-3, ASOG1, ASOAN, ASOA1-3.
  • The update to the dust size distribution scheme causes a decrease in DST1 and DST2 concentrations and an increase in DST4 concentrations.
  • The fix for the treatment of dust in wet deposition also impacts the dust tracers, contributing to the decrease in DST2 and DST3 concentrations. In addition, this update causes a decrease in column AOD for dust over Africa, which leads to differences over Africa for the following tracers: H2O2, ALD2, RCHO, MVK, MACR, PMN, PPN, PRPE, N2O5, HNO4, MP, DMS, SO2, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, MOBA, HAC, GLYC, MMN, RIP, IEPOX, MAP, NO3, HNO2, BrCl, Cl, ClO, HOCl, ClNO3, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, TOLU, XYLE, OH, HO2.
  • The update to Lana DMS climatology causes differences over the oceans in the following tracers: HNO3, MVK, MACR, PMN, PPN, CH2O, N2O5, DMS, SO2, SO4, SO4s, MSA, and NH3, NH4, NIT, NITs, Br2, BrNO3, MPN, ISOPN, MOBA, RIP, IEPOX, NO2, NO3, HNO2, MTPA, LIMO, MTPO. Some of these tracers are also impacted by the dust changes listed above.
At 500 hPa, list all species that changed by 10% or more: NO, ALK4, ISOP, HNO3, H2O2, MEK, ALD2, RCHO, MVK, MACR, PMN, PPN, R4N2, PRPE, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, DST1, DST2, DST3, DST4, SALA, SALC, Br2, Br, BrO, HOBr, HBr, BrNO2, BrNO3, MPN, ISOPN, MOBA, HAC, GLYC, MMN, RIP, IEPOX, MAP, NO3, HNO2, BrCl, HOCl, ClNO2, OClO, Cl2, MTPA, LIMO, MTPO, TSOG1, TSOG0, TSOA1, TSOA2, TSOA3, ISOG1, ISOG2, ISOA1, ISOA2, ISOA3, TOLU, XYLE, ASOG1, ASOG2, ASOAN, ASOA1, ASOA2, ASOA3, OH, HO2
Comments on 500 hPa differences: See comments for SURFACE DIFFERENCES above.
In the ZONAL MEAN differences, list all species that changed by 10% or more: ISOP, HNO3, H2O2, MVK, MACR, PMN, PRPE, N2O5, HNO4, MP, DMS, SO2, SO4, SO4s, MSA, NH3, NH4, NIT, NITs, BCPI, OCPI, BCPO, OCPO, DST1, DST2, DST3, DST4, SALA, SALC, Br2, HOBr, HBr, BrNO3, ISOPN, MOBA, MMN, RIP, NO3, HNO2, Cl, HOCl, ClOO, MTPA, LIMO, MTPO, TSOG1, TSOG2, TSOG3, TSOG0, TSOA1, TSOA2, TSOA3, TSOAO, ISOG1, ISOG2, ISOG3, ISOA1, ISOA2, ASOG1, ASOG2, ISOA3, ASOG3, ASOGAN, ASOA1, ASOA2, ASOA3, OH, HO2
Comments on ZONAL MEAN differences:
  • Differences in BCPO in the stratosphere are due to the fix for black carbon in ucx_mod.
  • For all other differences, see comments for SURFACE DIFFERENCES above.
In the EMISSION RATIO maps, list all species that changed by 10% or more:
  • Biogenic emissions: DMS
  • Dust emissions: DST1, DST2, DST4
Comments on EMISSION RATIO differences:
Additional or summary comments:
  • The change in organic aerosol density for calculating aerosol optical depth was expected to cause a 40% increase in organic carbon AOD. This consistent with the v11-01b AOD plots for OC.
Approval
Requires further investigation: No
Approved by: GCST, Eloise Marais, Tom Breider, Daniel Jacob
Date of approval: 04 Aug 2015

--Lizzie Lundgren (talk) 19:16, 30 July 2015 (UTC)
--Melissa Sulprizio (talk) 22:01, 30 July 2015 (UTC)

v11-01a

Here is the assessment form for 1-month benchmark simulation v11-01a.

Description
New features added into GEOS-Chem:

Features affecting the full-chemistry simulation in this benchmark:

Features not affecting the full-chemistry simulation in this benchmark:

Developer name(s) and institution(s):
Version, resolution, met fields used: v11-01, GEOS-FP (72L), 4x5, July 2013
1-month benchmark finished on: Thurs Jul 02 00:00:12 EDT 2015
Performance statistics:
  • Ran on 8 CPUs of bench@titan-10.as.harvard.edu (2.659 GHz x 8 CPU)
  • Wall time: 7:46:50
  • Scalability: 6.8812
Compared to previous benchmark: v10-01-public-release with SOA on
This update will impact:
(select all that apply with boldface)
Advection, BL Mixing, Convection, Met Fields, Dry Dep, Wet Dep, Stratosphere, Anthro Emiss, Biogenic Emiss, Biomass Emiss, Photolysis, Chemistry, Other (please specify): Tracer Unit Conversions, Air Quantities (e.g. box height and air mass), RRTMG
Unit test results may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-01/v11-01a/v11-01a.results.html
  • NOTE: Unit tests for tagged CO were not performed, since this simulation is not yet 100% compatible with HEMCO.
Plots may be viewed at: http://ftp.as.harvard.edu/gcgrid/geos-chem/1mo_benchmarks/v11-01/v11-01a/
Metrics
Global mean OH (from log file): 12.5726451325898 x 105 molec/cm3
Methyl chloroform lifetime: 4.9926 years
Did either of these change by more than 5%? No. The mean OH differs by 0.50%, and the MCF lifetime differs by -0.58%.
At the SURFACE, list all species that changed by 10% or more: NO, ISOP, HNO3, MVK, MACR, PMN, N2O5, NH4, NIT, NITs, OCPO, DST1, DST2, DST3, DST4, Br, BrO, HOBr, ISOPN, MOBA, GLYC, MMN, RIP, IEPOX, BrCl, Cl, ClO, ClNO2, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, ASOA2, ASOA3
Comments on SURFACE differences:
  • All differences are small number differences where concentrations are very low and may be attributed to numerical noise.
    • Especially ISOP and its related species
At 500 hPa, list all species that changed by 10% or more: NO, ISOP, MVK, MACR, PMN, PRPE, NH3, NIT, OCPO, DST3, DST4, Br, ISOPN, MOBA, GLYC, RIP, IEPOX, BrCl, Cl, ClO, ClNO2, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO
Comments on 500 hPa differences:
  • Small differences in NH3 and NIT can be attributed to numerical drift caused by ISORROPIA.
  • All other differences are small number differences where concentrations are very low and therefore can be attributed to numerical noise.
    • Especially ISOP and its related species
In the ZONAL MEAN differences, list all species that changed by 10% or more: NO, ALK4, ISOP, HNO3, MVK, MACR, PMN, PRPE, C3H8, N2O5, SO4s, NH3, NIT, NITs, BCPO, OCPO, DST1, DST2, DST3, DST4, SALC, Br, HBr, BrNO3, ISOPN, MOBA, GLYC, MMN, RIP, IEPOX, OCS, BrCl, CCl4, CH3CCl3, CFC11, H1211, H1301, H24O2, Cl, ClO, ClNO2, ClOO, OClO, Cl2, Cl2O2, MTPA, LIMO, MTPO, ISOA2, TOLU,
Comments on ZONAL MEAN differences:
  • NO, Br, HBr, Cl, ClO, ClOO: Differences for these species are around the South Pole only and reflect small number differences where concentrations are very low.
  • C3H8, N2O5, Br2, BrNO3, HAC, OCS, CCl4, CH3CCl3, CFC11, H1211, H1301, H2402: Differences for these species are in the top few pressure levels only. The small differences occur where concentrations are very low and therefore are attributable to numerical noise.
  • ALK4, PRPE, SO4s, NIT, NITs, BCPO, SALC, TOLU: Differences for these species are only within the stratosphere. The small number differences occur only where concentrations are very low and therefore are attributable to numerical noise.
  • ISOP, HNO3, MVK, MACR, PMN, OCPO, DST1, DST2, DST3, DST4, ISOPN, MOBA, GLYC, MMN, RIP, IEPOX, BrCl, Cl202, Cl2, ClNO2, OClO, Cl2, MTPA, LIMO, MTPO: All differences for these species reflect small number differences where concentrations are very low.
  • Small differences in NH3 and NIT may be attributed to numerical drift caused by ISORROPIA.
  • Some species (NO2, CH4, H2O, OH) show nonzero absolute differences but percent differences less than +/-10%. These are likely caused by the air quantity moisture fixes.
In the EMISSION RATIO maps, list all species that changed by 10% or more: None
Comments on EMISSION RATIO differences:
  • The emission totals for NO changed slightly for several sources: soil and fertilizer (both by -0.000030 Tg N), anthropogenic + biomass burning (by 0.000081 Tg N), and lightning (by 0.005719 Tg N).
-We believe that the small changes in soil NO emissions are due to changes in the atmospheric concentrations associated with the air quantity moisture fixes since these NO emissions are dependent on NOy deposition.
-The small changes in lightning NO emissions appear to arise from the effects of air quantity moisture fixes on variables such as derived cloud top height that affect the lightning parametrization.
-The small changes in anthropogenic + biofuel NO emissions are due to changes in NOx concentrations from the moisture updates feeding back into PARANOX and therefore affecting ship NO emissions. In addition, PARANOX uses air volume and air volume values changed slightly in the new release due to a bug fix in box height.
  • The emission totals for hydrophilic tracer from hydrophobic tracer changed slightly for black carbon (by -0.004145 Tg C) and organic carbon (by -0.012820 Tg C).
Additional or summary comments:
  • The air quantity updates most strongly impact long-lasting tracers such as carbon dioxide for which transport processes dominate. For this reason, the Carbon Working Group has independently evaluated the proposed changes and are incorporating them into the Adjoint model. We therefore recommend that GEOS-Chem users run v11-01 rather than v10-01 for methane and carbon dioxide simulations.
Approval
Requires further investigation: September 3, 2015 update: Version 11-01a dry mixing ratios show a moisture artefact while tracer total mixing ratios [kg/kg] do not show a moisture artefact. There is debate over which mixing ratio, dry or total, should show the moisture artefact.

Legacy versions of GEOS-Chem appear to rely on an implicit assumption of the "same" mixing ratio throughout, including input, output, and transport. Given that total air mass is used for conversions, we assume this "same" mixing ratio is total mixing ratio. Given that (1) legacy versions of GEOS-Chem use the "same" mixing ratio for transport and input/output, and (2) mixing ratios in legacy versions of GEOS-Chem do not show a moisture signature, then it makes sense that we now see a moisture signature in the input/output dry mixing ratio but not the total mixing ratio. This is because the tracer mass distribution is driven by transport not the restart file concentration.

To address this issue, we will change input and output to be total mixing ratio and use total air rather than dry air molecular weight to extract moles from total mixing ratio where necessary. This will make v11-01a consistent with legacy GEOS-Chem while correcting the mixing ratio to mass unit conversion error that was the primary motivation for v11-01a. This change will be incorporated into a future v11-01 version. The Carbon and Transport Working Groups will look into the issue of the moisture signature in dry vs. total mixing ratio and provide a recommendation.

Approved by: GCST
Date of approval: July 7, 2015

--Lizzie Lundgren (talk) 18:00, 3 September 2015 (UTC)