Difference between revisions of "GEOS-Chem High Performance Working Group"

From Geos-chem
Jump to: navigation, search
(Welcome)
 
(39 intermediate revisions by 10 users not shown)
Line 1: Line 1:
'''''[[GEOS-Chem_HP|GCHP Home]]'''''
+
'''''[[GEOS-Chem_HP|GCHP Main Page]]'''''
  
== Welcome ==
+
In March 2022, [https://lae.mit.edu/team/sebastian-eastham Sebastian Eastham] (GitHub: [https://github.com/sdeastham @sdeastham]) was named '''GCHP Model Scientist''' and the GEOS-Chem High Performance Working Group was disbanded.
Welcome to the [[GCHP|GEOS-Chem High Performance (GCHP)]] Working Group wiki page! GCHP represents the next generation of GEOS-Chem with a distributed memory capability enabling efficient scaling across many cores and finer resolution simulations. GCHP also has the advantage of using a cubed-sphere geometry enabling more accurate transport and eliminating the polar singularity inherent to lat-lon grids.
+
 
+
If you are working on a project using GCHP, please add your name and project description to the [[GEOS-Chem_High_Performance_Working_Group#Current_GCHP_Projectss|GCHP projects list]] located on this page. Also help us pool performance information across systems by contributing your GCHP run information, including your system specifications, on our [[GCHP_Timing_Tests|GCHP Timing Tests page]].
+
 
+
If you would like to stay informed of GCHP developments, please join the [[GEOS-Chem_High_Performance_Working_Group#Email|GEOS-Chem High Performance Working Group mailing list]]. We also encourage you to join our [[GEOS-Chem_High_Performance_Working_Group#Slack|GCHP Slack workspace]]. Please contact the [[GEOS-Chem_Support_Team|GEOS-Chem Support Team]] with GCHP questions and feedback.
+
 
+
== Contact information ==
+
 
+
=== Email ===
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|-valign="top"
+
!bgcolor="#CCCCCC"|GEOS-Chem HP Working Group Chairs
+
|
+
*[mailto:randall.martin@dal.ca Randall Martin]
+
*[mailto:seastham@mit.edu Sebastian Eastham]
+
 
+
|-valign="top"
+
!width="300px" bgcolor="#CCCCCC"|GEOS-Chem HP email list
+
|width="600px"|<tt>geos-chem-hp [at] g.harvard.edu</tt>
+
 
+
|-valign="top"
+
!bgcolor="#CCCCCC"|To subscribe to email list
+
|Either
+
*Send an email to <tt>geos-chem-hp+subscribe [at] g.harvard.edu</tt>
+
Or
+
*Go to the [https://groups.google.com/a/g.harvard.edu/forum/#!forum/geos-chem-hp GEOS-Chem High-Performance Computing Google Group]
+
*Click on '''Subscribe to this group'''
+
 
+
|-valign="top"
+
!bgcolor="#CCCCCC"|To unsubscribe from email list
+
|Either
+
*Send an email to <tt>geos-chem-hp+unsubscribe [at] g.harvard.edu</tt>
+
Or
+
*Go to the [https://groups.google.com/a/g.harvard.edu/forum/#!forum/geos-chem-hp GEOS-Chem High-Performance Computing Google Group]
+
*Click on the '''My Settings''' button
+
*Click on '''Leave this group'''
+
 
+
|}
+
 
+
=== Slack ===
+
 
+
The GCHP workspace on Slack facilitates easy communication between GCHP users. Contact the Lizzie Lundgren (elundgren [at] seas.harvard.edu) to join.
+
 
+
== HP Computing Platforms ==
+
If you are a GCHP user, please add your system information below.
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|-valign="top" bgcolor="#cccccc"
+
!width="200px"|User Group
+
!width="600px"|Platform and OS
+
!width="300px"|Contact Person
+
 
+
|-valign="top"
+
|Dalhousie
+
|'''Platform:''' Linux 2.6.18; '''OS:''' CentOS 5.7
+
|[mailto:jn231250@Dal.Ca Junwei Xu]
+
 
+
|-valign="top"
+
|Dalhousie
+
|'''Platform:''' Linux 2.6.32; '''OS:''' Red Hat 6.4
+
|[mailto:jn231250@Dal.Ca Junwei Xu]
+
 
+
|-valign="top"
+
|Harvard
+
|'''Platform:''' Linux 3.10.0; '''OS:''' CentOS 7.4.1707<br>Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz
+
|[[GEOS-Chem Support Team]]
+
 
+
|-valign="top"
+
|MIT [Selin group]
+
|'''Platform:''' Linux 4.9.13; '''OS:''' Fedora 24
+
|[mailto:darothen@mit.edu Daniel Rothenberg]
+
 
+
|-valign="top"
+
|MIT [LAE]
+
|'''Platform:''' Linux 3.13.0; '''OS:''' Ubuntu 14.04 LTS
+
|[mailto:seastham@mit.edu Sebastian D Eastham]
+
 
+
|-
+
|'''Add yours here!'''
+
|&nbsp;
+
|&nbsp;
+
|}
+
 
+
== Current GCHP Projects ==
+
If you are working on a project using GCHP, please add your group name, contact information, and a short description of your project to the table below.
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|- bgcolor="#cccccc"
+
!width="200px"|User Group
+
!width="600px"|Description
+
!width="300px"|Contact Person
+
 
+
|-
+
|Harvard
+
|Core development, validation, and documentation
+
|[http://people.seas.harvard.edu/~elundgren Lizzie Lundgren]
+
 
+
|-
+
|Jintai Lin (ACM @ PKU)
+
|Impacts of small-scale processes on global and regional chemistry (OH, O3 and CO in particular)
+
|[mailto:linjt@pku.edu.cn Jintai Lin]
+
 
+
|-
+
|Christoph Keller
+
|Coupling of GEOS-Chem to the GEOS Earth System Model and Data Assimilation System.
+
|[mailto:ckeller@seas.harvard.edu Christoph Keller]
+
 
+
|-
+
|Daniel Rothenberg (Selin Group @ MIT)
+
|Offline simulations with CESM/CAM meteorology
+
|[mailto:darothen@mit.edu Daniel Rothenberg]
+
 
+
|-
+
|'''Add yours here!'''
+
|&nbsp;
+
|&nbsp;
+
|}
+
 
+
== GCHP User Reports ==
+
If you are using GCHP, whether for a scientific project or simply to test out on your local system, please share your successes here. We also encourage you to join the GCHP Slack channel to connect with other users. Please report any bugs you find to the GEOS-Chem Support Team so that we can add them to the [[GEOS-Chem_HP_v11-02#Outstanding_HP_issues_not_yet_resolved_in_GEOS-Chem_v11-02|GCHP outstanding issues page]].
+
 
+
To fill out this section, copy the template and fill out your information. You can add as many runs as you wish. Feel free to edit the tables to best suit the information you are trying to show.
+
 
+
=== Template: your name and group here ===
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|- valign="top" bgcolor="#cccccc"
+
!width="60px"|Cluster name
+
!width="60px"|Compilers
+
!width="60px"|MPI
+
!width="60px"|NetCDF library
+
!width="60px"|# of Nodes
+
!width="60px"|# or CPUs
+
!width="60px"|GCHP version
+
!width="60px"|Grid resolution
+
!width="60px"|Duration [days:hrs]
+
!width="60px"|Met source
+
!width="60px"|Met resolution
+
!width="60px"|Dynamic timestep [min]
+
!width="60px"|Chemistry timestep [min]
+
!width="60px"|Total run time [hrs]
+
 
+
|-valign="top"
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
 
+
|}
+
 
+
Add notes here.
+
 
+
=== Bob Yantosca (GCST @ Harvard) ===
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|- valign="top" bgcolor="#cccccc"
+
!width="60px"|Cluster name
+
!width="60px"|Compilers
+
!width="60px"|MPI
+
!width="60px"|NetCDF library
+
!width="60px"|# of Nodes
+
!width="60px"|# or CPUs
+
!width="60px"|GCHP version
+
!width="60px"|Grid resolution
+
!width="60px"|Duration [days:hrs]
+
!width="60px"|Met source
+
!width="60px"|Met resolution
+
!width="60px"|Dynamic timestep [min]
+
!width="60px"|Chemistry timestep [min]
+
!width="60px"|Total run time [hr:min]
+
 
+
|-valign="top"
+
|Odyssey
+
|gfortran 8.2.0
+
|OpenMPI 3.1.1
+
|netcdf 4.1.3
+
|1
+
|6
+
|?
+
|C24
+
|00:06
+
|GEOS-FP
+
|0.25&deg; x 0.3125&deg;
+
|10
+
|20
+
|00:17
+
 
+
|-valign="top"
+
|Odyssey
+
|gfortran 7.1.0
+
|OpenMPI 3.1.1
+
|netcdf 4.1.3
+
|1
+
|6
+
|?
+
|C24
+
|00:06
+
|GEOS-FP
+
|0.25&deg; x 0.3125&deg;
+
|10
+
|20
+
|00:19
+
 
+
|}
+
 
+
'''NOTES:'''
+
*Timing tests reflect a 6-hour GCHP "out-of-the-box" run (with run directory "gchp_standard").  Such tests allow us to verify that updates made in the GEOS-Chem "Classic" code base won't break GCHP.
+
*This version of GCHP corresponds to [[GEOS-Chem 12#12.0.1|GEOS-Chem "Classic" version 12.0.1]].
+
 
+
=== Colin Lee, Dalhousie University ===
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|-valign="top" bgcolor="#cccccc"
+
!width="60px"|Cluster name
+
!width="60px"|Compilers
+
!width="60px"|MPI
+
!width="60px"|NetCDF library
+
!width="60px"|# of Nodes
+
!width="60px"|# of CPUs
+
!width="60px"|GCHP version
+
!width="60px"|Grid resolution
+
!width="60px"|Duration [days-hrs]
+
!width="60px"|Met source
+
!width="60px"|Met resolution
+
!width="60px"|Dynamic timestep [min]
+
!width="60px"|Chemistry timestep [min]
+
!width="60px"|Total run time [hrs]
+
 
+
|-valign="top"
+
|Graham
+
|ifort 2016
+
|openmpi 2.1.1
+
|4
+
|1
+
|24
+
|???
+
|c24
+
|31-0
+
|GEOS-FP
+
|2x25
+
|10
+
|20
+
|14:22
+
 
+
|-valign="top"
+
|Graham
+
|ifort 2016
+
|openmpi 2.1.1
+
|4
+
|4
+
|96
+
|???
+
|c96
+
|0-1
+
|GEOS-FP
+
|2x25
+
|5
+
|20
+
|0:18
+
 
+
|-valign="top"
+
|Graham
+
|ifort 2016
+
|openmpi 2.1.1
+
|4
+
|4
+
|96
+
|???
+
|c96
+
|0-1
+
|GEOS-FP
+
|0.25x0.3125
+
|5
+
|20
+
|0:30
+
 
+
|-valign="top"
+
|Graham
+
|ifort 2016
+
|openmpi 2.1.1
+
|4
+
|72
+
|864
+
|???
+
|c360
+
|0-1
+
|GEOS-FP
+
|2x2.5
+
|5
+
|20
+
|1:30
+
 
+
|-valign="top"
+
|Graham
+
|ifort 2016
+
|openmpi 2.1.1
+
|4
+
|72
+
|864
+
|???
+
|c360
+
|1-0
+
|GEOS-FP
+
|2x2.5
+
|5
+
|20
+
|6:57
+
 
+
|}
+
 
+
==== Notes ====
+
* Running on > approx. 1000 cores at c360 appears to cause a seg fault in call to SIN function around CubeToLaLon.F90:432
+
 
+
=== Sebastian Eastham, MIT (LAE) ===
+
 
+
{| border=1 cellspacing=0 cellpadding=5
+
|-valign="top" bgcolor="#cccccc"
+
!width="60px"|Cluster name
+
!width="60px"|Compilers
+
!width="60px"|MPI
+
!width="60px"|NetCDF library
+
!width="60px"|# of Nodes
+
!width="60px"|# or CPUs
+
!width="60px"|GCHP version
+
!width="60px"|Grid resolution
+
!width="60px"|Duration [days-hrs]
+
!width="60px"|Met source
+
!width="60px"|Met resolution
+
!width="60px"|Dynamic timestep [min]
+
!width="60px"|Chemistry timestep [min]
+
!width="60px"|Total run time [hrs]
+
 
+
|-valign="top"
+
|Nehalem
+
|ifort 2015
+
|MPICH2 v3.3
+
|NetCDF C 4.4.1, NetCDF Fortran 4.4.4
+
|2
+
|36
+
|11-02c
+
|C90
+
|31-0
+
|GEOS-FP
+
|0.25x0.3125
+
|5
+
|10
+
|68
+
 
+
|}
+
 
+
Notes: using 36 cores out of a total of 48 available from 2 nodes with a 10 GB direct ethernet connection.
+
 
+
'''''[[GEOS-Chem_HP|GCHP Home]]'''''
+

Latest revision as of 19:05, 24 March 2022

GCHP Main Page

In March 2022, Sebastian Eastham (GitHub: @sdeastham) was named GCHP Model Scientist and the GEOS-Chem High Performance Working Group was disbanded.