Exploring Clouds for Acceleration of Science
This material is available primarily for archival purposes. The E-CAS project is currently in the second year of funding and no submissions are being accepted for consideration.
Exploring Clouds for Acceleration of Science, or E-CAS, is a new project funded by the National Science Foundation (NSF), being administered and coordinated by Internet2 in collaboration with commercial cloud service providers. The project will invite proposals from researchers from multiple disciplines interested in performing cutting-edge scientific and computing studies by leveraging capabilities in cloud computing platforms.
The project is a cooperative agreement between NSF and Internet2 as well as commercial cloud providers Google and Amazon Web Services (AWS) who have agreed to commit significant resources to support the project. Additional cloud provider collaborators who are able to accommodate agreed-upon criteria for project support within 30 days following the project’s public announcement may also be able to participate.
E-CAS is intended to accelerate scientific discoveries by leveraging advancements and novel technologies in commercial cloud platforms to demonstrate their effectiveness in supporting a range of applications critical to growing academic and research computing and computational science communities, and to illustrate the viability of commercial cloud services as an option for leading-edge research across a broad spectrum of scientific disciplines.
The project’s broader impact will allow it to serve as a model for other large-scale research initiatives and in the likelihood of it enhancing curriculum and training advancements in the use of cloud services with academic research environments. More specifically, the broader research community can benefit from this project by understanding whether there are simulation and application workflows that currently use High-Performance Computing (HPC) resources that can benefit from commercial cloud platforms.
For more than 20 years, Internet2 has existed to facilitate collaborative efforts of U.S. higher education institutions to advance aspects of their academic, service, and research missions. Internet2 brings many years of experience working with cloud platforms, technologies and the service provider community. Therefore, Internet2 will serve as a natural coordinator, facilitator, and administrator of this project for the further benefit of its members and the broader research and education community. For more information about Internet2, visit www.internet2.edu.
Working with NSF, Internet2 has established a team to implement and manage the project. Specific responsibilities will include:
-Establishing, convening and managing an external Advisory Board
-Working with cloud providers to provide access, documentation, and support for cloud resources
-Working with regional network providers, and cloud service providers to establish appropriate connectivity to enable data pipelining between data sources and compute facilities
-Managing the Phase I and II proposal submission, review, and selection processes; and
-Managing and implementing the Phase I and II awards.
The Advisory Board will provide support to Internet2 for the execution of the project, manage logistics including resource selection, account setup, interactions with cloud providers, and provide support to the selected Phase I and II proposals. They will provide input to the external reviewers for proposal reviews.
The Advisory Board consists of expert academic researchers, representatives from the high-performance computing community and commercial cloud providers. The Advisory board uses external reviewers in the selection of Phase I and Phase II awards.
-Dr. Amy Apon, Ph.D. (Chair)
Co-Director, Complex Systems, Analytics, and Visualization Institute
Professor and Chair, Division of Computer Science, School of Computing
-Professor Thomas E. Cheatham, III
Department of Medicinal Chemistry, College of Pharmacy
Director, Research Computing and CHPC, UIT
University of Utah
-Dr. Valerie Taylor, Ph.D.
Director, Mathematics and Computer Science Division
Argonne National Laboratory
-Dan Stanzione, Ph.D.
Executive Director, Texas Advanced Computing Center
Associate Vice President for Research
The University of Texas at Austin
Section Head: Network Engineering and Telecommunications Section (NETS)
Manager: Front Range GigaPoP (FRGP)
President: Westnet Education and Research Consortium (WERC)
-Sanjay Padhi, Ph.D
AWS Research Initiatives
Worldwide Public Sector, Amazon Web Services
-Karan Bhatia, PhD
Google Cloud, High Performance Computing
Vice President, Oracle Cloud Innovation Accelerator – Higher Education & Research
Principal Investigator (PI)
President and CEO, Internet2
Jim Bottum, Ana Hunsinger
Both Google and Amazon Web Services (AWS) were responsive to initial discussions and agreed to commit significant resources to support the project. These initial discussions framed the format of the project and without their commitment the project would not be possible. Other cloud providers may be welcome to join the project if they can match the commitments of Google and AWS within the first 30 days of the project.
The project may welcome up to two additional cloud service providers who can agree to meet some minimum project coordination, project support and cloud credit requirements. Any additional providers will be determined within 30 days of the project’s formal public announcement.
The project will include two areas of focus throughout its two phases of execution. The first is Acceleration of Science: The goal of the Acceleration of Science studies is to achieve the best time-to-solution for scientific application/workflows using cloud. The measures of acceleration may include end-to-end performance (e.g., wall clock and data-movement), or other relevant measures such as number of concurrent simulations or workflows, or the ability to process near real-time streaming data. The second focus area is Innovation: The goal of the Innovation studies is to explore the innovative use of heterogeneous hardware resources such as CPUs, GPUs, and FPGAs to support and extend application workflows.
The project will consist of two phases.
Phase I: The project’s first phase will include the submission, review, selection, and funding of an estimated six Phase I projects. Each recipient will have one year to perform a six-month operations study and corresponding development work. At the end of Phase I, Internet 2 will host a project workshop to assess lessons learned.
Phase II: The project’s second phase will include submission, review, and selection of two-Phase II awards. The Phase II awards will be selected from the six Phase I projects and will ideally include one from each area of focus – one from Acceleration of Science and the other from Innovation. The Phase II awardees will have one year to complete their project. At the end of Phase II, Internet2 will host a final workshop to help define and document best practices, lessons learned, and recommendations for sustained, scalable commercial cloud service adoption research environments.
A Program Team and Advisory Board will define evaluation criteria for both phases of the project. The intent is to span a range of different classes of workflows, and the Program Team and Advisory Board will reach out to exemplar workflows running on NSF’s current HPC resources. Proposals will be considered for both operations projects (to support efforts with a track record of prior research involving cloud resources) and development projects (to support efforts from applicants with less experience with research involving cloud support). Applicants will be encouraged to explore hybrid co-compute tools for analytical and scientific workflows. For studies associated with modern hardware accelerators, proposals may use application programming interfaces (APIs) from the selected cloud provider(s).
For Phase I Proposals, potential applicants will be able to submit proposals of up to 10 pages addressing general project goals, previous work, methodology and justification of requested resources. Project proposals will also require a 2-page, NSF-format bio sketch for the Project PI as well as NSF-format current and pending funding lists for the Project PI. Full requirements can be found at www.internet2.edu/ecas.
Phase II Proposals will be selected from the 6 awarded Phase I proposals. Phase II proposal submissions will include a narrative of up to 15 pages addressing general project goals, previous work within the applicant’s Phase I project demonstrating value, necessity, and potential impact, methodology, and justification of requested resources. Project proposals will also require a 2-page, NSF-format bio sketch for the Project PI. Full requirements can be found at www.internet2.edu/ecas.
At the end of the submission period for each phase, proposals will be sent to external reviewers for evaluation. Once complete, the individual reviews will be evaluated by the academic members of the Advisory Board where final decisions will be made.
The Advisory Board is seeking computer and computational scientists from a wide range of fields and deep levels of experience to perform as reviewers, including members of the HPC provisioning community rooted in national centers and campuses with a wide range of expertise and scale including cloud provisioning and performance measurement and efficiency. We welcome recommendations for reviewers and encourage nominations to be sent to firstname.lastname@example.org.
Phase I accepted proposals will be granted cloud credits up to a maximum value of $100,000 per award based on justification provided by scientific workload needs. Cloud provider preferences and stated cloud resource needs will be considered in the selection of the Phase I awardees. The Phase I project awards also will include funding for up to one year of partial salary support and fringe benefits for a staff member, postdoctoral fellow, or graduate student to help with development and initial cloud deployment. Funding for this purpose will be allocated for one year for partial salary and fringe benefits, plus indirect costs on these direct costs for a total of up to $81,000.
Each of the Phase II accepted proposals will be allocated as a one-year sub-award from Internet2 to the awardee including direct costs for partial salary support for a staff member, postdoctoral fellow, or graduate student (including fringe benefits). The sub-award will also include up to $500,000 in cloud services from an assigned cloud provider (to be transmitted by the awardee directly to the provider from funds received under their Internet2 sub-award under a separate agreement including appropriate award, agency, and OMB compliance requirements). Phase II sub-awards will include indirect cost recovery on salary, fringe benefits, and cloud services.
Each project will receive an allocation of credits directly from an assigned commercial cloud provider to develop appropriate cloud architectures, test software, fine-tune performance, and then run the proposed workloads at scale within the execution period. These agreements will be arranged directly between the Phase I award campuses and cloud providers.
The anticipated submission deadline for Phase I proposals is 01 February 2019. Those projects selected for Phase I will be invited to submit Phase II proposals in April/May 2020. Proposal submission will be electronic with brief applications submitted via Internet2 as a portal for E-CAS panel review. The submission window is now closed.
Proposals may be submitted by academic institutions, including universities and two-and four-year colleges (including community colleges) accredited in and having a campus located in the United States. Proposals will also be accepted from non-profit, non-academic organizations, including national research laboratories, regional networks, and similar organizations within the United States associated with educational or research activities.
Phase I awards were announced in March 2019 and Phase II awards were announced in September 2020.
No, there is no requirement for your home institution to be an Internet2 member or to be connected to the Internet2 network. There is however significant benefit in being connected to the Internet2 network which enables high performance connectivity to cloud providers through its Cloud Exchange and Cloud Connect services.
NSF 19-510 is a separate program from this project. Interested parties in that solicitation should contact the NSF directly.
There is no direct connection between the two. This project is a fixed-term project in partnership with the NSF to support research innovation and acceleration of science for a small number of selected projects. The NET+ program is an ongoing engagement between Internet2 and cloud providers to make cloud services available through an agreed set of commercial terms and conditions.
To determine this information, please send an email to email@example.com.
No, the Phase II projects will be selected from the projects in Phase I. Think of it as a funded “proof of concept” for six projects in Phase 1, followed by an award for two of those projects to further develop and repeatedly run the science workloads at scale for an additional year.
For further information, please send all questions to firstname.lastname@example.org. To find out more information, please visit www.internet2.edu/ecas.