[hpc-announce] Call for Papers for Metrics 2023 - Conference on Metrics for Measuring Success of CyberInfrastructure Projects

[Calyam, Prasad P.]

***Apologies if you got multiple copies of this CFP

Call for Papers - Metrics2023
(November 11 - November 12, 2023; Denver, Colorado)

Website: https://sites.google.com/view/metrics2023

Topics: Metrics for objectively assessing the progress and impact of CyberInfrastructure (CI) projects are important for not only obtaining the required resources for the long-term sustainability of the projects and community engagement but also for identifying issues and prioritizing the areas of improvement. As projects evolve over time, the metrics for measuring their progress and impact should also evolve. Even though each CI project is unique, there are certain elements (such as the community engagement and training) that cross-cut across a vast majority of the projects. Hence, there is a possibility of defining a set of metrics that can be relevant to a broad range of the CI projects for measuring their progress and impact.

The main goal of the Metrics 2023 conference is to bring together colleagues from a diverse range of disciplines and organizations to network, collaborate, and work towards defining a taxonomy of CI projects and the appropriate metrics for their short-term and long-term evaluation. Towards this end, abstracts for presentations, and papers for publication in the special issue of Springer Nature Computer Science journal are invited.

Metrics for evaluating the projects related to the following areas are in the scope of this conference:

  *   Software and data infrastructure (including infrastructure for AI, Quantum Computing, and CyberSecurity)
  *   Hardware infrastructure design, development and deployment (for High Performance Computing, Data-Intensive Computing, Cloud Computing, Quantum Computing, Data Storage and Archival, and IoT)
  *   Operations, and maintenance (including, processes and practices such as DevSecOps and ITIL)
  *   Community building and customer service
  *   Training, education, and outreach
  *   Diversity, Equity, Inclusion, and Accessibility (DEIA)
  *   Building virtual organizations

Topics of interest for papers and abstracts include, but are not limited to:

  1.  Case-studies on measuring success of projects including lessons learnt, design of the evaluation method, data analysis
  2.  Evolution of the metrics as the project progresses through different project years and release cycles
  3.  Currently known best practices for tracking metrics
  4.  Tools for tracking the product use metrics and experiences related to their adoption
  5.  Challenges and opportunities in developing self-reporting software or data product/infrastructure
  6.  Problems and solutions related to gathering certain types of metrics
  7.  Benchmarking and performance evaluation techniques for hardware and software products
  8.  Methods and experiences related to measuring accuracy, precision, explainability, and fairness of results
  9.  Manual and automated methods for gathering quantitative and qualitative metrics
  10. Methods and experiences related to measuring productivity of people
  11. Methods for measuring the societal impact of projects
  12. Literature review and survey of the methods for evaluating success of projects from the areas that are in the scope of the conference
  13. New methods for analyzing success including the role and use of social-media
  14. Taxonomy of CyberInfrastructure (CI) projects and associated metrics
Submission Guidelines for Papers:
The Metrics2023 proceedings will be published by Springer Nature Computer Science in a special journal issue named as "Metrics for Measuring Success of CyberInfrastructure Projects".

We invite authors to submit their original and unpublished work, that is not under review for another publication. Full papers (10 -25 pages in length including references) should be formatted as per the Springer-specified guidelines (details below) for review. Authors of selected papers will be provided 20 minutes time-slots for their presentations at the conference.

Deadline for paper submission: October 1, 2023
Deadline for notification: November 1, 2023
Presentations of selected papers: November 11 - November 12, 2023
Deadline for submission of the final version of the paper: November 30, 2023
Timeline for publication: December 1, 2023

Templates and instructions for authors for preparing the papers are available at the following link:
https://www.springer.com/journal/42979/submission-guidelines

Following is the link to the submission system:
https://www.editorialmanager.com/sncs/default2.aspx

Please select the following title of the journal special issue in the Springer submission system at the time of submitting the paper: "Metrics for Measuring Success of CyberInfrastructure Projects."

Submission Guidelines for Short-Talk:
We invite abstracts for short talks (maximum 7 minutes each). The abstracts should be prepared following the Springer guidelines, and could be 3-5 pages in length including references. While the abstracts will NOT be published in the proceedings (special issue of the journal), they will be made publicly accessible through a GitHub repository set up for the conference and linked to this website. The PDF copies of the rough draft of the slides (up to 16 slides maximum) are also required as a part of the submission. The PDFs of the abstract and the slides can be merged into a single PDF file, and can be submitted through EasyChair for peer-review by going to the following link:
https://easychair.org/my/conference?conf=metrics2023

  *   Deadline for abstract submission for short-talks: September 15, 2023
  *   Deadline for notification: October 1, 2023
  *   Submission of the final slides and abstract: November 8, 2023
  *   Presentations: November 11 - November 12, 2023
PLEASE NOTE: The submission system for the journal paper review is different from the submission system for the abstracts for short-talks. Please follow the links above for the different types of submissions. Additionally, the registration of abstracts for full-papers is not required. The deadline for abstracts mentioned on this CFP is related to the call for short-talks.
Organizing committee:
Ritu Arora, Wayne State University
Izzat Alsmadi, Texas A & M University
Prasad Calyam, University of Missouri
Matthew Curry, Sandia National Laboratory
George K. Thiruvathukal, Loyala University

Contact:
All questions about submissions should be emailed to ritu at wayne.edu<mailto:ritu at wayne.edu>