[hpc-announce] Metrics2024: Measuring Success of Research, Education, and CyberInfrastructure Programs and Projects Date: December 16-17, 2024 Mode: In-Person and Online; India International Centre, Delhi, India
Majumdar, Amitava
majumdar at sdsc.edu
Mon Oct 7 16:39:58 CDT 2024
Call for Abstracts for Presentations, Papers, Panels, BoFs, and Exhibits
Metrics2024: Measuring Success of Research, Education, and CyberInfrastructure Programs and Projects
Date: December 16-17, 2024
Mode: In-Person and Online
Venue: India International Centre, Delhi, India
Conference website: https://urldefense.us/v3/__https://sites.google.com/view/metrics2024__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8OTb1Aebg$
Link for submitting full-papers for journal publication – Springer Nature Computer Science – Special Issue: https://urldefense.us/v3/__https://www.editorialmanager.com/sncs/default2.aspx__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8MA6eNkkw$
Easychair Link for submitting presentation abstracts, and proposals for BoFs and panels: https://urldefense.us/v3/__https://easychair.org/conferences/?conf=metrics2024__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8OxDGkXrg$
Abstract registration deadline: October 15, 2024
Submission deadline: October 15, 2024
Metrics for objectively assessing the progress, success, and impact of research, education, and CyberInfrastructure (CI) programs and projects are important for not only obtaining the required resources for their management, long-term sustainability, and community engagement but also for identifying issues and prioritizing the areas of improvement.
The main goal of the Metrics2024 conference is to bring together colleagues from a diverse range of disciplines and organizations to network, collaborate, and work towards developing and sharing "responsible metrics" for short-term and long-term evaluation of programs and projects in the scope of the conference. Towards this end, extended abstracts for presentations, proposals for panels/BoFs/exhibits, and full-papers for publication in a special issue of Springer Nature Computer Science journal are invited.
Metrics for evaluating the programs and projects related to the following areas are in the scope of this conference:
1. CyberInfrastructure (CI)
* Hardware, Software, and Data infrastructure
* Design, development and deployment of infrastructure (for High Performance Computing, Data-Intensive Computing, Cloud Computing, Quantum Computing, Data Storage and Archival, IoT, edge computing, AI, and Cybersecurity)
* Network infrastructure
* AI for CI
* Data Centers
* Designing, building, operating, and managing data centers
* Infrastructure-as-a-service
* Sustainability (e.g., power efficiency, responsible decommissioning, reducing and tracking carbon emission, and green technologies)
* Processes and Governance Frameworks
* Data privacy, cybersecurity, and risk management
* Data governance
* Operations and maintenance (including, processes and practices such as, DevSecOps and ITIL)
* People
* Customer Service/Support
* Building virtual organizations and collaborations
2. Education, Training, and Outreach programs
* Curriculum development and instructional design
* Teaching and learning tools, technologies, techniques, and platforms
* Instructor and student training
* Mentoring, practical training, and research experience programs for student engagement
* Public engagement
* Professional development programs
* AI initiatives in higher education
* Broadening participation
* Career growth/progress
* Leadership development
* Organizational behavior
* Team Science and Science of Team Science
3. Research and Research Administration programs
* Benchmarking research competitiveness
* Research enterprise tools, activities, inputs, outputs, and processes
* Economic development - Innovation and technology commercialization
* Responsible use of AI in research
* Customer service
Topics of interest for papers and abstracts include, but are not limited to:
1. Case-studies on measuring success of projects/programs including lessons learnt, design of the evaluation method, and data analysis
2. Evolution of the metrics as a project/program progresses through different project years and release cycles
3. Currently known best practices for tracking metrics
4. Tools for tracking the product use metrics and experiences related to their adoption
5. Challenges and opportunities in developing self-reporting software or data product/infrastructure
6. Problems and solutions related to gathering certain types of metrics
7. Benchmarking and performance evaluation techniques for products or programs
8. Methods and experiences related to measuring accuracy, precision, explainability, and fairness of results
9. Manual and automated methods for gathering quantitative and qualitative metrics
10. Methods and experiences related to measuring productivity of people
11. Methods for measuring the societal impact of projects and programs
12. Literature review and survey of the methods for evaluating success of projects and programs from the areas that are in the scope of the conference
13. New methods for analyzing success including the role and use of social-media and AI
14. Taxonomy of projects/programs and associated metrics
The conference agenda will include talks, panel/s, BoF sessions, and demonstrations/exhibits.
Call for Abstracts for Presentations – In-Person and Online Event:
We invite extended abstracts and slides for presentations on the topics related to the conference. The abstracts should be prepared following the Springer guidelines and could be 5-10 pages in length including references. The extended abstracts that qualify for short papers (6-10 pages in length) will be published in the proceedings (special issue of the journal). All other abstracts and slides will be made publicly accessible through a GitHub repository set up for the conference and linked to this website.
PDF copies of the rough draft of the slides (up to 25 slides maximum) are required as a part of the submissions. The PDFs of the abstract and the slides can be merged into a single PDF file, and can be submitted through EasyChair for peer-review by going to the following link: https://urldefense.us/v3/__https://easychair.org/conferences/?conf=metrics2024__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8OxDGkXrg$
Please include the key-word "Extended Abstract" before the actual title of the submission. For example: "Extended Abstract: A new approach for comparative analysis of research projects".
Deadline for extended abstracts and slides submission: October 15, 2024
Deadline for notification: November 7, 2024
Submission of the final slides and abstract: November 20, 2024
Presentations: December 16 - December 17, 2024
Call for Panels - In-Person Event:
We invite proposals for panels on the topics related to the conference. The panels will be one-hour long and will involve discussions and exchange of thoughts among peers on a specific topic related to the conference.
The panel proposals should include: a title, the names and contact information of the moderator and 3-4 panelists, a description of the structure of the panel and how it will be run, and short biographies of the moderator and the panelists.
There are no formatting guidelines for the proposals and the proposals will not be published in the proceedings. Panel proposals should be 2–4 pages in length.
The PDFs of the proposals for panels should be submitted through EasyChair for peer-review by going to the following link: https://urldefense.us/v3/__https://easychair.org/conferences/?conf=metrics2024__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8OxDGkXrg$
Please include the keyword "Panel" before the actual title of the submission. For example: "Panel: Approaches for comparative analysis of research projects".
Deadline for panel proposals: October 15, 2024
Deadline for notification: November 7, 2024
Submission of the final slides and abstract: November 20, 2024
Panel: December 16 or December 17, 2024
Call for BoFs - In-Person Event:
BoFs are informal and interactive sessions that bring together like-minded conference participants to discuss topics and ideas related to the conference. Each BoF session will be one hour long and will be led by one or more experts on the proposed topic. Proposals for BoF should include the title of the BoF, the name and contact information of the session organizer/s, short biography of the organizers, and a short description of how the session will be run. The proposals for BoFs would be 2-4 pages long.
The PDFs of the proposals for BoFs should be submitted through EasyChair for peer-review by going to the following link: https://urldefense.us/v3/__https://easychair.org/conferences/?conf=metrics2024__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8OxDGkXrg$
Please include the keyword "BoF" before the actual title of the submission. For example: "BoF: Future approaches for comparative analysis of research projects".
Deadline for BoF proposals: October 15, 2024
Deadline for notification: November 7, 2024
Submission of the final slides and abstract: November 20, 2024
BoF date: December 16 or December 17, 2024
Call for Papers - In-Person and Online Event:
The Metrics2024 proceedings will be published by Springer Nature Computer Science in a special journal issue named "Measuring Success of Research, Education, and CyberInfrastructure Projects".
We invite authors to submit their original and unpublished work that is in the scope of the conference, and not under review for another publication. Full papers (12 -25 pages in length including references) should be formatted as per the Springer-specified guidelines (details below) for review. Please note that the length of a page as per Springer format is different from the length of a page in a double-column IEEE/ACM format.
Deadline for submission: November 30, 2024
Deadline for first notification: January 31, 2025
Deadline for submission of the final version of the paper: March 15, 2025
Timeline for publication: April 15, 2025
Templates and instructions for authors for preparing the papers are available at the following link: https://urldefense.us/v3/__https://www.springer.com/journal/42979/submission-guidelines__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8M0dzPt8g$
Following is the link to the submission system: https://urldefense.us/v3/__https://www.editorialmanager.com/sncs/default2.aspx__;!!G_uCfscf7eWS!c23hbBtz4Nsn6yM8Uzb4Eo4GJCF3S81DxikIdqs60f_29WWwEZZVPbiBD2sqjti_lwBb8c1O3HCzMGz0m8MA6eNkkw$
When using the Springer Nature Computer Science submission system, there would be a point during the submission process when one is asked: “Does this manuscript belong to a special issue?” and at that point one needs to click "yes" and then scroll down to the near bottom of the list to select the special issue titled "Metrics for Measuring Success of Research, Education, and CyberInfrastructure Projects."
PLEASE NOTE: The submission system for the journal paper review is different from the submission system for the abstracts/proposals for presentations, panels, and BoFs. Please send an email to Ritu Arora (ritu at venratech.com) and Amit Majumdar (majumdar at sdsc.edu) that includes the paper number that you receive after submission to the SNCS system for follow-ups with the editorial team.
Contact
For any questions, please feel free to email Ritu Arora (ritu at venratech.com) and Amit Majumdar (majumdar at sdsc.edu).
More information about the hpc-announce
mailing list