DesignSafe Annual Evaluation Report 2020-2021

This report summarizes the 2020-21 evaluation of the DesignSafe cyberinfrastructure, which was conducted by TACC’s Expanding Pathways in Computing (EPIC) STEM Evaluation Services. EPIC used a mixed methods approach to assess the implementation, outcomes, and impacts of DesignSafe on the natural hazards community. The evaluation aims to inform project improvements and report on outcomes over the project’s duration. Multiple data sources were used, including platform analytics, user profiles, annual and microsurvey responses, trainee surveys, and user and stakeholder interviews.

Key findings reveal high user satisfaction overall, significant impact on professional activities, and recommendations for system improvements. Users appreciated DesignSafe for facilitating collaboration, data sharing, and advanced research capabilities, despite some users experiencing technical challenges. Training survey respondents shared positive feedback and eagerness for further learning. User interviews highlighted DesignSafe’s role in improving research quality and fostering a collaborative culture. Stakeholders shared project accomplishments, such as improved resources, increases in Data Depot activity and HPC use, greater user diversity, the development of case studies, upcoming versioning capabilities, and the data awards; and they provided additional insights and recommendations. Based on the findings, the evaluators recommend building communities through multiple methods, enhancing user guides and documentation, streamlining user experience, improving trainings, and prioritizing sustainable development.