Literature on Cloud Capacity Planning

This release captures the state-of-the-art (as of 2020) in cloud capacity planning literature and provides a set of complementary scripts to analyze this literature. The dataset which is central to this release (publications.yaml) maps 57 cloud capacity planning approaches as published in literature to the taxonomy on cloud capacity planning which the authors of this release have proposed. The approaches were gathered with a systematic literature survey process, aggregating multiple common sources and executing a set of automated and manual filtering steps. Taxonomy The taxonomy and the process used to derive it is described in detail in the MSc Thesis of Georgios Andreadis at Delft University of Technology (to be published end of August 2020), on cloud capacity planning. We describe the taxonomy here to provide context to the raw data. The taxonomy divides the process underlying capacity planning systems into the following categories: System Model Workloads Resources Model Inputs Forecast Model Modeling Strategy Model Structure Decision Support Role Type of Advice Advice Method For each of these categories, the taxonomy prescribes a set of possible classes (possible instantiations of the category). We list these for each category, below, preceded by its abbrevation as appearing in the dataset: System Model Workloads VM: Virtual Machines DB: Databases S: Streaming Workloads BD: Big Data Frameworks WS: Web Service B: Batch Jobs Resources C: Compute Hardware S: Storage Hardware N: Network Hardware E: Energy Hardware (Storage and Supply) H: Heat Control Hardware V: Virtualized Resources (VM, containers, etc.) Model Inputs H: Historical Data RS: Resource Specifications B: (Micro)Benchmarks or Systematic Performance Tests S: SLAs P: Pricing Data LC: Lease Contracts HP: Human Personnel-related Factors Forecast Model Modeling Strategy A: Analytical S: Simulation E: Real-world Experimentation Model Structure U: Unconditional Extrapolation W: What-if Scenarios Decision Support Role F: Forecast A: Adaptation Advice Type of Advice N: Number of Resources T: Type of Resources L: Locality of Resources Advice Method H: Heuristic R: Regression L: Local Search SS: Stochastic Search SP: Stochastic Programming NN: Neural Network GT: Game Theory GA: Genetic Algorithm NLP: (Non)Linear Programming File Structure This release is structured as follows: publications.yaml: This is the dataset of mappings of publications to the taxonomy. Each item in the array represents a publication, with a set of true-false classifications per category for each class. The id field of each publication identifies the publication (first-author and publication year). The summary field of each publication summarizes the publication in a short sentence. The classification field contains a set of true-false classifications per category for each class. The notes field is an optional field containing any additional notes kept by the author of this dataset on their classification, in the case where doubts arose during the classification process. taxonomy.py: Script which parses the YAML dataset into different CSV views per category, to facilitate meta-analysis. Also prints out a full (long-table) representation of the mappings. taxonomy_analysis.py: Jupyter notebook which contains several meta-analysis processing steps, including trend, cluster, and correlation analysis. README.md: A file containing this description.