Literature on Cloud Capacity Planning

This release captures the state-of-the-art (as of 2020) in cloud capacity planning literature and provides a set of complementary scripts to analyze this literature. The dataset which is central to this release (<code>publications.yaml</code>) maps 57 cloud capacity planning approaches as published in literature to the taxonomy on cloud capacity planning which the authors of this release have proposed. The approaches were gathered with a systematic literature survey process, aggregating multiple common sources and executing a set of automated and manual filtering steps. <strong>Taxonomy</strong> The taxonomy and the process used to derive it is described in detail in the MSc Thesis of Georgios Andreadis at Delft University of Technology (to be published end of August 2020), on cloud capacity planning. We describe the taxonomy here to provide context to the raw data. The taxonomy divides the process underlying capacity planning systems into the following categories: System Model Workloads Resources Model Inputs Forecast Model Modeling Strategy Model Structure Decision Support Role Type of Advice Advice Method For each of these categories, the taxonomy prescribes a set of possible <em>classes</em> (possible instantiations of the category). We list these for each category, below, preceded by its abbrevation as appearing in the dataset: System Model Workloads <code>VM</code>: Virtual Machines <code>DB</code>: Databases <code>S</code>: Streaming Workloads <code>BD</code>: Big Data Frameworks <code>WS</code>: Web Service <code>B</code>: Batch Jobs Resources <code>C</code>: Compute Hardware <code>S</code>: Storage Hardware <code>N</code>: Network Hardware <code>E</code>: Energy Hardware (Storage and Supply) <code>H</code>: Heat Control Hardware <code>V</code>: Virtualized Resources (VM, containers, etc.) Model Inputs <code>H</code>: Historical Data <code>RS</code>: Resource Specifications <code>B</code>: (Micro)Benchmarks or Systematic Performance Tests <code>S</code>: SLAs <code>P</code>: Pricing Data <code>LC</code>: Lease Contracts <code>HP</code>: Human Personnel-related Factors Forecast Model Modeling Strategy <code>A</code>: Analytical <code>S</code>: Simulation <code>E</code>: Real-world Experimentation Model Structure <code>U</code>: Unconditional Extrapolation <code>W</code>: What-if Scenarios Decision Support Role <code>F</code>: Forecast <code>A</code>: Adaptation Advice Type of Advice <code>N</code>: Number of Resources <code>T</code>: Type of Resources <code>L</code>: Locality of Resources Advice Method <code>H</code>: Heuristic <code>R</code>: Regression <code>L</code>: Local Search <code>SS</code>: Stochastic Search <code>SP</code>: Stochastic Programming <code>NN</code>: Neural Network <code>GT</code>: Game Theory <code>GA</code>: Genetic Algorithm <code>NLP</code>: (Non)Linear Programming <strong>File Structure</strong> This release is structured as follows: <code>publications.yaml</code>: This is the dataset of mappings of publications to the taxonomy. Each item in the array represents a publication, with a set of true-false classifications per category for each class. The <code>id</code> field of each publication identifies the publication (first-author and publication year). The <code>summary</code> field of each publication summarizes the publication in a short sentence. The <code>classification</code> field contains a set of true-false classifications per category for each class. The <code>notes</code> field is an optional field containing any additional notes kept by the author of this dataset on their classification, in the case where doubts arose during the classification process. <code>taxonomy.py</code>: Script which parses the YAML dataset into different CSV views per category, to facilitate meta-analysis. Also prints out a full (long-table) representation of the mappings. <code>taxonomy_analysis.py</code>: Jupyter notebook which contains several meta-analysis processing steps, including trend, cluster, and correlation analysis. <code>README.md</code>: A file containing this description.