Data and code on the Moral Machine experiment on large language models (LLMs)

As large language models (LLMs) have become more deeply integrated into various sectors, understanding how they make moral judgements has become crucial, particularly in the realm of autonomous driving. This study used the moral machine framework to investigate the ethical decision-making tendencies of prominent LLMs, including GPT-3.5, GPT-4, PaLM 2 and Llama 2, to compare their responses with human preferences. While LLMs' and humans' preferences such as prioritizing humans over pets and favouring saving more lives are broadly aligned, PaLM 2 and Llama 2, especially, evidence distinct deviations. Additionally, despite the qualitative similarities between the LLM and human preferences, there are significant quantitative disparities, suggesting that LLMs might lean toward more uncompromising decisions, compared with the milder inclinations of humans. These insights elucidate the ethical frameworks of LLMs and their potential implications for autonomous driving., Using the MM methodology detailed in the supplementary information of https://www.nature.com/articles/s41586-018-0637-6, we implemented code for generating Moral Machine scenarios. After generating the MM scenarios, responses from GPT-3.5, GPT-4, PaLM 2, and Llama 2 were collected using the application programming interface (API) and relevant code. We applied the conjoint analysis framework to evaluate the relative importance of the nine preferences., , # Data and Code on the Moral Machine Experiment on Large Language Models

[https://doi.org/10.5061/dryad.d7wm37q6v](https://doi.org/10.5061/dryad.d7wm37q6v)

## Requirements

* Python 3.9

```
pip install -r requirements.txt
```

**NOTE:** The script `run_chatgpt.py` requires an OpenAI API key. Please obtain your API key by following [OpenAI's instructions](https://help.openai.com/en/articles/4936850-where-do-i-find-my-secret-api-key). To run the script `run_palm2.py`, setup is required. Please refer to [the Google Cloud instructions](https://cloud.google.com/vertex-ai/docs/start/introduction-unified-platform). Specifically, follow these sections in the given order: 1) [Set up a project and a development environment](https://cloud.google.com/vertex-ai/docs/start/cloud-environment) and 2) [Install the Vertex AI SDK for Python](https://cloud.google.com/vertex-ai/docs/start/install-sdk). Before running `run_llama2.py`, the Llama2 model files must be downloaded. Please follow [the instructi...