zeitgeist-ai/financial-qa
收藏资源简介：
Financial-QA数据集是一个包含50个金融问题的集合，这些问题由Llama 3生成，并附有详细的真实答案。数据集还包括两个额外的提示，为问题提供了不同的上下文。每个数据条目包含一个问题、一个真实答案和一个预期回答。数据集在Hugging Face上公开可用。数据集结构分为默认配置和少样本示例配置，每个配置包含不同的特征和示例。
The Financial-QA dataset consists of 50 financial questions generated by Llama 3, each accompanied by a detailed ground truth answer. The dataset has two configurations: default and few-shot-examples. The default configuration includes features such as question, ground_truth, and answer. The few-shot-examples configuration adds an eval feature, which contains a JSON with a LLM as Judge response. The dataset is designed for question-answering tasks in the finance domain.
Financial-QA Dataset Card
数据集概述
Financial-QA数据集是由Llama 3生成的50个金融问题集合，每个问题都附有详细的正确答案。数据集还包括两个额外的提示，提供不同的问题背景。每个数据条目包含一个问题、一个正确答案和一个预期回答。该数据集在Hugging Face上公开可用。
数据集结构
数据实例（默认）
每个数据实例包含：
- Question: 由Llama 3生成的金融问题。
- Answer: 简单回答。
- Ground Truth: 详细的标准和问题的预期答案。
示例实例
json { "question": "What is the best way to save for retirement?", "ground_truth": "The best way to save for retirement is to start early, be consistent, and take advantage of tax-advantaged accounts. Steps include maximizing employer-matched accounts, utilizing tax-advantaged accounts like IRAs, automating savings, investing wisely, monitoring progress, and considering catch-up contributions for those 50 or older.", "answer": "Saving for retirement is crucial. Start early, take advantage of employer matching, diversify accounts (401(k), IRAs, annuities), automate savings, invest in a mix of stocks, bonds, real estate, make catch-up contributions if over 50, review progress regularly, and seek professional guidance if needed." }
数据实例（few-shot-example）
每个数据实例包含：
- Question: 由Llama 3生成的金融问题。
- Answer: 简单回答。
- Ground Truth: 详细的标准和问题的预期答案。
- eval: 包含LLM作为评判者的响应的JSON。
示例实例
json { "question": "What is the best way to save for retirement?", "ground_truth": "The best way to save for retirement is to start early, be consistent, and take advantage of tax-advantaged accounts. Steps include maximizing employer-matched accounts, utilizing tax-advantaged accounts like IRAs, automating savings, investing wisely, monitoring progress, and considering catch-up contributions for those 50 or older.", "answer": "Saving for retirement is crucial. Start early, take advantage of employer matching, diversify accounts (401(k), IRAs, annuities), automate savings, invest in a mix of stocks, bonds, real estate, make catch-up contributions if over 50, review progress regularly, and seek professional guidance if needed." "eval": {"reasoning": "1. Correctness: The answer accurately aligns with the ground truth, thereby earning the final point.", "total_score": 5} }
