SoftwareDev dataset

[yuanhao2023]

Hello Developer,
May I ask where I can obtain the contents of the SoftwareDev dataset? Or is this dataset a closed-source dataset?

[iorisa]

Sorry, I don't quite understand what the SoftwareDev dataset is used for. To avoid any misunderstanding, could you please describe it in detail?

[yuanhao2023]

抱歉，我不太明白 this 是做什么用的。为避免任何误解，您能详细描述一下吗？SoftwareDev dataset

Thanks for your reply. According to the MetaGPT paper, the performance comparison between MetaGPT and ChatDev is based on the SoftwareDev dataset. I am currently working on a research project based on MetaGPT and would like to evaluate its performance using the official dataset provided by the MetaGPT team. Table 8 in the paper presents some examples from this dataset.

Could you please clarify if this dataset is publicly available or if there is a way to request access to it?

Thank you for your assistance.

[iorisa]

The SoftwareDev related to the MetaGPT paper is not open to the public. After the release of MetaGPT 1.0 and MGX, we will open an open-source version similar to SoftwareDev.