llm-usage-astronomy

This repository contains the code used for the paper “Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomy” as presented at the SPAICE 2024 Conference, at ECSAT, Harwell, Oxfordshire, UK.

Repository Structure

data

• count papers ai favs.json: the absolute occurence and its frequency per year for the top 100 AI-favoured words
• count papers control.json: the absolute occurence and its frequency per year for 100 control words

notebooks

• human_vs_llm.ipynb: implementation of how to determine top AI words by token frequency from a dataset
• llm_in_astronomy.ipynb: implementation of ADS NASA search for top 100 AI words vs 100 control words

• LICENSE: the license under which you can reuse this code
• README.md: you are reading it now :)

Paper

Conference proceedings link: https://zenodo.org/records/13885577

@inproceedings{astarita_2024_13885577,
	title = {Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomy},
        author={Simone Astarita and Sandor Kruk and Jan Reerink and Pablo Gómez},
        booktitle={Proceedings of SPAICE2024: The First Joint European Space Agency / IAA Conference on AI in and for Space},
        pages = {241–246},
        editor = {Dominik Dold and Alexander Hadjiivanov and Dario Izzo},
	year = 2024,
        month = oct,
	doi = {10.5281/zenodo.13885577},
	url = {https://doi.org/10.5281/zenodo.13885577},
        publisher = {Zenodo}
}

If you wish to cite the non-reviewed version (v1), you can get the one from arXiv: https://arxiv.org/abs/2406.17324

@misc{astarita2024delvingutilisationchatgptscientific,
      title={Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomy}, 
      author={Simone Astarita and Sandor Kruk and Jan Reerink and Pablo Gómez},
      year={2024},
      eprint={2406.17324},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2406.17324v1}
}