Summarising Daily AI Papers with GitHub and Gemini

llm
talk
code
Author

Gabriel Chua

Published

September 28, 2024

This blog post summarizes a talk I gave at Machine Learning Singapore. Thank you Martin and Sam for having me!

Thumbnail

Key Points

The summaries are automatically generated from HuggingFace’s Daily Papers, using Gemini and GitHub actions. All credits go to the research community for sharing and the HuggingFace community for curating these papers.

The GitHub Actions workflow runs two Python scripts, pull_hf_daily.py and summarize_papers.py - both of which were written using Cursor/Sonnet 3.5.

This entire project runs for free - from the GitHub Actions runners to the LLM calls for Gemini. I initially started with Flash, but realised the generous rate limits would support Pro, and decided to upgrade. Now, each day around noon UTC, the scripts automatically retrieve the latest research papers, generate summaries using a large language model, and push the updates directly to GitHub Pages.

Here is the GitHub Repo: daily-ai-papers.

Slides