SimpleQA Evals and Deep Research 2.0

[assafelovic]

Another exciting week with so much improvements by our amazing community. We're thrilled to announce the latest release of GPT Researcher, now featuring evaluations using the SimpleQA dataset by OpenAI. Our rigorous testing has demonstrated an impressive 93% accuracy rate, surpassing all current leading projects in the market.

This achievement underscores the remarkable capabilities of the open-source community, and we're just getting started! In response to extensive feedback, we've refined our deep research functionalities to be faster, smarter, and more cost-effective, while also addressing previous bugs. Update to the latest version and experience the enhancements firsthand!

What's Changed

• Fix Key Error while using Deep Research by @kongacute in Fix Key Error while using Deep Research #1188
• Update requirements.txt with missing langgraph dep by @namin in Update requirements.txt with missing langgraph dep #1189
• Fix Docker Build Failure: Updated combined_query in DeepRsearchSkill.run() to Handle Backslashes in F-Strings by @monolok in Fix Docker Build Failure: Updated combined_query in DeepRsearchSkill.run() to Handle Backslashes in F-Strings #1192
• stabilize docker & frontend upgrades by @ElishaKay in stabilize docker & frontend upgrades #1191
• Improved overall planning and research performance by @assafelovic in Improved overall planning and research performance #1195
• Added support for base_url param in create_chat_completions for OpenAI Provider by @gaurav3247 in Added support for base_url param in create_chat_completions for OpenAI Provider #1198
• Update llm.py by @olipayne in Update llm.py #1200
• Fix WebSocket timeout issues by @luislofer89 in Fix WebSocket timeout issues #1203
• fix: Add missing langgraph module to requirements.txt by @hurxxxx in fix: Add missing langgraph module to requirements.txt #1207
• Refactor: typing cleanup by @czakop in Refactor: typing cleanup #1187
• add async nodriver scrapper by @ewgdg in add async nodriver scrapper #1170
• Add language requirement to resource report prompt by @hurxxxx in Add language requirement to resource report prompt #1208
• Feature:eval metrics by @kga245 in Feature:eval metrics #1183
• README for feat(evals): Add SimpleQA evaluation framework and initial results by @kga245 in README for feat(evals): Add SimpleQA evaluation framework and initial results #1212
• Polish up loose ends based on feedback by @ElishaKay in Polish up loose ends based on feedback #1211

New Contributors

• @namin made their first contribution in Update requirements.txt with missing langgraph dep #1189
• @olipayne made their first contribution in Update llm.py #1200
• @luislofer89 made their first contribution in Fix WebSocket timeout issues #1203
• @hurxxxx made their first contribution in fix: Add missing langgraph module to requirements.txt #1207
• @czakop made their first contribution in Refactor: typing cleanup #1187

Full Changelog: v3.2.2...v3.2.3

---

This discussion was created from the release SimpleQA Evals and Deep Research 2.0.