Mechanistic analysis of a GPT-2–like model exploring the compositionality gap in transformers. Using Logit Lens and Causal Tracing, the study identifies and mitigates a deep-layer bottleneck via dataset enhancement to improve logical reasoning.

A simple CLI chat mode framework for local GPT-2 Tensorflow models

A basic Learning Management System (LMS) built using Python, gRPC, and SQLite. The project implements Raft for consensus and fault tolerance, consistency. And a small sized LLM for tutoring support.

The Memory Support Chatbox for Pregnant Women is a project aimed at providing support and information to pregnant women experiencing cognitive memory issues. Using the GPT-2 language model, the chatbox generates responses based on text data related to pregnancy and memory issues.