Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
-
Updated
Nov 18, 2026 - Python
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
Distribution transparent Machine Learning experiments on Apache Spark
A minimal coding-agent harness built to measure what context management actually costs: constraint survival after compaction (8%→83%), default-FAIL verification against false completions, and KV-cache prefix design (21%→90%). Stdlib-only, real deepseek-chat runs
Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.
This project implements 30+ variants of ANN algorithms to find the K nearest neighbors in high-dimensional vector spaces. It is meant as a convenient sandbox: drop in your own ANN code, run a one-liner, and instantly compare build/search speed and recall against the bundled baselines.
Adversarial security benchmark for agent authorization: does a compromised agent's policy-violating proposal become an unauthorized external effect? 61 trials, nine families, an independent oracle, per-mechanism ablation, confidence intervals. 0 unauthorized effects in 61 attack trials (95% CI [0.0%, 5.9%]). Reproduction is partial.
Testing whether models distinguish declared-true from declared-false premises
面向中文古诗词吟诵的 CosyVoice 1/2/3 三代跨架构 LoRA 微调实验框架:系统对比 LLM/FSQ/Flow/DiT 声学骨干与 prompt 边界,提供吟诵专用客观评测公式与试听样例。Cross-generation CosyVoice 1/2/3 LoRA benchmark for Chinese poetry chanting.
HALO (Harness for Always-On Loop Oversight), from the survey Always-On Personal Intelligence: an evaluation harness and MCP plugin for always-on personal AI assistants and LLM agents. It checks whether Sensing, Memory, and Action are connected and whether self-evolving agents learn from outcomes, via paper and code audits and ablations.
Attentively Embracing Noise for Robust Latent Representation in BERT (COLING 2020)
[REALM @ EMNLP 2026] Do Context Files Help Coding Agents? Two-agent (Claude Code + Codex) ablation on whether AGENTS.md/CLAUDE.md change coding-agent correctness & efficiency.
A light-weight library for fast-ablation studies on GPT-like Language Models.
Emotiwave is a research project investigating how well AI systems can recognise human emotions from video when one or more sensors fail. The core question: if you lose the audio, or the camera, or the transcript — does the system fall apart, or does it adapt?
Differential Privacy in Machine Learning under Membership Inference Attacks
O(N) attention with a bounded inference KV cache. D4 Daubechies wavelet field + content-gated Q·K gather at dyadic offsets.
This study tries to compare the detection of lung diseases using xray scans from three different datasets using three different neural network architectures using Pytorch and perform an ablation study by changing learning rates. The dimensional understanding is visualised using t-SNE and Grad-CAM for visualisation of diseases in x-ray scans.
🧠 Automated neural network ablation studies using LLM agents and LangGraph. Systematically remove components, test performance, and gain insights into architecture importance through an intelligent multi-agent workflow.
ResNet-18 written from scratch in PyTorch: 96.06% CIFAR-10 test accuracy, each recipe choice backed by an ablation.
Beautiful modular D3QN research pipeline with training, ablations, plots, report, and packaging
A comprehensive experimental lab for Looped Transformers from scratch. Includes an automated ablation pipeline (ExperimentTable) and a real-time monitoring dashboard.
To associate your repository with the ablation-study topic, visit your repo's landing page and select "manage topics."