📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
Light-field imaging application for plenoptic cameras
[ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection
xKV: Cross-Layer SVD for KV-Cache Compression
Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
Light field geometry estimator for plenoptic cameras
An efficient and scalable attention module designed to reduce memory usage and improve inference speed in large language models. Designed and implemented the Multi-Head Latent Attention (MLA) module as a drop-in replacement for traditional multi-head attention (MHA) in large language models.
🍺 CLI for quickly generating citations for websites and books
Exam-focused study notes for the AWS Certified Machine Learning - Associate (MLA-C01) certification exam.
Make your BibTeX perfect. Auto-clean entries, unify conference names (e.g., CVPR, NeurIPS), and generate citation keys for LaTeX & Word.
In this section, predicting the energy efficiency of buildings with machine learning algorithms.
Provided is a Google Apps Script that's soul purpose is to help make MLA writing easier
A production-grade LLM architecture built from scratch in PyTorch. Features Multi-Head Latent Attention (MLA), Mixture of Experts (MoE), GRPO alignment, and a complete 31-part educational course.
A Mixture of Experts model with latent attention designed for efficient training and inference.
Add a description, image, and links to the mla topic page so that developers can more easily learn about it.
To associate your repository with the mla topic, visit your repo's landing page and select "manage topics."