Diffusion Language Models combining deep narrow networks, Canon layers (depthwise causal convolutions), and WSD (Warmup-Stable-Decay) training.
Asankhaya Sharma
codelion
AI & ML interests
Creator of OptiLLM, OpenEvolve, Adaptive Classifier, and Ellora. Pioneering a new category in AI infrastructure: inference-time compute for LLMs.
Recent Activity
updated
a model about 8 hours ago
mlx-community/Qwen3.5-4B-OptiQ-4bit published
a model about 8 hours ago
mlx-community/Qwen3.5-4B-OptiQ-4bit updated
a model about 15 hours ago
mlx-community/Qwen3.5-2B-OptiQ-4bit Organizations
A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.
Pivotal Token Search (PTS) identifies tokens in a language model's generation that significantly impact the probability of success
All models, datasets and tools related to https://securade.ai
High-quality synthetic educational datasets designed for LLM pretraining with structured pedagogical content across 9 knowledge domains.
Ellora: Enhancing LLMs with LoRA - Standardized Recipes for Capability Enhancement
Internal Coherence Maximization (ICM): A Label-Free, Unsupervised Training Framework for LLMs
Diffusion Language Models combining deep narrow networks, Canon layers (depthwise causal convolutions), and WSD (Warmup-Stable-Decay) training.
High-quality synthetic educational datasets designed for LLM pretraining with structured pedagogical content across 9 knowledge domains.
A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.
Ellora: Enhancing LLMs with LoRA - Standardized Recipes for Capability Enhancement
Pivotal Token Search (PTS) identifies tokens in a language model's generation that significantly impact the probability of success
Internal Coherence Maximization (ICM): A Label-Free, Unsupervised Training Framework for LLMs
All models, datasets and tools related to https://securade.ai