README.md

metadata

license: apache-2.0
base_model:
  - unsloth/Qwen3.6-35B-A3B-GGUF
pipeline_tag: image-text-to-text
library_name: mesh-llm
tags:
  - distributed-inference
  - gguf
  - mesh-llm
  - moe
  - qwen
  - qwen3_5_moe
  - topology-independent
  - unsloth

Mesh-LLM MoE Package

This repository stores Mesh-LLM topology-independent MoE package artifacts derived from unsloth/Qwen3.6-35B-A3B-GGUF. It is published as meshllm/qwen3.6-35b-a3b-gguf-moe and is meant to be consumed by mesh-llm serve.

Source

• repo: unsloth/Qwen3.6-35B-A3B-GGUF
• revision: 9280dd353ab587157920d5bd391ada414d84e552

What This Repository Contains

• meshllm.json describes the upstream source repo and all published variants in this package repository.
• variants/<variant>/manifest.json is the runtime entrypoint used to materialize MoE shards.
• variants/<variant>/ranking.csv and variants/<variant>/analysis.json contain the analyzer output for that variant.
• variants/<variant>/trunk.gguf plus variants/<variant>/experts/ hold the topology-independent component artifacts.

Available Variants

Q4_K_XL

• Mesh model ref: unsloth/Qwen3.6-35B-A3B-GGUF:Q4_K_XL
• Distribution id: Qwen3.6-35B-A3B-UD-Q4_K_XL
• Manifest: variants/Q4_K_XL/manifest.json
• Serve with:

mesh-llm serve 'unsloth/Qwen3.6-35B-A3B-GGUF:Q4_K_XL'

Notes

• This is a derived Mesh-LLM package repository, not the original upstream model repository.
• mesh-llm will prefer published package artifacts from this repository when a matching catalog entry exists.