Diffusers
medical
How to use from the
Use from the
Diffusers library
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("R-J/StainFuser", dtype=torch.bfloat16, device_map="cuda")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

StainFuser: Controlling Diffusion for Faster Neural Style Transfer in Multi-Gigapixel Histology Images

Repo containing model weights from the paper, Github code can be found here

StainFuser

Organisation

  • checkpoint: StainFuser trained weights trained at 512x512 resolution with mixed magnification
  • training: contains SD per-trained weights for backbone initialistaion in training

Citation

@misc{jewsbury2024stainfuser,
      title={StainFuser: Controlling Diffusion for Faster Neural Style Transfer in Multi-Gigapixel Histology Images}, 
      author={Robert Jewsbury and Ruoyu Wang and Abhir Bhalerao and Nasir Rajpoot and Quoc Dang Vu},
      year={2024},
      eprint={2403.09302},
      archivePrefix={arXiv},
      primaryClass={eess.IV}
}
Downloads last month
41
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train R-J/StainFuser

Paper for R-J/StainFuser