BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
Paper • 2411.16102 • Published
andy-yang
andy-yang
AI & ML interests
None yet
Recent Activity
upvoted a paper about 2 months ago
FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale upvoted a paper 3 months ago
Combee: Scaling Prompt Learning for Self-Improving Language Model Agents authored a paper 4 months ago
BlendServe: Optimizing Offline Inference for Auto-regressive Large
Models with Resource-aware BatchingOrganizations
authored 10
papers 4 months ago
Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation
Paper • 2506.19852 • Published • 43
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
Paper • 2509.24006 • Published • 119
Barbarians at the Gate: How AI is Upending Systems Research
Paper • 2510.06189 • Published • 9
StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generation
Paper • 2511.07399 • Published • 1
WorldModelBench: Judging Video Generation Models As World Models
Paper • 2502.20694 • Published
Jet-RL: Enabling On-Policy FP8 Reinforcement Learning with Unified Training and Rollout Precision Flow
Paper • 2601.14243 • Published • 24
Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantization
Paper • 2602.02958 • Published • 34
SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routing
Paper • 2603.08982 • Published • 16
Flash-KMeans: Fast and Memory-Efficient Exact K-Means
Paper • 2603.09229 • Published • 84
authored 6
papers about 1 year ago
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
Paper • 2311.03285 • Published • 30
Rethinking Benchmark and Contamination for Language Models with Rephrased Samples
Paper • 2311.04850 • Published
Post-Training Sparse Attention with Double Sparsity
Paper • 2408.07092 • Published
Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
Paper • 2502.01776 • Published • 3
Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning
Paper • 2502.02770 • Published • 1
Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation
Paper • 2505.18875 • Published • 42