Commit Graph

Select branches

Hide Pull Requests

ds4f-mxfp4

glm-5.3-flash

glm5.2

laguna-s2.1

main

responses-api

#1

#100

#100/merge

#1000

#1000/merge

#1003

#1003/merge

#1004

#1004/merge

#1005

#1005/merge

#1006

#1006/merge

#1008

#1008/merge

#101

#1010

#1010/merge

#1011

#1011/merge

#1012

#1012/merge

#1013

#1013/merge

#1014

#1016

#1016/merge

#1017

#1017/merge

#1018

#1018/merge

#102

#1020

#1020/merge

#1021

#1022

#1022/merge

#1024

#1024/merge

#1027

#1027/merge

#1028

#103

#103/merge

#1030

#1030/merge

#1031

#1031/merge

#1033

#1033/merge

#1034

#1035

#1036

#1036/merge

#1037

#1038

#104

#104/merge

#1041

#1041/merge

#1042

#1042/merge

#1043

#1043/merge

#1044

#1047

#1048

#1048/merge

#1049

#105

#105/merge

#1050

#1050/merge

#1051

#1052

#1052/merge

#1055

#1056

#1058

#1058/merge

#1059

#1059/merge

#106

#1060

#1060/merge

#1061

#1061/merge

#1062

#1062/merge

#1063

#1064

#1065

#1067

#1067/merge

#1068

#1068/merge

#107

#107/merge

#1070

#1070/merge

#1071

#1071/merge

#1072

#1073

#1074

#1074/merge

#1077

#1079

#1079/merge

#1081

#1081/merge

#1082

#1083

#1083/merge

#1084

#1084/merge

#1086

#1086/merge

#1088

#1088/merge

#1089

#1089/merge

#109

#109/merge

#1090

#1090/merge

#1093

#1093/merge

#1094

#1094/merge

#1095

#1095/merge

#1096

#1096/merge

#1097

#1097/merge

#1098

#1098/merge

#1099

#1099/merge

#110

#1100

#1101

#1101/merge

#1102

#1102/merge

#1103

#1104

#1104/merge

#1106

#1106/merge

#1107

#1108

#1108/merge

#111

#1110

#1110/merge

#1112

#1112/merge

#1113

#1113/merge

#1115

#1115/merge

#1116

#1116/merge

#1117

#1117/merge

#1118

#1118/merge

#1120

#1121

#1121/merge

#1122

#1122/merge

#1123

#1123/merge

#1124

#1124/merge

#1125

#1125/merge

#1126

#1126/merge

#1127

#1128

#1128/merge

#1129

#1130

#1130/merge

#1131

#1131/merge

#1134

#1134/merge

#1135

#1137

#1137/merge

#1138

#1138/merge

#1139

#1139/merge

#1140

#1140/merge

#1142

#1142/merge

#1143

#1143/merge

#1144

#1144/merge

#1145

#1145/merge

#1147

#1148

#1148/merge

#1149

#1149/merge

#115

#115/merge

#1150

#1150/merge

#1152

#1152/merge

#1153

#1153/merge

#1154

#1154/merge

#1155

#1155/merge

#1156

#1156/merge

#1157

#1157/merge

#1158

#1158/merge

#1159

#116

#116/merge

#1160

#1160/merge

#1161

#1161/merge

#1162

#1162/merge

#1163

#1163/merge

#1165

#1167

#1167/merge

#1168

#1168/merge

#1169

#1169/merge

#117

#1170

#1170/merge

#1172

#1172/merge

#1174

#1174/merge

#1175

#1175/merge

#1177

#1177/merge

#1178

#1179

#1179/merge

#118

#1180

#1180/merge

#1182

#1182/merge

#1183

#1183/merge

#1184

#1184/merge

#1185

#1185/merge

#1187

#1187/merge

#119

#1190

#1190/merge

#1191

#1191/merge

#1192

#1193

#1193/merge

#1194

#1194/merge

#1197

#1197/merge

#1198

#1198/merge

#1199

#1200

#1200/merge

#1203

#1203/merge

#1204

#1204/merge

#1205

#1205/merge

#1206

#1206/merge

#1207

#1207/merge

#1208

#121

#121/merge

#1210

#1210/merge

#1212

#1212/merge

#1213

#1216

#1216/merge

#1217

#1217/merge

#1218

#1218/merge

#1219

#1219/merge

#122

#1220

#1220/merge

#1221

#1221/merge

#1222

#1222/merge

#1225

#1225/merge

#1226

#1226/merge

#1227

#1227/merge

#1228

#1228/merge

#1229

#1229/merge

#1230

#1230/merge

#1232

#1233

#1233/merge

#1234

#1234/merge

#1236

#1236/merge

#1237

#1237/merge

#1238

#124

#124/merge

#1241

#1241/merge

#1242

#1242/merge

#1244

#1245

#1246

#1246/merge

#1247

#1247/merge

#1248

#1248/merge

#1250

#1250/merge

#1251

#1251/merge

#1252

#1252/merge

#1253

#1253/merge

#1254

#1254/merge

#1256

#1256/merge

#1257

#1257/merge

#1258

#1258/merge

#1261

#1262

#1263

#1263/merge

#1264

#1264/merge

#1265

#1265/merge

#1267

#1267/merge

#1269

#1269/merge

#1270

#1272

#1272/merge

#1273

#1273/merge

#1274

#1274/merge

#1275

#1275/merge

#1276

#1276/merge

#1277

#1277/merge

#1278

#1278/merge

#1279

#1279/merge

#128

#1280

#1280/merge

#1281

#1281/merge

#1282

#1282/merge

#1283

#1283/merge

#1284

#1284/merge

#1285

#1285/merge

#1286

#1286/merge

#1287

#1287/merge

#1288

#1288/merge

#1289

#1289/merge

#129

#1290

#1290/merge

#1291

#1291/merge

#1293

#1293/merge

#1295

#1295/merge

#1296

#1296/merge

#1298

#1298/merge

#1299

#1299/merge

#130

#1300

#1300/merge

#1303

#1304

#1304/merge

#1306

#1306/merge

#1307

#1307/merge

#1309

#1309/merge

#131

#1310

#1310/merge

#1312

#1312/merge

#1313

#1313/merge

#1314

#1315

#1315/merge

#1319

#1319/merge

#132

#1320

#1321

#1321/merge

#1322

#1322/merge

#1323

#1323/merge

#1324

#1324/merge

#1325

#1325/merge

#1326

#1326/merge

#1327

#1328

#1328/merge

#133

#134

#134/merge

#135

#136

#137

#138

#139

#140

#141

#143

#143/merge

#144

#145

#145/merge

#146

#146/merge

#147

#147/merge

#148

#148/merge

#149

#15

#150

#151

#153

#153/merge

#155

#156

#158

#158/merge

#159

#162

#166

#168

#168/merge

#169

#175

#177

#178

#178/merge

#180

#181

#184

#184/merge

#185

#186

#186/merge

#187

#187/merge

#189

#19

#191

#192

#194

#195

#195/merge

#196

#196/merge

#197

#197/merge

#198

#2

#203

#204

#204/merge

#205

#205/merge

#206

#206/merge

#207

#207/merge

#212

#213

#215

#215/merge

#218

#219

#223

#223/merge

#224

#224/merge

#225

#225/merge

#227

#227/merge

#228

#23

#230

#230/merge

#232

#233

#234

#234/merge

#236

#238

#239

#24

#241

#241/merge

#242

#242/merge

#243

#243/merge

#245

#245/merge

#247

#248

#248/merge

#250

#250/merge

#252

#252/merge

#253

#255

#255/merge

#256

#256/merge

#258

#258/merge

#26

#26/merge

#261

#261/merge

#263

#263/merge

#264

#265

#265/merge

#266

#266/merge

#267

#268

#268/merge

#269

#269/merge

#27

#270

#270/merge

#271

#271/merge

#272

#273

#274

#276

#276/merge

#277

#279

#28

#280

#280/merge

#281

#281/merge

#282

#282/merge

#286

#287

#287/merge

#29

#290

#292

#294

#295

#296

#297

#298

#299

#3

#30

#300

#301

#301/merge

#302

#302/merge

#305

#305/merge

#306

#307

#307/merge

#308

#31

#310

#310/merge

#311

#312

#313

#315

#316

#317

#317/merge

#319

#32

#320

#322

#322/merge

#323

#323/merge

#324

#326

#326/merge

#327

#327/merge

#332

#336

#336/merge

#338

#343

#344

#345

#345/merge

#347

#347/merge

#349

#349/merge

#35

#350

#351

#352

#353

#353/merge

#354

#354/merge

#355

#356

#356/merge

#358

#36

#361

#361/merge

#362

#362/merge

#363

#365

#365/merge

#367

#368

#368/merge

#371

#371/merge

#373

#373/merge

#374

#376

#376/merge

#377

#377/merge

#378

#378/merge

#379

#379/merge

#38

#380

#380/merge

#381

#381/merge

#382

#382/merge

#383

#385

#385/merge

#39

#391

#394

#395

#395/merge

#396

#396/merge

#397

#398

#399

#399/merge

#400

#400/merge

#401

#401/merge

#402

#402/merge

#407

#411

#411/merge

#412

#413

#413/merge

#416

#416/merge

#418

#418/merge

#419

#419/merge

#420

#420/merge

#421

#421/merge

#423

#426

#426/merge

#430

#430/merge

#433

#434

#434/merge

#435

#435/merge

#438

#438/merge

#44

#441

#442

#443

#446

#446/merge

#447

#448

#45

#45/merge

#451

#451/merge

#453

#453/merge

#454

#456

#456/merge

#460

#461

#461/merge

#464

#464/merge

#466

#466/merge

#47

#472

#472/merge

#474

#474/merge

#478

#478/merge

#479

#479/merge

#480

#481

#481/merge

#482

#482/merge

#484

#484/merge

#487

#487/merge

#488

#488/merge

#489

#490

#490/merge

#492

#494

#494/merge

#497

#497/merge

#498

#499

#499/merge

#5

#502

#502/merge

#504

#507

#508

#508/merge

#511

#511/merge

#512

#512/merge

#513

#513/merge

#514

#515

#516

#517

#517/merge

#518

#519

#52

#520

#520/merge

#523

#523/merge

#524

#524/merge

#525

#525/merge

#526

#526/merge

#527

#528

#528/merge

#529

#529/merge

#53

#53/merge

#530

#531

#533

#535

#535/merge

#537

#539

#54

#54/merge

#540

#540/merge

#541

#542

#543

#544

#545

#546

#547

#548

#548/merge

#55

#55/merge

#550

#551

#551/merge

#552

#552/merge

#553

#553/merge

#555

#556

#556/merge

#557

#557/merge

#558

#558/merge

#559

#56

#560

#560/merge

#561

#561/merge

#566

#566/merge

#568

#568/merge

#570

#570/merge

#571

#571/merge

#572

#572/merge

#573

#573/merge

#574

#575

#575/merge

#578

#579

#579/merge

#58

#580

#581

#582

#582/merge

#583

#584

#584/merge

#587

#588

#589

#589/merge

#59

#59/merge

#590

#591

#591/merge

#592

#594

#594/merge

#598

#599

#599/merge

#60

#601

#601/merge

#602

#602/merge

#604

#604/merge

#605

#605/merge

#61

#61/merge

#611

#611/merge

#612

#613

#613/merge

#614

#614/merge

#616

#616/merge

#617

#619

#619/merge

#621

#622

#622/merge

#623

#628

#628/merge

#630

#630/merge

#631

#631/merge

#632

#632/merge

#633

#633/merge

#634

#637

#637/merge

#640

#645

#645/merge

#647

#647/merge

#648

#649

#649/merge

#650

#652

#656

#657

#659

#66

#662

#662/merge

#664

#664/merge

#665

#666

#669

#669/merge

#67

#670

#670/merge

#677

#68

#680

#680/merge

#681

#681/merge

#683

#686

#686/merge

#689

#689/merge

#69

#69/merge

#690

#690/merge

#692

#692/merge

#696

#696/merge

#699

#699/merge

#7

#70

#700

#700/merge

#701

#702

#702/merge

#703

#703/merge

#704

#704/merge

#706

#706/merge

#707

#708

#708/merge

#709

#709/merge

#710

#710/merge

#711

#711/merge

#712

#712/merge

#714

#714/merge

#715

#716

#716/merge

#717

#717/merge

#718

#718/merge

#72

#72/merge

#720

#722

#722/merge

#723

#723/merge

#725

#725/merge

#727

#727/merge

#728

#728/merge

#729

#729/merge

#73

#730

#737

#737/merge

#738

#738/merge

#739

#739/merge

#740

#740/merge

#741

#741/merge

#743

#744

#744/merge

#746

#747

#747/merge

#748

#748/merge

#749

#749/merge

#752

#752/merge

#753

#753/merge

#754

#754/merge

#755

#756

#756/merge

#757

#757/merge

#758

#758/merge

#761

#763

#763/merge

#764

#765

#766

#767

#767/merge

#77

#770

#770/merge

#772

#772/merge

#774

#774/merge

#775

#775/merge

#776

#776/merge

#777

#777/merge

#778

#778/merge

#779

#779/merge

#782

#782/merge

#785

#785/merge

#787

#788

#789

#79

#790

#790/merge

#794

#794/merge

#795

#795/merge

#796

#796/merge

#797

#797/merge

#798

#798/merge

#799

#799/merge

#800

#800/merge

#804

#804/merge

#806

#806/merge

#808

#808/merge

#81

#81/merge

#811

#813

#813/merge

#814

#814/merge

#815

#815/merge

#817

#818

#819

#82

#820

#821

#822

#824

#824/merge

#826

#826/merge

#827

#827/merge

#828

#828/merge

#83

#830

#830/merge

#831

#831/merge

#832

#832/merge

#833

#833/merge

#835

#835/merge

#837

#841

#841/merge

#843

#843/merge

#844

#844/merge

#846

#846/merge

#848

#848/merge

#849

#849/merge

#850

#850/merge

#852

#852/merge

#854

#854/merge

#856

#856/merge

#857

#86

#86/merge

#861

#863

#863/merge

#864

#864/merge

#865

#865/merge

#869

#869/merge

#87

#871

#871/merge

#872

#872/merge

#873

#873/merge

#874

#874/merge

#875

#875/merge

#876

#876/merge

#877

#877/merge

#878

#878/merge

#88

#882

#882/merge

#883

#883/merge

#884

#885

#885/merge

#886

#886/merge

#887

#888

#89

#89/merge

#892

#892/merge

#893

#894

#894/merge

#899

#9

#90

#90/merge

#902

#902/merge

#903

#903/merge

#904

#904/merge

#905

#909

#909/merge

#91

#914

#915

#915/merge

#916

#918

#918/merge

#919

#919/merge

#92

#92/merge

#920

#920/merge

#921

#921/merge

#923

#924

#927

#93

#93/merge

#930

#930/merge

#934

#934/merge

#935

#935/merge

#936

#936/merge

#937

#937/merge

#939

#94

#940

#940/merge

#941

#942

#942/merge

#943

#943/merge

#944

#944/merge

#947

#950

#950/merge

#952

#952/merge

#953

#954

#955

#955/merge

#956

#956/merge

#957

#957/merge

#958

#958/merge

#959

#959/merge

#96

#960

#960/merge

#961

#961/merge

#962

#962/merge

#963

#964

#965

#965/merge

#967

#967/merge

#968

#969

#969/merge

#97

#97/merge

#970

#970/merge

#971

#972

#972/merge

#975

#975/merge

#976

#976/merge

#977

#977/merge

#978

#978/merge

#979

#979/merge

#98

#981

#982

#983

#984

#984/merge

#985

#985/merge

#986

#986/merge

#987

#987/merge

#988

#988/merge

#99

#990

#990/merge

#991

#992

#993

#993/merge

#994

#995

#995/merge

#996

#997

#997/merge

Mono Color

• b3f50180ec Read half-aligned Qwen Q2 weight rows correctly on Metal main antirez 2026-11-03 16:55:02 +01:00
• 5e3a3449e2 Check both staging widths in the Qwen compact expert dispatch test antirez 2026-11-03 16:52:44 +01:00
• cd1c5507b6 Preserve resident Qwen prefill speed with speculative decoding antirez 2026-11-03 16:50:55 +01:00
• 2cd0ae7064 Keep M6 Qwen tuning separate from DeepSeek and GLM kernel selection antirez 2026-11-03 16:41:21 +01:00
• 5c9ed63c16 Keep generated Qwen research dumps out of the release tree antirez 2026-11-03 16:38:47 +01:00
• 7bba0f7d2c Load Qwen version 2 checkpoints and rebuild missing predictor history on demand antirez 2026-11-03 16:38:47 +01:00
• a2798605b7 Use resident Qwen arithmetic when experts are streamed from SSD antirez 2026-11-03 16:37:20 +01:00
• 0dbfd05e16 Keep Metal-only Qwen predictor kernel tests out of the CUDA binary antirez 2026-11-03 16:32:40 +01:00
• afd33efab2 Keep current M5 expert tuning alongside the streamed Metal path antirez 2026-11-03 16:29:39 +01:00
• c942a90fdd Restore Qwen predictor scratch views after the fused resident expert path antirez 2026-11-03 16:28:41 +01:00
• 4ef9e4d0d0 Merge #1056: Giorgio Oppo’s Qwen3.8 Metal SSD expert streaming antirez 2026-11-03 16:28:10 +01:00
• 9eb4a12f25 Merge upstream/main into qwen-kernel-opt Giorgio Oppo 2026-11-02 21:35:23 +01:00
• e4709b44be Share DeepSeek V4 Metal index queries across four keys antirez 2026-11-02 11:36:48 +01:00
• 9fe88cd312 Integrate the per-model Metal weight policy fix antirez 2026-11-02 11:26:14 +01:00
• 890898cfb4 Apply Metal weight tracking to the model being opened antirez 2026-11-02 11:26:14 +01:00
• a4bbb38ce4 Integrate the V4.1 memory-aware Metal TP fix antirez 2026-11-02 11:17:03 +01:00
• c54841002d Keep V4.1 TP sharded when either Mac needs the smaller working set antirez 2026-11-02 11:15:23 +01:00
• 8c54d7fb01 Merge #1073 with local Metal and Spark optimizations antirez 2026-11-02 11:11:33 +01:00
• 0accf8b395 Merge #1073: speed up DeepSeek V4.1 Flash on Metal antirez 2026-11-02 11:04:52 +01:00
• 6075227f1e Preserve the Spark small-batch shared-expert projection antirez 2026-11-02 11:04:22 +01:00
• 224e77e791 Keep Metal-only V4.1 decode helpers out of the Spark build antirez 2026-11-02 11:04:22 +01:00
• a88711246c Merge reviewed server PRs #1165 and #1245 from upstream antirez 2026-11-01 18:07:54 +01:00
• b4e3faf526 Merge #1245: allow up to 256 images per server request Salvatore Sanfilippo 2026-11-01 18:07:47 +01:00
• da2a102dd0 Merge #1165: advertise the loaded model modalities Salvatore Sanfilippo 2026-11-01 18:06:35 +01:00
• b7615c141f Keep the default CUDA unroll policy for multirow Qwen Q8 antirez 2026-11-01 09:46:06 +01:00
• 36e2680676 Link ROCm fallback symbols into standalone GPU test tools antirez 2026-11-01 09:43:04 +01:00
• ae40c5c4f0 Carry the complete V4.1 raw window through medium prefill pruning antirez 2026-10-31 20:43:40 +01:00
• c1bce729fc Cross the legacy GLM sparse boundary in one SSD layer sweep antirez 2026-10-31 20:42:03 +01:00
• ef8e536501 Reuse Q2_K bit planes in Qwen Metal expert prefills antirez 2026-10-31 20:35:44 +01:00
• 524c874506 Skip wired GLM weights during full-layer SSD read-ahead antirez 2026-10-31 20:32:49 +01:00
• 46ade1bb3e Reuse rotated compact keys across legacy GLM prefill queries antirez 2026-10-31 20:31:53 +01:00
• 1c6d058d9f Gather Qwen BF16 prompt embeddings directly on the GPU antirez 2026-10-31 20:30:32 +01:00
• d9fc9cf30c Merge #1147: validate sparse selection prefixes in Metal GLM prefill antirez 2026-10-31 20:30:04 +01:00
• b799c90e3a Resize independent image rows in parallel before vision prefill antirezandMarcello Costagliola 2026-10-31 20:28:10 +01:00
• 773247a881 Skip whole decoder chunks in medium V4.1 prefills antirez 2026-10-31 20:21:25 +01:00
• 8c9b1986a4 Merge #1127: overlap short callback-driven Metal Flash prefills antirez 2026-10-31 20:15:45 +01:00
• c2779bb4e8 Keep the four-head Flash indexer schedule on Metal TP antirez 2026-10-31 17:49:26 +01:00
• 32604bc6de Issue Qwen Q8 weights ahead during single-token CUDA decode antirez 2026-10-31 17:46:11 +01:00
• dc9580daf4 Merge #1213: stop discarded GLM MTP drafts after their KV write antirez 2026-10-31 17:38:36 +01:00
• babe24db9f Fill single-token GLM indexer tensor tiles with heads on Spark antirez 2026-10-31 17:33:15 +01:00
• db67455bed Reduce Metal Flash and Pro index scores with one barrier antirez 2026-10-31 17:33:15 +01:00
• efd018cc43 Tile single-host GLM 5.3 Flash indexed attention on Metal antirezandtrueimage 2026-10-31 17:32:53 +01:00
• b00bbf42da Remove per-head barriers in the CUDA Flash and Pro decode indexer antirez 2026-10-31 17:29:39 +01:00
• 79e59d7ac2 Merge #1270: keep legacy GLM MTP live across the sparse boundary antirez 2026-10-31 17:26:35 +01:00
• 95976d737f Merge #1238: speed up Qwen3.8 Metal decode antirez 2026-10-31 17:16:16 +01:00
• d61aa0c139 Reuse V4.1 index queries across eight keys per Spark warp antirez 2026-10-31 16:27:39 +01:00
• e3137ce6bc Batch disk Engram reads for Metal verifier rows antirezandbadelon 2026-10-31 15:54:28 +01:00
• 23c333bd1c Skip rejected V4.1 index keys in Metal SSD decode antirez 2026-10-31 15:52:26 +01:00
• c7bb2d7656 Skip masked V4.1 index scores on DGX Spark antirez 2026-10-31 15:49:39 +01:00
• 4c29e82b3e Merge #1034: queue single-host V4.1 Metal SSD decode by default antirez 2026-10-31 15:47:40 +01:00
• 47400ed008 Merge #1262: skip rejected V4.1 keys without changing Metal top-k ties antirez 2026-10-31 15:42:39 +01:00
• 32f4243a09 Merge #1261: pipeline resident V4.1 Metal decode submissions antirez 2026-10-31 15:37:19 +01:00
• f2e60304a3 Merge upstream/main into qwen-kernel-opt Giorgio Oppo 2026-10-31 09:39:36 +01:00
• e14d7f8b1e Release cached engines between regression tests antirez 2026-10-30 19:32:07 +01:00
• c97964b8aa Validate Qwen tokens before prefetched input staging antirez 2026-10-30 18:10:33 +01:00
• 21178462db Test indexer row-group tails and output bounds antirez 2026-10-30 17:57:19 +01:00
• 345d7f44cb Score four indexer rows per SIMD group HDYS-TTBYS 2026-10-24 09:43:03 +09:00
• e73e516e75 metal: reuse Q4_K raw loads in Qwen NAX prefill Matthijs van den Bos 2026-10-09 15:30:41 +02:00
• 64baaa0678 Test Qwen PLE prefetch parity and recovery Matthijs van den Bos 2026-09-29 23:11:25 +02:00
• 347c2e1fbe Overlap Qwen PLE reads with prefill GPU work Matthijs van den Bos 2026-09-29 22:49:30 +02:00
• 82aa7e8e60 metal: use shuffle network for non-causal top-k block sort Emilian Bold 2026-10-07 15:02:24 +03:00
• 5382eac5e0 metal: process medium V4.1 SSD appends in one layer sweep nomish 2026-10-19 20:22:48 -07:00
• a8ce74afd5 server: render blank reasoning as absent Tim Lawrenz 2026-10-28 14:55:16 +00:00
• 97e32768e6 metal: use exact divisions in the V4.1 FP4 activation quantizer nomish 2026-10-19 11:55:07 -07:00
• 381808d839 Test CPU-touched Metal buffer reclamation antirez 2026-10-30 17:49:58 +01:00
• a4c922c560 Fix a Metal session memory leak on /ctx Mark Shank 2026-10-21 11:11:03 -04:00
• 2768d0ed3c fix(jpeg): validate SOS spectral parameters in progressive scans Giulio Davide Carparelli 2026-10-30 00:45:26 +01:00
• 3459d5546b docs: revalidate streaming decode queue on Flash 1017 Dango233 2026-10-30 18:57:29 +08:00
• fc69b626ae Merge remote-tracking branch 'origin/main' into dango-codex/queue-1017-validation Dango233 2026-10-30 15:33:45 +08:00
• 1e6a0e9602 Decode: give batched Engram tables separate row buffers HDYS-TTBYS 2026-10-26 23:12:42 +09:00
• 694620956b Qwen decode: DS4_QWEN4_NO_PLE_OVERLAP restores up-front PLE staging; name the moe down_reduce n_hc slot paradise-runner 2026-10-26 06:36:53 -06:00
• 1be7b4db2a Decode: give each Engram table its own input buffer HDYS-TTBYS 2026-10-25 23:16:51 +09:00
• d9f2d15b40 glm: bridge MTP verification across the indexed attention boundary Luo Hanjun 2026-10-25 15:22:31 +08:00
• 5fd33a4e53 Set the candidate-decode flag after the Engram reads HDYS-TTBYS 2026-10-24 00:00:24 +09:00
• 9d7a00b4fb Restrict candidate-row scoring to single-token decode HDYS-TTBYS 2026-10-23 23:04:04 +09:00
• 01772c087a Optimize V4.1 long-context decode HDYS-TTBYS 2026-10-23 22:31:35 +09:00
• 57df7a5bf4 Pipeline V4.1 single-host batched decode command buffers HDYS-TTBYS 2026-10-23 18:24:30 +09:00
• be2773bc6f Pipeline V4.1 single-host decode command buffers HDYS-TTBYS 2026-10-23 18:24:30 +09:00
• 72ccf36317 Revert the V4.1 decode pre-encode: held command buffer, per-token GPU spin Tarjei Mandt 2026-10-22 15:04:10 +11:00
• 51fef8784a Merge pull request #9 from IngeniousIdiocy/v41-decode-on-kp7 Tarjei Mandt 2026-10-22 15:04:09 +11:00
• 3650da359e Turn off the V4.1 TP concurrent shared expert with the fixed-route switch Tarjei Mandt 2026-10-22 11:54:16 +11:00
• ce5b718be8 Start V4.1 short-sweep suffix pruning at 512 rows Tarjei Mandt 2026-10-22 11:54:06 +11:00
• 5b83cdfe8c Merge pull request #7 from ivanfioravanti/v41-tp-decode-engram-warm Tarjei Mandt 2026-10-22 11:53:51 +11:00
• e1d8114167 Encode the next V4.1 decode token while this one finishes Mark Shank 2026-10-21 11:55:48 -04:00
• 4ff3af604f Speed up the V4.1 decode top-512 Mark Shank 2026-10-21 11:55:16 -04:00
• 64ceeea4f5 Score long V4.1 decode index rows from bf16 keys Mark Shank 2026-10-21 11:54:36 -04:00
• e99dc21751 Spread two single-core V4.1 decode reductions over the GPU Mark Shank 2026-10-21 11:54:00 -04:00
• f0b4f55fcc Compute one RoPE table per V4.1 decode token Mark Shank 2026-10-21 11:53:25 -04:00
• 55b1e75e64 Narrow more V4.1 decode weights and read them with wider loads Mark Shank 2026-10-21 11:52:48 -04:00
• b66c926046 Compile V4.1's fixed decode shapes into its decode matvecs Mark Shank 2026-10-21 11:52:09 -04:00
• 95606b5045 Fix a data race in the V4.1 FP8 weight-copy builder Mark Shank 2026-10-21 11:51:33 -04:00
• 26335c7044 Overlap V4.1 decode hyper-connection weights with the projections Mark Shank 2026-09-18 19:27:54 -04:00
• f5127dfc82 Allow up to 256 images per server request ivanfioravanti 2026-10-21 19:43:58 +02:00
• 5a588dbf12 Share weight loads across two rows in the exact TP K-slice matvec ivanfioravanti 2026-10-21 17:54:49 +02:00
• 565db43559 Prune the V4.1 decoder suffix of short sweeps without changing the output ivanfioravanti 2026-10-21 17:20:24 +02:00
• 187f46b4fa ds4-bench: per-step decode logits hash and dump ivanfioravanti 2026-10-20 07:45:39 +02:00
• bdae7640ef Warm the V4.1 Engram page cache when the tables fit in memory ivanfioravanti 2026-10-20 07:45:21 +02:00
• e91c453ec2 Overlap more of V4.1 two-Mac TP decode ivanfioravanti 2026-10-21 08:13:51 +02:00
• ee7e840523 cuda: improve SSD-streamed prefill with ordered expert reads antirez 2026-10-21 09:30:33 +02:00
• 0f9b03c9df Speed up exact V4.1 prefill matmuls and indexer scores on M3 ivanfioravanti 2026-10-20 07:43:50 +02:00