Agora Dashboard

Pluralis-8B Finished

Overview

• Peak: 114
• Loss: 2.438
• TPS: 5.9 kTPS
• Protocol Overhead: 38%

Telemetry

• Pluralis: —%
• Training Loss: Cross-entropy

Analysis

• Mean MFU: 20.2%

Baselines:

• Optimal central setting: 6.74
• Megatron-LM at 200 Mbps: 0.37 tok/s/TFLOP. See Analysis tab for full breakdown + sources.

Hardware

• Total Swarm TFLOPS: 39.88k
• Active Dense BF16 Compute:
  • Pluralis: 56%
  • Contributor: 46%

Geography

• Norm. Accuracy:
  • ARC Easy: 63.3%
  • ARC Challenge: 36.8%
  • PIQA: 72.7%
  • BoolQ: 62.3%
  • OpenBookQA: 37.2%

Throughput

• Tokens/sec:
• Throughput per TFLOP: Tok/s divided by active dense BF16 TFLOPs · higher is better
• Baselines: 4.20~