Home / Tools / Live playground
Tool 02 · Live playground

Ask it anything.
Watch it fly.

Cooled by Nexalus

Chat with Llama 3.3 70B on a Nova 8 and watch your tokens per second live. Until the public endpoint opens, the playground runs in demo mode with pre-written answers.

Llama 3.3 70BDemo mode
Hi! I'm running on a Nova 8 cooled by Nexalus. Pick a prompt below or type your own.

Your stream

0tokens / second
First token—
Tokens0

Whole server, right now

54,968

tokens/second across all users on 8 GPUs (replay of the measured one-hour run)

Demo mode replays pre-written answers at an illustrative speed. Live mode measures the real stream from the server: tokens per second, time to first token and token count.

More tools

Keep exploring.

Cooled by Nexalus