Jump to content

Main public logs

Combined display of all available logs of JOHNWICK. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).

Logs
  • 07:38, 19 November 2025 PC talk contribs created page What Happens When AI Models Start Running on Rust Inference Engines? (Created page with "It started with a weird bug in Python.
Of course it did. I was running a simple PyTorch inference — nothing fancy, just a model predicting customer churn. Everything looked fine until… latency went wild.
One request took 89 ms, the next took 3100 ms, and then — randomly — 487 ms. I stared at my terminal like it had personally betrayed me. That’s when a colleague said, “Why not try Rust?”
And honestly? I laughed.
Rust for machine learning inferenc...")