Number of always-connected-nodes has grown by 10,000% over the past few months: we are consistently seeing 225k-250k nodes now, introducing new scaling challenges. These are unique nodes (we filter out spam), running a model (LLM/embedding), across mostly CPUs and some GPUs.
