Skip to content
@xorbitsai

Xorbits

Xorbits makes it easy to scale ML and DS workloads, from data loading to preprocessing, tuning, training, and model serving.
README.md

XorbitsAI

Xorbits makes it easy to scale ML and DS workloads, from data loading to preprocessing, tuning, training, and model serving.

Slack Twitter

  • xorbits: Scalable Python DS & ML, in an API compatible & lightning fast way.
  • xinference: a powerful and versatile library designed to serve language, speech recognition, and multimodal models.
  • xoscar: Python actor framework for heterogeneous computing.

Pinned Loading

  1. inference inference Public

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-re…

    Python 8.9k 786

  2. xllamacpp xllamacpp Public

    Forked from shakfu/cyllama

    xllamacpp - a Python wrapper of llama.cpp

    C++ 68 9

  3. inference-client inference-client Public

    Python 9 9

  4. xoscar xoscar Public

    Python actor framework for heterogeneous computing.

    Python 169 28

  5. xinference-helm-charts xinference-helm-charts Public

    Smarty 13 13

  6. xorbits xorbits Public

    Scalable Python DS & ML, in an API compatible & lightning fast way.

    Python 1.2k 70

Repositories

Showing 10 of 15 repositories
  • inference Public

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

    xorbitsai/inference’s past year of commit activity
    Python 8,930 Apache-2.0 786 130 (1 issue needs help) 28 Updated Jan 12, 2026
  • inference-client Public
    xorbitsai/inference-client’s past year of commit activity
    Python 9 Apache-2.0 9 0 0 Updated Jan 10, 2026
  • xoscar Public

    Python actor framework for heterogeneous computing.

    xorbitsai/xoscar’s past year of commit activity
    Python 169 Apache-2.0 28 18 5 Updated Jan 8, 2026
  • xorbits Public

    Scalable Python DS & ML, in an API compatible & lightning fast way.

    xorbitsai/xorbits’s past year of commit activity
    Python 1,203 Apache-2.0 70 106 (10 issues need help) 14 Updated Jan 1, 2026
  • xllamacpp Public Forked from shakfu/cyllama

    xllamacpp - a Python wrapper of llama.cpp

    xorbitsai/xllamacpp’s past year of commit activity
    C++ 68 MIT 13 3 0 Updated Dec 29, 2025
  • xinference-helm-charts Public
    xorbitsai/xinference-helm-charts’s past year of commit activity
    Smarty 13 Apache-2.0 13 0 0 Updated Dec 27, 2025
  • enterprise-docs Public

    Official enterprise version docs.

    xorbitsai/enterprise-docs’s past year of commit activity
    1 1 0 0 Updated Sep 26, 2025
  • doc-insights Public
    xorbitsai/doc-insights’s past year of commit activity
    Python 2 1 0 0 Updated Nov 25, 2023
  • Audits-Demo Public
    xorbitsai/Audits-Demo’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Nov 20, 2023
  • benchmarks Public

    Performance benchmarks that Xorbits vs other libraries.

    xorbitsai/benchmarks’s past year of commit activity
    Python 9 Apache-2.0 3 0 1 Updated Oct 20, 2023
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.