Skip to content
@prolific-oss

Prolific

The ultimate human data platform to power world-changing AI and research.
README.md

Prolific

Prolific connects researchers and developers with a global pool of vetted human participants. Using the Prolific API, you can recruit participants in minutes to power workflows that require real human input, including:

  • Post-training
  • Preference collection
  • Model evaluations
  • Red-teaming
  • UX research
  • and other human-in-the-loop tasks.

This GitHub organization contains open-source repositories, examples, and developer tools to help you integrate with and build on top of Prolific.

Get started

Featured repos

  • CLI: Command-line tools for interacting with the Prolific API.
  • Prolific AI Task Builder: Getting Started: A streamlined workflow for collecting pairwise human preference data at scale for preference tuning and AI alignment research.

Pinned Loading

  1. rlhf_data_collection_pipeline_aitb rlhf_data_collection_pipeline_aitb Public

    Example for building, managing, and scaling preference data collection for AI using Prolific's AI Task Builder

    Jupyter Notebook 13

  2. cli cli Public

    🔬 A CLI for managing and automating workflows on the Prolific platform

    Go 9 5

  3. commercial-pressure-evals commercial-pressure-evals Public

    Home for commercial pressure evaluations and the paper "The Missing Red Line"

    Python

  4. prolific-survey-getting-started prolific-survey-getting-started Public

    A Python getting-started example showing how to use the Prolific API to launch a survey and collect high-quality human participant data for AI, research, and more.

    Jupyter Notebook

  5. prolific-external-study-link-getting-started prolific-external-study-link-getting-started Public

    A minimal, end-to-end example showing how to create and run a Prolific study that links participants to an external survey or application. Designed as a getting-started demo for researchers, engine…

    Jupyter Notebook

  6. prolific-ai-task-builder-getting-started prolific-ai-task-builder-getting-started Public

    A getting-started demo showing how to build and run AI Task Builder jobs on Prolific to collect large-scale human annotations or judgments. The example covers uploading datasets, configuring tasks,…

    Jupyter Notebook

Repositories

Showing 10 of 16 repositories
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…