Skip to content

Develop medical text classification operator #1234

Closed

Description

@qwertyuiop1868
  • [ Step1--collect some medical data like medical QAs, then use the data to train a NLP model and save the trained model]

  • [Step2--develop a new operator like the sentiment analysis operator in Texera, the new operator will load the trained model and provide an interface to test data ]

  • [ Step3--After the operator receive the test data, the trained model will give corresponding predictions, finally the operator output these predictions to the " view results" icon to visualize it]

Activity

  1. qwertyuiop1868 commented on Jul 15, 2021

    @qwertyuiop1868
    Author
    1. read raw data( json file )into Texera by converting the data format
    2. develop an operator to integrate Bert model
    3. use the operator to classify, we input tuples to the operator, and the operator output corresponding prediction

    Bert pretrained model: https://github.com/google-research/bert

  2. qwertyuiop1868 commented on Jul 22, 2021

    @qwertyuiop1868
    Author

    The first workflow has been built successfully in pytorch environment, with the predict speed a little slow

  3. qwertyuiop1868 commented on Jul 22, 2021

    @qwertyuiop1868
    Author
    1. read raw data into Texera
    2. develop a Python UDF to filter the data to get high-frequency labels and split these filtered data into train set, valid set and test set
    3. develop a Python UDF for supervised training, after training, the UDF output predictions for test set
  4. qwertyuiop1868 commented on Jul 30, 2021

    @qwertyuiop1868
    Author

    The second workflow has finished, with small amount of training data

  5. qwertyuiop1868 commented on Jul 30, 2021

    @qwertyuiop1868
    Author

    For now my task of medical text classification has entirely completed

  6. Yicong-Huang commented on Aug 2, 2021

    @Yicong-Huang
    Contributor

    @Make0913 please document the workflows, you can include screenshots, gifs, and even texera links here.

  7. qwertyuiop1868 commented on Aug 2, 2021

    @qwertyuiop1868
    Author

    I have archived my workflow and related data files to project account on Texera
    URL: https://texera.ics.uci.edu/workflow/116

    I will show the screenshot of my work below:
    For the workflow of training step:

    • the workflow structure

    截屏2021-08-03 上午7 40 59

    • the result

    截屏2021-08-03 上午7 41 08

    For the workflow of predict step:

    • the workflow structure

    截屏2021-08-03 上午7 41 21

    • the result

    截屏2021-08-03 上午7 41 31

  8. Yicong-Huang commented on Sep 6, 2021

    @Yicong-Huang
    Contributor

    @Make0913 please do the same steps for this use case, 1) share workflows and files to project account. 2) add a reference here for each workflow. Thanks!

  9. qwertyuiop1868 commented on Sep 8, 2021

    @qwertyuiop1868
    Author

    Done!

  10. Yicong-Huang commented on Sep 8, 2021

    @Yicong-Huang
    Contributor

    Thanks! I will archive this issue now.

  11. added a commit that references this issue on Oct 16, 2025
    38d94ad
  12. added a commit that references this issue on Oct 22, 2025
    3166752
  13. 290 remaining items

  14. added 15 commits that reference this issue on Jun 22, 2026
    240ae53
    83769ae
    dac0dda
    9355af7
    fffbddf
    b8bae84
    150ea62
    bb15bf6
    62af7a3
    8418521
    57134f7
    4dfcf2f
    f922e3c
    556da04
    ce044c1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions