Skip to content

Pass control messages to Python UDF operator in Amber #816

Closed

Description

@zuozhiw

The new Amber engine supports many types of control messages, such as pause, resume, breakpoints, etc.. Such control messages are detected by the engine after every tuple iteration.

In the Python UDF operator implementation, such checks happen at every batch. This will make response to control messages slow. We want to pass control messages to the Python UDF operator.

Activity

  1. self-assigned this
    on Apr 23, 2021
  2. linked a pull request that will close this issuePython Proxy Server & Client #1143on Aug 2, 2021
  3. linked a pull request that will close this issuePython DPThread #1153on Aug 2, 2021
  4. linked a pull request that will close this issueAdd Python DataProcessing Thread #1267on Aug 2, 2021
  5. linked a pull request that will close this issueAdd PythonUDF V2 #1274on Aug 2, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions