Apply log formatter on every ouput line in SSHOperator by dolfinus · Pull Request #27442 · apache/airflow

dolfinus · 2022-11-01T15:27:06Z

If a command running by SSHOperator returns multiline logs, they are logged into task log. But logging format is applied only to the first line.

For example, logs printed by command:

2022-10-12 10:26:05,919 [INFO    ] ===================================== DBReader starts =====================================
2022-10-12 10:26:05,919 [INFO    ] |Hive| -> |Spark| Reading table to DataFrame using parameters:
2022-10-12 10:26:05,919 [INFO    ]          table = 'myschema.mytable'
2022-10-12 10:26:05,920 [INFO    ]          columns = '*'
2022-10-12 10:26:05,920 [INFO    ]          options = None
2022-10-12 10:26:05,920 [INFO    ] |Hive| Checking connection availability...
2022-10-12 10:26:05,923 [INFO    ] |Spark| Using connection parameters:
2022-10-12 10:26:05,923 [INFO    ]          type = Hive
2022-10-12 10:26:07,717 [INFO    ] |Hive| Connection is available.
2022-10-12 10:26:07,718 [INFO    ] |Hive| Fetching schema of table 'myschema.mytable'
2022-10-12 10:26:11,094 [INFO    ] |Hive| Executing SQL query:
2022-10-12 10:26:11,094 [INFO    ]          SELECT
2022-10-12 10:26:11,094 [INFO    ]                 col1,
2022-10-12 10:26:11,095 [INFO    ]                 col2,
2022-10-12 10:26:11,095 [INFO    ]                 col3
2022-10-12 10:26:11,097 [INFO    ]          FROM
2022-10-12 10:26:11,097 [INFO    ]                 myschema.mytable
2022-10-12 10:26:11,267 [INFO    ] |Spark| DataFrame successfully created from SQL statement
2022-10-12 10:26:11,267 [INFO    ] -------------------------------------- DBReader ends --------------------------------------
2022-10-12 10:26:11,267 [INFO    ] ===================================== DBReader starts =====================================
2022-10-12 10:26:11,267 [INFO    ] |Hive| -> |Spark| Reading table to DataFrame using parameters:
2022-10-12 10:26:11,267 [INFO    ]          table = 'myschema.anothertable'
2022-10-12 10:26:11,268 [INFO    ]          columns = '*'
2022-10-12 10:26:11,268 [INFO    ]          where = "version_dt = '2022-09-24' and business_dt > '2022-12-01'"
2022-10-12 10:26:11,268 [INFO    ]          options = None
2022-10-12 10:26:11,268 [INFO    ] |Hive| Checking connection availability...
2022-10-12 10:26:11,271 [INFO    ] |Spark| Using connection parameters:
2022-10-12 10:26:11,271 [INFO    ]          type = Hive
2022-10-12 10:26:11,320 [INFO    ] |Hive| Connection is available.
2022-10-12 10:26:11,321 [INFO    ] |Hive| Fetching schema of table 'myschema.anothertable'
2022-10-12 10:26:11,419 [INFO    ] |Hive| Executing SQL query:
2022-10-12 10:26:11,420 [INFO    ]          SELECT
2022-10-12 10:26:11,420 [INFO    ]                 number,
2022-10-12 10:26:11,420 [INFO    ]                 version_dt,
2022-10-12 10:26:11,420 [INFO    ]                 business_dt
2022-10-12 10:26:11,420 [INFO    ]          FROM
2022-10-12 10:26:11,420 [INFO    ]                 myschema.anothertable
2022-10-12 10:26:11,421 [INFO    ]          WHERE
2022-10-12 10:26:11,421 [INFO    ]                 version_dt = '2022-09-24' and business_dt > '2022-12-01'
2022-10-12 10:26:11,695 [INFO    ] |Spark| DataFrame successfully created from SQL statement
2022-10-12 10:26:11,696 [INFO    ] -------------------------------------- DBReader ends --------------------------------------
2022-10-12 10:26:12,146 [INFO    ] ===================================== DBWriter starts =====================================
2022-10-12 10:26:12,147 [INFO    ] |Spark| -> |Hive| Writing DataFrame to table using parameters:
2022-10-12 10:26:12,147 [INFO    ]          table = 'myschema.newtable'
2022-10-12 10:26:12,147 [INFO    ]          options:
2022-10-12 10:26:12,147 [INFO    ]              mode = 'overwrite_table'
2022-10-12 10:26:12,147 [INFO    ]              format = 'orc'
2022-10-12 10:26:12,148 [INFO    ]              partitionBy = 'business_dt'
2022-10-12 10:26:12,148 [INFO    ]          DataFrame schema
2022-10-12 10:26:12,155 [INFO    ]              root
2022-10-12 10:26:12,156 [INFO    ]              |-- col1: string (nullable = true)
2022-10-12 10:26:12,156 [INFO    ]              |-- col2: string (nullable = true)
2022-10-12 10:26:12,156 [INFO    ]              |-- col2: string (nullable = true)
2022-10-12 10:26:12,156 [INFO    ]              |-- business_dt: date (nullable = true)
2022-10-12 10:26:12,156 [INFO    ] |Hive| Checking connection availability...
2022-10-12 10:26:12,156 [INFO    ] |Spark| Using connection parameters:
2022-10-12 10:26:12,156 [INFO    ]          type = Hive
2022-10-12 10:26:12,173 [INFO    ] |Hive| Connection is available.
2022-10-12 10:26:12,174 [INFO    ] |Hive| Fetching schema of table 'myschema.newtable'
2022-10-12 10:26:12,324 [INFO    ] |Hive| Table 'myschema.newtable' already exists
2022-10-12 10:26:12,325 [INFO    ] |Hive| Saving data to a table 'myschema.newtable'
2022-10-12 10:33:25,856 [INFO    ] |Hive| Table 'myschema.newtable' successfully created
2022-10-12 10:33:25,857 [INFO    ] -------------------------------------- DBWriter ends --------------------------------------

and how they are printed to task log in Airflow:

[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,919 [INFO    ] ===================================== DBReader starts =====================================
2022-10-12 10:26:05,919 [INFO    ] |Hive| -> |Spark| Reading table to DataFrame using parameters:
2022-10-12 10:26:05,919 [INFO    ]          table = 'myschema.mytable'
2022-10-12 10:26:05,920 [INFO    ]          columns = '*'
2022-10-12 10:26:05,920 [INFO    ]          options = None
2022-10-12 10:26:05,920 [INFO    ] |Hive| Checking connection availability...
[2022-10-12 07:26:05,931] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,923 [INFO    ] |Spark| Using connection parameters:
2022-10-12 10:26:05,923 [INFO    ]          type = Hive
[2022-10-12 07:26:07,733] {ssh_hook.py:472} INFO - 2022-10-12 10:26:07,717 [INFO    ] |Hive| Connection is available.
2022-10-12 10:26:07,718 [INFO    ] |Hive| Fetching schema of table 'myschema.mytable'
[2022-10-12 07:26:11,100] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,094 [INFO    ] |Hive| Executing SQL query:
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,094 [INFO    ]          SELECT
2022-10-12 10:26:11,094 [INFO    ]                 col1,
2022-10-12 10:26:11,095 [INFO    ]                 col2,
2022-10-12 10:26:11,095 [INFO    ]                 col3
2022-10-12 10:26:11,097 [INFO    ]          FROM
2022-10-12 10:26:11,097 [INFO    ]                 myschema.mytable
[2022-10-12 07:26:11,270] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ] |Spark| DataFrame successfully created from SQL statement
2022-10-12 10:26:11,267 [INFO    ] -------------------------------------- DBReader ends --------------------------------------
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ] ===================================== DBReader starts =====================================
2022-10-12 10:26:11,267 [INFO    ] |Hive| -> |Spark| Reading table to DataFrame using parameters:
2022-10-12 10:26:11,267 [INFO    ]          table = 'myschema.anothertable'
2022-10-12 10:26:11,268 [INFO    ]          columns = '*'
2022-10-12 10:26:11,268 [INFO    ]          where = "version_dt = '2022-09-24' and business_dt > '2022-12-01'"
2022-10-12 10:26:11,268 [INFO    ]          options = None
2022-10-12 10:26:11,268 [INFO    ] |Hive| Checking connection availability...
2022-10-12 10:26:11,271 [INFO    ] |Spark| Using connection parameters:
2022-10-12 10:26:11,271 [INFO    ]          type = Hive
[2022-10-12 07:26:11,329] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,320 [INFO    ] |Hive| Connection is available.
2022-10-12 10:26:11,321 [INFO    ] |Hive| Fetching schema of table 'myschema.anothertable'
[2022-10-12 07:26:11,424] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,419 [INFO    ] |Hive| Executing SQL query:
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]          SELECT
2022-10-12 10:26:11,420 [INFO    ]                 number,
2022-10-12 10:26:11,420 [INFO    ]                 version_dt,
2022-10-12 10:26:11,420 [INFO    ]                 business_dt
2022-10-12 10:26:11,420 [INFO    ]          FROM
2022-10-12 10:26:11,420 [INFO    ]                 myschema.anothertable
2022-10-12 10:26:11,421 [INFO    ]          WHERE
2022-10-12 10:26:11,421 [INFO    ]                 version_dt = '2022-09-24' and business_dt > '2022-12-01'
[2022-10-12 07:26:11,701] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,695 [INFO    ] |Spark| DataFrame successfully created from SQL statement
2022-10-12 10:26:11,696 [INFO    ] -------------------------------------- DBReader ends --------------------------------------
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,146 [INFO    ] ===================================== DBWriter starts =====================================
2022-10-12 10:26:12,147 [INFO    ] |Spark| -> |Hive| Writing DataFrame to table using parameters:
2022-10-12 10:26:12,147 [INFO    ]          table = 'myschema.newtable'
2022-10-12 10:26:12,147 [INFO    ]          options:
2022-10-12 10:26:12,147 [INFO    ]              mode = 'overwrite_table'
2022-10-12 10:26:12,147 [INFO    ]              format = 'orc'
2022-10-12 10:26:12,148 [INFO    ]              partitionBy = 'business_dt'
2022-10-12 10:26:12,148 [INFO    ]          DataFrame schema
[2022-10-12 07:26:12,159] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,155 [INFO    ]              root
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ]              |-- col1: string (nullable = true)
2022-10-12 10:26:12,156 [INFO    ]              |-- col2: string (nullable = true)
2022-10-12 10:26:12,156 [INFO    ]              |-- col2: string (nullable = true)
2022-10-12 10:26:12,156 [INFO    ]              |-- business_dt: date (nullable = true)
2022-10-12 10:26:12,156 [INFO    ] |Hive| Checking connection availability...
2022-10-12 10:26:12,156 [INFO    ] |Spark| Using connection parameters:
2022-10-12 10:26:12,156 [INFO    ]          type = Hive
[2022-10-12 07:26:12,179] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,173 [INFO    ] |Hive| Connection is available.
2022-10-12 10:26:12,174 [INFO    ] |Hive| Fetching schema of table 'myschema.newtable'
[2022-10-12 07:26:12,330] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,324 [INFO    ] |Hive| Table 'myschema.newtable' already exists
2022-10-12 10:26:12,325 [INFO    ] |Hive| Saving data to a table 'myschema.newtable'
[2022-10-12 07:33:25,863] {ssh_hook.py:472} INFO - 2022-10-12 10:33:25,856 [INFO    ] |Hive| Table 'myschema.newtable' successfully created
2022-10-12 10:33:25,857 [INFO    ] -------------------------------------- DBWriter ends --------------------------------------

Indents are messed up, this is really hard to read.

Now SSHHook splits multiline logs, and logs every line separately:

[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,919 [INFO    ] ===================================== DBReader starts =====================================
[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,919 [INFO    ] |Hive| -> |Spark| Reading table to DataFrame using parameters:
[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,919 [INFO    ]          table = 'myschema.mytable'
[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,920 [INFO    ]          columns = '*'
[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,920 [INFO    ]          options = None
[2022-10-12 07:26:05,928] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,920 [INFO    ] |Hive| Checking connection availability...
[2022-10-12 07:26:05,931] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,923 [INFO    ] |Spark| Using connection parameters:
[2022-10-12 07:26:05,931] {ssh_hook.py:472} INFO - 2022-10-12 10:26:05,923 [INFO    ]          type = Hive
[2022-10-12 07:26:07,733] {ssh_hook.py:472} INFO - 2022-10-12 10:26:07,717 [INFO    ] |Hive| Connection is available.
[2022-10-12 07:26:07,733] {ssh_hook.py:472} INFO - 2022-10-12 10:26:07,718 [INFO    ] |Hive| Fetching schema of table 'myschema.mytable'
[2022-10-12 07:26:11,100] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,094 [INFO    ] |Hive| Executing SQL query:
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,094 [INFO    ]          SELECT
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,094 [INFO    ]                 col1,
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,095 [INFO    ]                 col2,
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,095 [INFO    ]                 col3
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,097 [INFO    ]          FROM
[2022-10-12 07:26:11,105] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,097 [INFO    ]                 myschema.mytable
[2022-10-12 07:26:11,270] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ] |Spark| DataFrame successfully created from SQL statement
[2022-10-12 07:26:11,270] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ] -------------------------------------- DBReader ends --------------------------------------
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ] ===================================== DBReader starts =====================================
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ] |Hive| -> |Spark| Reading table to DataFrame using parameters:
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,267 [INFO    ]          table = 'myschema.anothertable'
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,268 [INFO    ]          columns = '*'
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,268 [INFO    ]          where = "version_dt = '2022-09-24' and business_dt > '2022-12-01'"
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,268 [INFO    ]          options = None
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,268 [INFO    ] |Hive| Checking connection availability...
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,271 [INFO    ] |Spark| Using connection parameters:
[2022-10-12 07:26:11,277] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,271 [INFO    ]          type = Hive
[2022-10-12 07:26:11,329] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,320 [INFO    ] |Hive| Connection is available.
[2022-10-12 07:26:11,329] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,321 [INFO    ] |Hive| Fetching schema of table 'myschema.anothertable'
[2022-10-12 07:26:11,424] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,419 [INFO    ] |Hive| Executing SQL query:
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]          SELECT
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]                 number,
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]                 version_dt,
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]                 business_dt
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]          FROM
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,420 [INFO    ]                 myschema.anothertable
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,421 [INFO    ]          WHERE
[2022-10-12 07:26:11,430] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,421 [INFO    ]                 version_dt = '2022-09-24' and business_dt > '2022-12-01'
[2022-10-12 07:26:11,701] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,695 [INFO    ] |Spark| DataFrame successfully created from SQL statement
[2022-10-12 07:26:11,701] {ssh_hook.py:472} INFO - 2022-10-12 10:26:11,696 [INFO    ] -------------------------------------- DBReader ends --------------------------------------
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,146 [INFO    ] ===================================== DBWriter starts =====================================
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,147 [INFO    ] |Spark| -> |Hive| Writing DataFrame to table using parameters:
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,147 [INFO    ]          table = 'myschema.newtable'
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,147 [INFO    ]          options:
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,147 [INFO    ]              mode = 'overwrite_table'
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,147 [INFO    ]              format = 'orc'
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,148 [INFO    ]              partitionBy = 'business_dt'
[2022-10-12 07:26:12,154] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,148 [INFO    ]          DataFrame schema
[2022-10-12 07:26:12,159] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,155 [INFO    ]              root
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ]              |-- col1: string (nullable = true)
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ]              |-- col2: string (nullable = true)
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ]              |-- col2: string (nullable = true)
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ]              |-- business_dt: date (nullable = true)
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ] |Hive| Checking connection availability...
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ] |Spark| Using connection parameters:
[2022-10-12 07:26:12,161] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,156 [INFO    ]          type = Hive
[2022-10-12 07:26:12,179] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,173 [INFO    ] |Hive| Connection is available.
[2022-10-12 07:26:12,179] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,174 [INFO    ] |Hive| Fetching schema of table 'myschema.newtable'
[2022-10-12 07:26:12,330] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,324 [INFO    ] |Hive| Table 'myschema.newtable' already exists
[2022-10-12 07:26:12,330] {ssh_hook.py:472} INFO - 2022-10-12 10:26:12,325 [INFO    ] |Hive| Saving data to a table 'myschema.newtable'
[2022-10-12 07:33:25,863] {ssh_hook.py:472} INFO - 2022-10-12 10:33:25,856 [INFO    ] |Hive| Table 'myschema.newtable' successfully created
[2022-10-12 07:33:25,863] {ssh_hook.py:472} INFO - 2022-10-12 10:33:25,857 [INFO    ] -------------------------------------- DBWriter ends --------------------------------------

^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

boring-cyborg · 2022-11-01T15:27:11Z

Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution Guide (https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst)
Here are some useful points:

Pay attention to the quality of your code (flake8, mypy and type annotations). Our pre-commits will help you with that.
In case of a new feature add useful documentation (in docstrings or in docs/ directory). Adding a new operator? Check this short guide Consider adding an example DAG that shows how users should use it.
Consider using Breeze environment for testing locally, it's a heavy docker but it ships with a working Airflow and a lot of integrations.
Be patient and persistent. It might take some time to get a review or get the final approval from Committers.
Please follow ASF Code of Conduct for all communication including (but not limited to) comments on Pull Requests, Mailing list and Slack.
Be sure to read the Airflow Coding style.
Apache Airflow is a community-driven project and together we are making it better 🚀.
In case of doubts contact the developers at:
Mailing List: [email protected]
Slack: https://s.apache.org/airflow-slack

airflow/providers/ssh/hooks/ssh.py

Co-authored-by: Niko <[email protected]>

airflow/providers/ssh/hooks/ssh.py

potiuk · 2022-11-07T23:24:45Z

Static checks detected an error.

dolfinus · 2022-11-08T08:06:08Z

Fixed the linter error

boring-cyborg · 2022-11-08T08:12:39Z

Awesome work, congrats on your first merged pull request!

boring-cyborg bot added the area:providers label Nov 1, 2022

o-nikolas reviewed Nov 2, 2022

View reviewed changes

airflow/providers/ssh/hooks/ssh.py Outdated Show resolved Hide resolved

airflow/providers/ssh/hooks/ssh.py Outdated Show resolved Hide resolved

dolfinus and others added 3 commits November 2, 2022 10:59

Apply log formatter to every line of stdout/stderr in SSHOperator

7305d48

Update airflow/providers/ssh/hooks/ssh.py

be6d57d

Co-authored-by: Niko <[email protected]>

Update airflow/providers/ssh/hooks/ssh.py

9c95732

Co-authored-by: Niko <[email protected]>

uranusjr reviewed Nov 2, 2022

View reviewed changes

airflow/providers/ssh/hooks/ssh.py Show resolved Hide resolved

potiuk approved these changes Nov 7, 2022

View reviewed changes

o-nikolas approved these changes Nov 7, 2022

View reviewed changes

Update ssh.py

5f3cc63

uranusjr approved these changes Nov 8, 2022

View reviewed changes

uranusjr changed the title ~~Apply log formatter to every line of stdout/stderr in SSHOperator~~ Apply log formatter on every ouput line in SSHOperator Nov 8, 2022

uranusjr merged commit 8f152a1 into apache:main Nov 8, 2022

potiuk mentioned this pull request Nov 15, 2022

Status of testing Providers that were prepared on November 15, 2022 #27674

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

Apply log formatter on every ouput line in SSHOperator#27442

Apply log formatter on every ouput line in SSHOperator#27442
uranusjr merged 4 commits intoapache:mainfrom
dolfinus:main

dolfinus commented Nov 1, 2022

Uh oh!

boring-cyborg bot commented Nov 1, 2022

Uh oh!

Uh oh!

Uh oh!

Uh oh!

potiuk commented Nov 7, 2022

Uh oh!

dolfinus commented Nov 8, 2022

Uh oh!

boring-cyborg bot commented Nov 8, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Comments

Conversation

dolfinus commented Nov 1, 2022

Uh oh!

boring-cyborg bot commented Nov 1, 2022

Uh oh!

Uh oh!

Uh oh!

Uh oh!

potiuk commented Nov 7, 2022

Uh oh!

dolfinus commented Nov 8, 2022

Uh oh!

boring-cyborg bot commented Nov 8, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants