grpc: `response-action()` by alltilla · Pull Request #561 · axoflow/axosyslog

alltilla · 2025-03-27T18:11:15Z

With this option, it is possible to fine tune how AxoSyslog behaves in case of different gRPC results.

Supported by the following destination drivers:

opentelemetry()
loki()
bigquery()
clickhouse()
google-pubsub-grpc()

Supported gRPC results:

ok
unavailable
cancelled
deadline-exceeded
aborted
out-of-range
data-loss
unknown
invalid-argument
not-found
already-exists
permission-denied
unauthenticated
failed-precondition
unimplemented
internal
resource-exhausted

Supported actions:

disconnect
drop
retry
success

Usage:

google-pubsub-grpc(
  project("my-project")
  topic("my-topic")
  response-action(
    not-found => disconnect
    unavailable => drop
  )
);

Signed-off-by: Attila Szakacs <[email protected]>

github-actions · 2025-03-27T18:16:23Z

This Pull Request introduces config grammar changes

axoflow/834b23e6a3b0d3e7ba94b122063787f57ad3944d -> alltilla/grpc-response-handling-override

Details

--- a/destination
+++ b/destination

 axosyslog-otlp(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

 bigquery(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

 clickhouse(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

 google-pubsub-grpc(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

 loki(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

 opentelemetry(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

 syslog-ng-otlp(
+    response-action(
+        <empty>
+        aborted => disconnect
+        aborted => drop
+        aborted => retry
+        aborted => success
+        already-exists => disconnect
+        already-exists => drop
+        already-exists => retry
+        already-exists => success
+        cancelled => disconnect
+        cancelled => drop
+        cancelled => retry
+        cancelled => success
+        data-loss => disconnect
+        data-loss => drop
+        data-loss => retry
+        data-loss => success
+        deadline-exceeded => disconnect
+        deadline-exceeded => drop
+        deadline-exceeded => retry
+        deadline-exceeded => success
+        failed-precondition => disconnect
+        failed-precondition => drop
+        failed-precondition => retry
+        failed-precondition => success
+        internal => disconnect
+        internal => drop
+        internal => retry
+        internal => success
+        invalid-argument => disconnect
+        invalid-argument => drop
+        invalid-argument => retry
+        invalid-argument => success
+        not-found => disconnect
+        not-found => drop
+        not-found => retry
+        not-found => success
+        ok => disconnect
+        ok => drop
+        ok => retry
+        ok => success
+        out-of-range => disconnect
+        out-of-range => drop
+        out-of-range => retry
+        out-of-range => success
+        permission-denied => disconnect
+        permission-denied => drop
+        permission-denied => retry
+        permission-denied => success
+        resource-exhausted => disconnect
+        resource-exhausted => drop
+        resource-exhausted => retry
+        resource-exhausted => success
+        unauthenticated => disconnect
+        unauthenticated => drop
+        unauthenticated => retry
+        unauthenticated => success
+        unavailable => disconnect
+        unavailable => drop
+        unavailable => retry
+        unavailable => success
+        unimplemented => disconnect
+        unimplemented => drop
+        unimplemented => retry
+        unimplemented => success
+        unknown => disconnect
+        unknown => drop
+        unknown => retry
+        unknown => success
+    )
 )

alltilla added 3 commits March 27, 2025 19:01

grpc/common/grpc-dest: add response-action()

2c759d6

Signed-off-by: Attila Szakacs <[email protected]>

grpc: use custom response handlers in dest drivers

9771f85

Signed-off-by: Attila Szakacs <[email protected]>

news: add entry for axoflow#561

03c323f

Signed-off-by: Attila Szakacs <[email protected]>

alltilla requested a review from MrAnno March 27, 2025 18:11

MrAnno approved these changes Mar 27, 2025

View reviewed changes

MrAnno merged commit e0a30f8 into axoflow:main Mar 27, 2025
22 checks passed

HofiOne mentioned this pull request Apr 17, 2025

grpc: response-action() syslog-ng/syslog-ng#5332

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

grpc: `response-action()`#561

grpc: `response-action()`#561
MrAnno merged 3 commits intoaxoflow:mainfrom
alltilla:grpc-response-handling-override

alltilla commented Mar 27, 2025

Uh oh!

github-actions bot commented Mar 27, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

alltilla commented Mar 27, 2025

Uh oh!

github-actions bot commented Mar 27, 2025

This Pull Request introduces config grammar changes

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants