Skip to content

Comments

Revert PR #980 temporarily, while we do further work on it#1103

Merged
jonathangreen merged 2 commits intomainfrom
feature/revert-auth-error
May 16, 2023
Merged

Revert PR #980 temporarily, while we do further work on it#1103
jonathangreen merged 2 commits intomainfrom
feature/revert-auth-error

Conversation

@jonathangreen
Copy link
Member

Description

We're seeing an elevated number of 5XX errors in production due to the auth disable that was added in #980.

Screenshot 2023-05-15 at 11 03 10 AM

Motivation and Context

Going to disable this temporarily while we work out how we want to move this forward.

I did a git revert the PR and then modified it to keep the migration and new models in the code base, since they have already been rolled out to production. This just reverts the code that actually records and processes the auth failures.

How Has This Been Tested?

  • Running unit tests locally.

Checklist

  • I have updated the documentation accordingly.
  • All new and existing tests passed.

We are seeing elevated errors due to the auth filtering happening in
migration intact.

We will do further work and reenable in a future PR.
@jonathangreen jonathangreen requested review from RishiDiwanTT and tdilauro and removed request for RishiDiwanTT May 15, 2023 19:06
@codecov
Copy link

codecov bot commented May 15, 2023

Codecov Report

Patch coverage: 100.00% and project coverage change: -0.01 ⚠️

Comparison is base (c9df0ef) 89.73% compared to head (f3f8c1c) 89.72%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1103      +/-   ##
==========================================
- Coverage   89.73%   89.72%   -0.01%     
==========================================
  Files         177      176       -1     
  Lines       28794    28753      -41     
  Branches     6623     6618       -5     
==========================================
- Hits        25838    25800      -38     
+ Misses       1936     1934       -2     
+ Partials     1020     1019       -1     
Impacted Files Coverage Δ
api/authenticator.py 93.15% <100.00%> (+0.25%) ⬆️
api/sip/client.py 96.35% <100.00%> (-0.01%) ⬇️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

Copy link
Contributor

@tdilauro tdilauro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me.

@jonathangreen
Copy link
Member Author

@RishiDiwanTT I'll wait for you to take a look at this, then get it rolled out tomorrow if it looks okay to you.

@RishiDiwanTT
Copy link
Contributor

While this looks fine as a code commit, do we want to keep recording the errors in the DB as a form of downtime analysis of the third party APIs, while keeping the threshold number high (like 100k errors) so it never truly goes down?
This way we can run some statistical analysis on the recorded numbers to know what the right numbers are.

@jonathangreen
Copy link
Member Author

I think we can pull the data we need for analysis from our existing logs, so I'm going to merge this one and make a new ticket to do some analysis and revisit.

@jonathangreen jonathangreen merged commit 88f5554 into main May 16, 2023
@jonathangreen jonathangreen deleted the feature/revert-auth-error branch May 16, 2023 14:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants