Skip to content

feat(funnels): Highlight significant deviations in new funnel viz#9536

Merged
Twixes merged 5 commits intomasterfrom
lemon-funnel-viz-5
Apr 27, 2022
Merged

feat(funnels): Highlight significant deviations in new funnel viz#9536
Twixes merged 5 commits intomasterfrom
lemon-funnel-viz-5

Conversation

@Twixes
Copy link
Copy Markdown
Member

@Twixes Twixes commented Apr 26, 2022

Problem

#9412 added a new funnel viz (behind feature flag lemon-funnel-viz), but it didn't have support for highlighting significantly different breakdowns.

Changes

This should make use of the existing significance logic. Let me know if I got this right @neilkakkar.

Screen Shot 2022-04-26 at 16 20 39

@Twixes Twixes requested a review from neilkakkar April 26, 2022 14:24
title: 'Total conversion',
render: (_: void, breakdown: FlattenedFunnelStepByBreakdown) =>
formatDisplayPercentage(breakdown?.conversionRates?.total ?? 0, true),
render: function RenderTotalConversion(
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

curious about when and where does 'Total conversion' show up? Not sure I ever see this. Otherwise LGTM!

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suspect you might have not created and switched on the lemon-funnel-viz flag?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

D'oh, ofcourse. Gahh, let me go again :P

@neilkakkar
Copy link
Copy Markdown
Contributor

unrelated feedback: there's something funky going on when scrolling into this table:

2022-04-26 15 41 17

@Twixes
Copy link
Copy Markdown
Member Author

Twixes commented Apr 26, 2022

Well, I don't care @neilkakkar ;) About this table at least, because that's the old one, and it's going out the window once lemon-funnel-viz is released.

@neilkakkar
Copy link
Copy Markdown
Contributor

I see it now, this is beauty :D - and covers the whole line lol, much nicer UI!

@Twixes
Copy link
Copy Markdown
Member Author

Twixes commented Apr 26, 2022

I realized I had kind of confused FunnelStepWithConversionMetrics['significant']['total'] here and it was used wrong in Total conversion. This also led me to update the table columns to more clearly reflect what they actually convey, including significance. For instance the real difference between the "Rate" next to "Completed" and the one next to "Droppped" was that the former was the total so far conversion, while the latter was relative to the previous step. This should now be clearer in general. CC @clarkus

Before

before

After

after

(the screenshots are with DEVIATION_SIGNIFICANCE_MULTIPLIER = 1.2)

@Twixes Twixes requested a review from neilkakkar April 26, 2022 15:42
@neilkakkar
Copy link
Copy Markdown
Contributor

Hmm, I am not sure if that's what those conversion rates meant.

I think they were conversion rates for success, and dropoffs (which is why they sum up to 100%, otherwise it doesn't make sense how that's possible?)

But, your change makes more sense, as these numbers are more valuable/harder to compute mentally.

We probably don't need to highlight both rates in a single row though, since thats too many highlights? I had this condition earlier where if one is highlighted we shouldn't highlight the other conversion rate in the same overarching column

@Twixes
Copy link
Copy Markdown
Member Author

Twixes commented Apr 26, 2022

They don't actually add up to 100% in the old table, which I didn't realize before building this new table, so it probably wasn't the most intuitive experience:

Screen Shot 2022-04-26 at 18 40 34

Fair point with highlighting both rates! Used the same logic as before so that only one rate can end up highlighted.

@Twixes Twixes changed the title fix(funnels): Highlight significant deviations in new funnel viz feat(funnels): Highlight significant deviations in new funnel viz Apr 26, 2022
@neilkakkar
Copy link
Copy Markdown
Contributor

I see, makes sense then!

@Twixes Twixes merged commit 75037f2 into master Apr 27, 2022
@Twixes Twixes deleted the lemon-funnel-viz-5 branch April 27, 2022 10:23
fuziontech added a commit that referenced this pull request Apr 28, 2022
* master: (137 commits)
  feat(cohorts): add cohort filter grammars (#9540)
  feat(cohorts): Backwards compatibility of groups and properties (#9462)
  perf(ingestion): unsubscribe from buffer topic while no events are produced to it (#9556)
  fix: Fix `Loading` positioning and `LemonButton` disabled state (#9554)
  test: Speed up backend tests (#9289)
  fix: LemonSpacer -> LemonDivider (#9549)
  feat(funnels): Highlight significant deviations in new funnel viz (#9536)
  docs(storybook): Lemon UI (#9426)
  feat: add support for list of teams to enable the conversion buffer for (#9542)
  chore(onboarding): cleanup framework grid experiment (#9527)
  fix(signup): domain provisioning on cloud (#9515)
  chore: split out async migrations ci (#9539)
  feat(ingestion): enable json ingestion for self-hosted by default (#9448)
  feat(cohort): add all cohort filter selectors to Storybook (#9492)
  feat(ingestion): conversion events buffer consumer (#9432)
  ci(run-backend-tests): remove CH version default (#9532)
  feat: Add person info to events (#9404)
  feat(ingestion): produce to buffer partitioned by team_id:distinct_id (#9518)
  fix: bring latest_migrations.manifest up to date (#9525)
  chore: removes unused feature flag (#9529)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants