Work items:

• Prevent orphans by purging associated records before the parent table #23384
• Humanizing the table name makes debugging harder #23387
• Add purge_by_date_and_orphaned #23385
• Verify destroy / delete mechanism for each purging mixin types, part 1:
  • containers: Opt into purging by destroy for container entities, use delete elsewhere #23389
    • Fixes: Change Container related tables purging to use archiving and destroy_all on archived records as they age out #23307

    app/models/container/purging.rb:    include PurgingMixin
    app/models/container_group/purging.rb:    include PurgingMixin
    app/models/container_image/purging.rb:    include PurgingMixin
    app/models/container_node/purging.rb:    include PurgingMixin
    app/models/container_project/purging.rb:    include PurgingMixin
    app/models/container_quota/purging.rb:    include PurgingMixin
    app/models/container_quota_item/purging.rb:    include PurgingMixin
    

  • Fix issue where base_model? is incorrect when base_model is overridden #23395
• Add request + request log purging: Purge miq requests every 6 months #21577
• Data migration to purge orphaned records (containers + requests)
• Test openshift quotas and consider dropping container quota and container quota item archiving completely, see: Add deleted_on (with index) to container_quotas, container_quota_items manageiq-schema#110 https://bugzilla.redhat.com/show_bug.cgi?id=1504560.
• Verify destroy / delete mechanism for each purging mixin types, part 2:
  • Non-containers

    app/models/audit_event/purging.rb:    include PurgingMixin
    app/models/binary_blob/purging.rb:    include PurgingMixin
    app/models/compliance/purging.rb:    include PurgingMixin
    app/models/drift_state/purging.rb:  include PurgingMixin
    app/models/event_stream/purging.rb:    include PurgingMixin
    app/models/miq_report_result/purging.rb:  include PurgingMixin
    app/models/miq_task/purging.rb:    include PurgingMixin
    app/models/mixins/purging_mixin.rb:module PurgingMixin
    app/models/notification/purging.rb:    include PurgingMixin
    app/models/policy_event/purging.rb:    include PurgingMixin
    app/models/vim_performance_state/purging.rb:    include PurgingMixin
    

• Data migration to purge orphaned records (non-containers)
• keep_reports has support for two types of values for the same setting: 1) A number of report results per report OR 2) a duration (how many months to keep results for each report). Some reports you may run a lot and some not as often. A number # of report results would help on the former scenario but duration (number of months to keep reports) would work on the latter scenario. Maybe we should split this into two settings?
• Review/change the existing keep_* settings that are possibly wrong
  • keep_hourly_performances and keep_daily_performances being both 6 months seems incorrect. We'll have 4320 hourlies vs 180 dailies per object that's live over the those 6 months. Hourlies for trends reports only seem to go back days. Will need to see how far back chargeback reports using hourlies go back.
• Handle container* purging differently. Their lifecycle is different. We have some tables such as event_streams, vim_performance_states, metrics_* and metric_rollups_* that are purged independently. Only vim_performance_states orphaned rows along with by date. event_streams and metrics* tables only purge by date so a container/container_group/etc. could be have been deleted but we won't purge their events or metrics* for months. Maybe they should be treated like vim_performance_states or maybe we should come up with a new way to handle them.