Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1276

Add a Simple History Server for the UI for Yarn / Mesos

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 1.0.0
    • Web UI
    • None

    Description

      For the 1.0 release we should have a basic history server for non-standalone modes (e.g. Yarn, Mesos). It can just be initialized with a storage directory and watch for new applications. Ideally this should be able to respect UI security filters as well.

      This might require us to add some sort of "COMPLETED" file or some synchronization to know when the UI has finished running so we don't try to load the file a bunch of times.

      Attachments

        Issue Links

          Activity

            People

              andrewor14 Andrew Or
              pwendell Patrick Wendell
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: