Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4150 Versioning and rolling upgrades for MR2
  3. MAPREDUCE-4421

Run MapReduce framework via the distributed cache

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0-alpha
    • 2.3.0
    • None
    • None
    • Reviewed

    Description

      Currently MR AM depends on MR jars being deployed on all nodes via implicit dependency on YARN_APPLICATION_CLASSPATH.

      We should stop adding mapreduce jars to YARN_APPLICATION_CLASSPATH and, probably, just rely on adding a shaded MR jar along with job.jar to the dist-cache.

      Attachments

        1. MAPREDUCE-4421-4.patch
          21 kB
          Jason Darrell Lowe
        2. MAPREDUCE-4421-3.patch
          21 kB
          Jason Darrell Lowe
        3. MAPREDUCE-4421-2.patch
          20 kB
          Jason Darrell Lowe
        4. MAPREDUCE-4421.patch
          12 kB
          Jason Darrell Lowe
        5. MAPREDUCE-4421.patch
          12 kB
          Jason Darrell Lowe

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-2464 Provide Hadoop as a local resource (on HDFS) which can be used by other projects

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5534 Improve job configuration handling when MapReduce deployed via HDFS

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6173 Document the configuration of deploying MR over distributed cache with enabling wired encryption at the same time

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. YARN-666 [Umbrella] Support rolling upgrades in YARN

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jlowe Jason Darrell Lowe
              acmurthy Arun Murthy
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: