Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11215

Vectorized grace hash-join throws FileUtil warnings

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 1.2.0, 1.3.0, 2.0.0
    • 1.3.0, 2.0.0
    • Vectorization
    • None
    •  HIVE-11215: Delete spills only if they exist (Gopal V, reviewed by Matt Mccline)

    Description

      TPC-DS query13 warnings about a null-file deletion.

      2015-07-09 03:14:18,880 INFO [TezChild] exec.MapJoinOperator: Hybrid Grace Hash Join: Number of rows restored from KeyValueContainer: 31184
      2015-07-09 03:14:18,881 INFO [TezChild] exec.MapJoinOperator: Hybrid Grace Hash Join: Deserializing spilled hash partition...
      2015-07-09 03:14:18,881 INFO [TezChild] exec.MapJoinOperator: Hybrid Grace Hash Join: Number of rows in hashmap: 31184
      2015-07-09 03:14:18,897 INFO [TezChild] exec.MapJoinOperator: spilled: true abort: false. Clearing spilled partitions.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      2015-07-09 03:14:18,898 WARN [TezChild] fs.FileUtil: null file argument.
      

      Attachments

        1. HIVE-11215.1.patch
          0.8 kB
          Gopal Vijayaraghavan

        Activity

          People

            gopalv Gopal Vijayaraghavan
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: