Spring for Apache Hadoop 2.0 RC2 发布

jopen 10年前

Apache Hadoop 版本2.0已经达到了,发布候选阶段。最新的版本是2.0.0.RC2。正在接近GA版本,所以这是一个很好的时间来一试这个新的2.0版本。


spring-yarn 框架能够让你很方便得开发基于Spring的应用程序,然后使用YARN部署运行在Hadoop v2之上。


Spring for Apache Hadoop 2.0主要是添加YARN应用开发支持,此外还持续改进HDFS和MapReduce 的支持。你可以看到许多新的YARN特性在 YARN samples 中,并且在这周会发布新的Spring IO Guides

The YARN support introduced in Spring for Apache Hadoop 2.0:

  • The support for YARN features is provided in the new spring-yarn sub-project. The spring-yarn framework makes it easier for you to develop Spring based applications that can be deployed to run on Hadoop v2 using YARN.
  • We have also integrated the YARN support with Spring Boot so that you can deploy Spring Boot applications on YARN.
  • Spring Boot promotes an annotation based programming model and we have added annotation based configuration for Hadoop YARN features.

The default distribution for the Spring for Apache Hadoop 2.0 releases is the current Apache Hadoop 2 stable release which is 2.2.0.

We continue to provide version specific artifacts with their respective transitive dependencies in the Spring IO milestone repository:

  • 2.0.0.RC2 (default - Apache Hadoop stable 2.2.0)
  • 2.0.0.RC2-hadoop12 (Apache Hadoop stable 1.2.1)
  • 2.0.0.RC2-phd1 (Pivotal HD 1.1)
  • 2.0.0.RC2-cdh4 (Cloudera CDH4 MR1)
  • 2.0.0.RC2-cdh5 (Cloudera CDH5 YARN beta)
  • 2.0.0.RC2-hdp13 (Hortonworks HDP 1.3)
  • 2.0.0.RC2-hdp20 (Hortonworks HDP 2.0)

By the next release candidate (due in a couple of weeks) we expect to add the following distributions:

  • Apache Hadoop 2.4.0
  • Pivotal HD 2.0
  • Cloudera CDH5 GA
  • Hortonworks HDP 2.1

For more project specific information please see the project page.