Hadoop MapReduce v2²Î¿¼ÊÖ²á-µÚ2°æ-(Ó°Ó¡°æ)

preface chapter 1£ºgetting started with hadooo v2 introduction setting up hadoop v2 on your local machine writing a wordcount mapreduce application£¬bundling it and running it using the hadoop local mode adding a combiner step to the wordcount mapreduce program setting up hdfs setting up hadoop yarn in a distributed cluster environment using hadoop v2 setting up hadoop ecosystem in a distributed cluster environment using a hadoop distribution hdfs command¡ªline file operations running the wordcount program in a distributed cluster environment benchmarking hdfs using dfsio benchmarking hadoop mapreduce using terasort chapter 2£ºcloud deployments¡ªusing hadoop yarn on cloud environments introduction running hadoop mapreduce v2 computations using amazon elastic mapreduce saving money using amazon ec2 spot instances to execute emr job flows executing a pig script using emr executing a hive script using emr creating an amazon emr job flow using the aws command line interface deploying an apache hbase cluster on amazon ec2 using emr using emr bootstrap actions to configure vms for the amazon emr jobs using apache whirr to deploy an apache hadoop cluster in a cloud environment chapter 3£ºhadoop essentials¡ªc0nfigurations£¬unit tests£¬and other apis introduction optimizing hadoop yarn and mapreduce configurations for cluster deployments shared user hadoop clusters¡ª¡ªusing fair and capacity schedulers setting classpath precedence to user¡ªprovided jars speculative execution of straggling tasks unit testing hadoop mapreduce applications using mrunit integration testing hadoop mapreduce applications using miniyarncluster adding a new datanode decommissioning datanodes using multiple disks£¯volumes and limiting hdfs disk usage setting the hdfs block size setting the file replication factor using the hdfs java api chapter 4£ºdevelooin¡«comdlex hadooo maoreduce aoolications introduction choosing appropriate hadoop data types implementing a custom hadoop writable data type implementing a custom hadoop key type emitting data of different value types from a mapper choosing a suitable hadoop inputformat for your input data format adding support for new input data formats¡ª¡ªimplementing a custom inputformat formatting the results of mapreduce computations¡ª¡ªusing hadoop outputformats writing multiple outputs from a mapreduce computation hadoop intermediate data partitioning secondary sorting¡ª¡ªsorting reduce input values broadcasting and distributing shared resources to tasks in a mapreduce job¡ªhadoop distributedcache using hadoop with legacy applications¡ª¡ªhadoop streaming adding dependencies between mapreduce jobs hadoop counters to report custom metrics chapter5£ºanalvtics introduction simple analytics using mapreduce performing group by using mapreduce calculating frequency distributions and sorting using mapreduce plotting the hadoop mapreduce results using gnuplot calculating histograms using mapreduce calculating scatter plots using mapreduce parsing a complex dataset with hadoop joining two datasets using mapreduce chapter6£ºhadooo ecosystem¡ªapache hive introduction getting started with apache hive creating databases and tables using hive cli simple sql¡ªstyle data querying using apache hive creating and populating hive tables and views using hive query results utilizing different storage formats in hive.storing table data using orc files using hive built¡ªin functions hive batch mode¡ªusing a query file performing a join with hive creating partitioned hive tables writing hive user¡¤defined functions£¨udf£© hcatalog¡ª¡¤performing java mapreduce computations on data mapped to hive tables hcatalog¡ª¡ªwriting data to hive tables from java mapreduce computations chapter7£ºhadood ecosystem ii¡ªpig.hbase.mahout.and sannn introduction getting started with apache pig joining two datasets using pig accessing a hive table data in pig using hcatalog getting started with apache hbase data random access using java client apis running mapreduce jobs on hbase using hive to insert data into hbase tables getting started with apache mahout running k¡ªmeans with mahout importing data to hdfs from a relational database using apache sqoop exporting data from hdfs to a relational database using apache sqoop tahie orcontencs chapter8£ºsearching and indexine introduction generating an inverted index using hadoop mapreduce intradomain web crawling using apache nutch indexing and searching web documents using apache solr configuring apache hbase as the backend data store for apache nutch whole web crawling with apache nutch using a hadoop£¯hbase cluster elasticsearch for indexing and searching generating the in¡ªlinks graph for crawled web pages chapter 9£ºciassmcations¡£recommendations£¬and findineg relationships introduction performing content¡ªbased recommendations classification using the naive bayes classifier assigning advertisements to keywords using the adwords balance algorithm chapter 10£ºmass text data processing introduction data preprocessing using hadoop streaming and python de¡ªduplicating data using hadoop streaming loading large datasets to an apache hbase data store¡ªimporttsv and bulkload creating tf and tf¡ªidf vectors for the text data clustering text data using apache mahout topic discovery using latent dirichlet allocation£¨lda£© document classification using mahout naive bayes classifier index