Online Integrated Development Environment for MapReduce Programming

다국어 초록 (Multilingual Abstract)

Though MapReduce programming model simplifies the development of parallel program, ordinary users have difficulties in setting up the development environment for MapReduce. The online integrated development environment for MapReduce programming can solve this problem, thus users need not build the environment themselves, only need to focus on the logical design of the parallel program. During the software construction, the problem of independent space setting and naming conflict of the file in the multi-user environment, and the problem of online compiling, execution and instant feedback message to client are solved. The software has been deployed and tested in Hadoop cluster, and can meet users’ basic requirements for the development of MapReduce.

목차 (Table of Contents)

• Abstract
• 1. Introduction
• 2. Related Work
• 3. Software Architecture
• 4. File System Architecture
• 4.1 Directory Hierarchy
• 4.2. Configuration of HDFS Directory
• 5. Runtime of MapReduce
• 5.1. ConsoleTask Class
• 5.2. Compiling Procedure
• 5.3. Running Procedure
• 6. Experiment and Evaluation
• 7. Conclusion
• Acknowledgements
• References