Research on Massive Data Mining Technology Based on Map Reduce

Facing the massive data of higher education institutions, data mining technology is an intelligent information processing technology that can effectively discover knowledge from the massive data and can discover important information that people have previously ignored from the huge data information. This article is dedicated to the development of applied mathematics education resource mining technology based on edge computing and data stream classification. First of all, this article establishes a resource system architecture suitable for existing applied mathematics education through edge computing technology, which can effectively improve the efficiency of data mining. Secondly, the data stream classification algorithm is used for information extraction and classification integration of massive applied mathematical education data. This method provides potential and valuable information for decision-makers and education practitioners. Finally, the simulation and performance test of the system verify that it has the functions of mathematical information mining and data processing. This system will provide strong support for applied mathematics education reform.

Abstract Analysis of manufacturing data as a tool for failure analysts often meets with roadblocks due to the complex non-linear behaviors of the relationships between failure rates and explanatory variables drawn from process history. The current work describes how the use of a comprehensive engineering database and data mining technology over-comes some of these difficulties and enables new classes of problems to be solved. The characteristics of the database design necessary for adequate data coverage and unit traceability are discussed. Data mining technology is explained and contrasted with traditional statistical approaches as well as those of expert systems, neural nets, and signature analysis. Data mining is applied to a number of common problem scenarios. Finally, future trends in data mining technology relevant to failure analysis are discussed.

At present, the college English testing system has become an indispensable system in many universities. However, the English test system is not highly humanized due to problems such as unreasonable framework structure. This paper combines data mining technology to build a college English test framework. The college English test system software based on data mining mainly realizes the computer program to automatically generate test papers, set the test time to automatically judge the test takers’ test results, and give out results on the spot. The test takers log in to complete the test through the test system software. The examination system software solves the functions of printing test papers, arranging invigilation classrooms, invigilating teachers, invigilating process, collecting test papers, scoring and analyzing test papers in traditional examinations. Finally, this paper analyzes the performance of this paper through experimental research. The research results show that the system constructed in this paper has certain practical effects.