Huashu Jinming big data analysis system can store industrial site intelligent terminals (e.g. SCADA/DCS, intelligent device, PLC, AGV, industrial robot, intelligent instrument, etc.) real time data and MES, ERP, PLM, WMS, IQA/OQC, QMS, factory energy, simulation, CRM, SRM and other system operating data to local data center or cloud via Kafka, Spark streaming, Sqoop, Oozie. It helps enterprises to quickly build big data analysis processing platform and to realize efficient and safe storage of data.
MapReduce, Pig, Hive, Spark and other big data processing engines can clean collected mass discrete data and get valuable data.Pyspark-MLlib, MATLAB, SPARKR and other analysis and mining tools can do data statistics and data mining by building data mining algorithms models of design, technology, equipment, environment, material, detection, staff quality, management and other dimensions. Knowledge rules in mined data can be stored to expert knowledge base. Built expert system can be used for multidimensional production guidance, online product yield selection, process parameters real-time adjustment and optimization, equipment maintenance and timely diagnosis.