Issue |
JNWPU
Volume 36, Number 6, December 2018
|
|
---|---|---|
Page(s) | 1139 - 1144 | |
DOI | https://doi.org/10.1051/jnwpu/20183661139 | |
Published online | 12 March 2019 |
Better Big Data Store for Real-Time Processing of Modern MRO System Via Transaction Key Groups
现代MRO系统的可扩展数据管理策略研究
Received:
7
December
2017
Aim. MRO2 system is a data management platform. It has the ability to manage and store all kinds of data in the product's lifecycle, that is both the mass storage capacity and the scalability are required. For the existing big-data stores for MRO2 systemeither only focus on the storage problem, or only do the scalability issue. In this paper, a two-layer data management model is proposed, in which the top layer uses the memory storage for scalability and the bottom layer uses the distributed key-value storage for mass storage. By adding a middle layer of the key group between the application and the KV storage system, the keys for real-time processing are combined to cache in a node. It satisfies the characteristics of the real-time application and improves the dynamic scalability. The present protocol of the dynamic key groups for real-time distributed computation for MRO2 system is explained in detail. And then the protocol for creating and deleting key groups is introduced. The third topic is an implement of a big-data store for supporting MRO2 system. In this topic, the delay times for creating and deleting the dynamic transaction groups to estimation are used. Finally, the experiments to appraise the present method are done. The response time of the present method is quite efficient in comparison with the other methods to be used inbig data storage systems.
摘要
现代MRO系统是对产品全生命周期中各种不同类型数据进行统一管理和存储的数据管理平台,既要具有海量存储的能力,亦需要具有可扩展性。而现存的MRO系统,要么只关注存储问题,要么只解决可扩展性问题。提出了一种二层数据管理模型,上层利用内存存储解决可扩展性,下层使用分布式键值存储(KV存储)达到海量存储的目的。通过在应用程序和KV存储系统之间添加键分组的中间层,使得实时处理所需要的键被组合起来缓存在一个节点上,既满足了实时应用的特性,又提高了动态可扩展性。首先给出了实时处理键组的数据模型,其次介绍实时处理键组的创建和删除协议,最后提出了支持实时处理键组的海量数据存储系统结构并对系统进行了评价,取得良好的效果。
Key words: modern MRO system / transaction key group / big data store / distributed computation
关键字 : 现代MRO系统 / 实时处理键组 / 海量数据存储 / 分布式计算
© 2018 Journal of Northwestern Polytechnical University. All rights reserved.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.