为满足数字矿山系统应用中对海量数据高效存取的技术要求,提出一种块段模型海量数据存储新方法。该存储技术满足数据库的特点:ACID 兼容、并发支持、数据共享及高效访问;采用线性八叉树的方法组织块段模型,并存将其储于LMDB(快速内存映射数据库)中;通过定位码比较算法及从几何空间地址码到存储空间定位码的转换算法,可高效地对三维空间任意点的地质属性进行查询;采用三维到二维的转换及内外点二维网格扫描筛选法,使地质属性查询的三维问题转化为二维问题,其性能和鲁棒性得到显著提高。实验结果表明,这种方法能够高效存取块段模型海量数据,并满足数据库的特点;相比于采用etree方法,采用LMDB方法至少快3倍,特别是在读取数据时效率更高,且数据量越大,效果越明显。
Data organization requires high efficiency for large amount of data applied in the digital mine system. A new method of storing massive data of block model is proposed to meet the characteristics of the database, including ACID-compliant, concurrency support, data sharing, and efficient access. Each block model is organized by linear octree, stored in LMDB (lightning memory-mapped database). Geological attribute can be queried at any point of 3D space by comparison algorithm of location code and conversion algorithm from address code of geometry space to location code of storage. The performance and robustness of querying geological attribute at 3D spatial region are enhanced greatly by the transformation from 3D to 2D and the method of 2D grid scanning to screen the inner and outer points. Experimental results showed that this method can access the massive data of block model, meeting the database characteristics. The method with LMDB is at least 3 times faster than that with etree, especially when it is used to read. In addition, the larger the amount of data is processed, the more efficient the method would be.
参考文献
[1] | 吴江斌;朱合华.基于Delaunay构网的地层3D TEN模型及建模[J].岩石力学与工程学报,2005(24):4581-4587. |
[2] | 毕林;王李管;陈建宏;冯兴隆.基于八叉树的复杂地质体块段模型建模技术[J].中国矿业大学学报,2008(4):532-537. |
[3] | Chernyshenko, Alexey Y.;Olshanskii, Maxim A..An adaptive octree finite element method for PDEs posed on surfaces[J].Computer Methods in Applied Mechanics and Engineering,2015Jul.1(Jul.1):146-172. |
[4] | T. Tu;D. R. O'Hallaron;J. C. Lopez.Etree: a database-oriented method for generating large octree meshes[J].Engineering with computers,20042(2):117-128. |
[5] | GU Xiao-wei;WANG Qing;GE Shu.Dynamic phase-mining optimization in open-pit metal mines[J].中国有色金属学报(英文版),2010(10):1974-1980. |
[6] | 荆永滨;王李管;毕林;陈建宏.复杂矿体的块段模型建模算法[J].华中科技大学学报(自然科学版),2010(2):97-100. |
- 下载量()
- 访问量()
- 您的评分:
-
10%
-
20%
-
30%
-
40%
-
50%