【问题标题】:merging 2 hdf5 files with pytables将 2 个 hdf5 文件与 pytables 合并
【发布时间】:2011-05-20 18:22:39
【问题描述】:

ptrepack 几乎是我想要的,只是它只有覆盖或忽略重复路径的选项。下面的例子说明了我想用结构发生什么

输入文件一

/ (RootGroup) ''
/data_set_name (Group) 'group of images files'
/data_set_name_Set (EArray(7913, 128)) ''
/data_set_name/image_set_index (Table(3,)) ''
  /data_set_name/i100 (Group) 'sift features and coordinates'
  /data_set_name/i100/descriptors (Array(7913, 128)) 'sift descriptors'
  /data_set_name/i100/locations (Array(7913, 4)) 'sift feature locations'

输入文件二

/ (RootGroup) ''
/data_set_name (Group) 'group of images files'
/data_set_name_Set (EArray(4328, 128)) ''
/data_set_name/image_set_index (Table(4,)) ''
  /data_set_name/i1156 (Group) 'sift features and coordinates'
  /data_set_name/i1156/descriptors (Array(4328, 128)) 'sift descriptors'
  /data_set_name/i1156/locations (Array(4328, 4)) 'sift feature locations'

想要的输出

/ (RootGroup) ''
/data_set_name (Group) 'group of images files'
/data_set_name_Set (EArray(12241, 128)) ''
/data_set_name/image_set_index (Table(7,)) ''
  /data_set_name/i100 (Group) 'sift features and coordinates'
  /data_set_name/i100/descriptors (Array(7913, 128)) 'sift descriptors'
  /data_set_name/i100/locations (Array(7913, 4)) 'sift feature locations'

  /data_set_name/i1156 (Group) 'sift features and coordinates'
  /data_set_name/i1156/descriptors (Array(4328, 128)) 'sift descriptors'
  /data_set_name/i1156/locations (Array(4328, 4)) 'sift feature locations'

有什么有效的方法来做到这一点?

【问题讨论】:

    标签: python hdf5 pytables merging-data


    【解决方案1】:

    您的意思是自动扩大具有相同路径的数据集?嗯,我没有考虑过这个,但看起来是一个很好的实现功能(虽然只对可放大的数组有效)。加了一张票:

    http://pytables.org/trac/ticket/325

    【讨论】:

    • 这也可能是你感兴趣的 "ptrepack -v --overwrite-nodes node1.h5:/node2.h5:/" 似乎复制了所有数据(基于文件的大小) 但在显示文件内容时只有一个文件组可见。但是执行“ptrepack -v --overwrite-nodes node1.h5:/groups node2.h5:/groups”复制后一切都是可见的
    猜你喜欢
    • 2011-12-21
    • 2015-10-10
    • 2016-11-12
    • 2013-10-07
    • 2016-01-02
    • 2011-06-05
    • 1970-01-01
    • 1970-01-01
    • 2012-12-11
    相关资源
    最近更新 更多