如何按行对数据框中的元素进行分组

【问题标题】：How to group elements in dataframe by row如何按行对数据框中的元素进行分组
【发布时间】：2021-12-28 21:33:43
【问题描述】：

我有this code，它本质上将图像的像素转换为我的世界中的一个块，它为您提供了一个“地图”，说明该块的放置位置以便在游戏中形成图像：代码生成一个 csv 文件其中电子表格中的每个单元格对应一个块。

我想改进这一点，不仅输出 csv 文件，还输出一个 txt 文件，其中包含将在游戏中生成图像的 minecraft 命令。

此外，这些命令必须与玩家的 (x, y, z) 具有相对位置，这应该通过元组或其他东西在代码中通知。

所以，假设玩家在游戏中处于 0、0、0 时，我的 csv 看起来像

这是用于测试的 dict 形式的相同数据帧

{0: {0: 'minecraft:diorite', 1: 'minecraft:diorite', 2: 'minecraft:stone'},
 1: {0: 'minecraft:stone', 1: 'minecraft:stone', 2: 'minecraft:cobblestone'},
 2: {0: 'minecraft:block_of_raw_iron',
  1: 'minecraft:diamond_block',
  2: 'minecraft:gold_block'}}

我希望我的 txt 输出是

/fill 0 0 0 0 0 1 minecraft:diorite
/fill 0 0 2 0 0 2 minecraft:stone

/fill 1 0 0 1 0 1 minecraft:stone
/fill 1 0 2 1 0 2 minecraft:cobblestone

/fill 2 0 0 2 0 0 minecraft:block_of_raw_iron
/fill 2 0 1 2 0 1 minecraft:diamond_block
/fill 2 0 2 2 0 2 minecraft:gold_block

致不懂 minecraft 命令语法的人：

/fill {x_start} {y_start} {z_start} {x_end} {y_end} {z_end} {block}

带有 [start, end]（都包括在内），x 横向移动，z 向上或向下。

我几乎尝试了所有方法，但我几乎放弃了这段代码，所以我删除了我的进度，抱歉:(

有人可以帮忙吗？提前致谢。

编辑 1.：为了更好的测试，这里是火影忍者的像素艺术（前 5 行）

{0: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 1: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 2: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 3: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 4: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 5: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 6: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 7: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 8: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 9: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 10: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 11: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 12: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 13: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 14: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:block_of_raw_iron'}, 15: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:sand'}, 16: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:snow_block', 4: 'minecraft:snow_block'}, 17: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:snow_block', 4: 'minecraft:snow_block'}, 18: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:snow_block', 4: 'minecraft:snow_block'}, 19: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:sand', 4: 'minecraft:sand'}, 20: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:sand', 3: 'minecraft:block_of_gold', 4: 'minecraft:sponge'}, 21: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:snow_block', 3: 'minecraft:diorite_slab', 4: 'minecraft:sand'}, 22: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:snow_block', 3: 'minecraft:snow_block', 4: 'minecraft:snow_block'}, 23: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:snow_block', 3: 'minecraft:snow_block', 4: 'minecraft:diorite_slab'}, 24: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:snow_block', 3: 'minecraft:sand', 4: 'minecraft:block_of_gold'}, 25: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:sand', 3: 'minecraft:sponge', 4: 'minecraft:sponge'}, 26: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:sand', 4: 'minecraft:white_terracotta'}, 27: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:snow_block', 4: 'minecraft:snow_block'}, 28: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:snow_block', 4: 'minecraft:diorite_slab'}, 29: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:snow_block', 4: 'minecraft:sand'}, 30: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:sand', 4: 'minecraft:sponge'}, 31: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 32: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:snow_block'}, 33: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 34: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 35: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 36: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 37: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 38: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 39: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 40: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 41: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 42: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 43: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 44: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}, 45: {0: 'minecraft:diorite_slab', 1: 'minecraft:diorite_slab', 2: 'minecraft:diorite_slab', 3: 'minecraft:diorite_slab', 4: 'minecraft:diorite_slab'}}

并且（我认为是）前 3 列的预期输出（再次假设玩家的位置为 0、0、0）。

/fill 0 0 0 0 0 45 minecraft:diorite_slab
/fill 1 0 0 1 0 45 minecraft:diorite_slab

/fill 2 0 0 2 0 26 minecraft:diorite_slab
/fill 2 0 27 2 0 29 minecraft:mushroom_stem
/fill 2 0 30 2 0 45 minecraft:diorite_slab

【问题讨论】：

  • 你能提供一个可复制形式的示例数据框吗？您可以使用df.head() 获取前几行，使用df.to_dict() 将其转换为文本格式。
  • 完成@NickODell
  • “编辑 1”的预期输出是什么？你给了一本字典。这些是否假定为 x 和 y？由于字典总是连续的数字，它看起来很适合多维数组。
  • @hesham_EE 这是尼克建议的输出：print(df.head().to_dict())。我假设使用 pandas.pydata.org/docs/reference/api/… 可能会以数据框格式为您提供。由于这是一个真实的情况，结果要大得多，我现在不能完全确定它是什么。当我发现时，我会制作和编辑。
  • @EricMendes 我对此进行了破解，对于火影忍者数据框，我从您那里得到了不同的结果。我不确定我所拥有的是否正确，你能检查一下吗？ pastebin.com/xte8JWHf

标签： python pandas numpy python-imaging-library minecraft


【解决方案1】：

这是一个主要使用shift和groupby的解决方案：

def script(df):
    z = (df != df.shift()).cumsum()
    zri = z.reset_index()
    ix_name = z.index.name
    co_name = z.columns.name
    for i in z:
        v = zri.groupby(i)[ix_name].agg(['first', 'last'])
        s = {co_name:i}
        e = {co_name:i}
        for _, r in v.iterrows():
            s[ix_name] = r['first']
            e[ix_name] = r['last']
            material = df.loc[r['first'], i]
            yield f'/fill {s["x"]} 0 {s["z"]} {e["x"]} 0 {e["z"]} {material}'

使用方法：

# df is the DataFrame of your dict

# label the axes
df = df.rename_axis(index='z', columns='x')

# select which axis to make major
a = list(script(df))
b = list(script(df.T))
res = min([a, b], key=len)

关于您的第一个样本数据：

>>> res
['/fill 0 0 0 0 0 1 minecraft:diorite',
 '/fill 0 0 2 0 0 2 minecraft:stone',
 '/fill 1 0 0 1 0 1 minecraft:stone',
 '/fill 1 0 2 1 0 2 minecraft:cobblestone',
 '/fill 2 0 0 2 0 0 minecraft:block_of_raw_iron',
 '/fill 2 0 1 2 0 1 minecraft:diamond_block',
 '/fill 2 0 2 2 0 2 minecraft:gold_block']

在您为“火影忍者的像素艺术”提供的前 5 行中：

>>> res
['/fill 0 0 0 45 0 0 minecraft:diorite_slab',
 '/fill 0 0 1 45 0 1 minecraft:diorite_slab',
 '/fill 0 0 2 19 0 2 minecraft:diorite_slab',
 '/fill 20 0 2 20 0 2 minecraft:sand',
 '/fill 21 0 2 24 0 2 minecraft:snow_block',
 '/fill 25 0 2 25 0 2 minecraft:sand',
 '/fill 26 0 2 45 0 2 minecraft:diorite_slab',
 '/fill 0 0 3 15 0 3 minecraft:diorite_slab',
 '/fill 16 0 3 18 0 3 minecraft:snow_block',
 '/fill 19 0 3 19 0 3 minecraft:sand',
 '/fill 20 0 3 20 0 3 minecraft:block_of_gold',
 '/fill 21 0 3 21 0 3 minecraft:diorite_slab',
 '/fill 22 0 3 23 0 3 minecraft:snow_block',
 '/fill 24 0 3 24 0 3 minecraft:sand',
 '/fill 25 0 3 25 0 3 minecraft:sponge',
 '/fill 26 0 3 26 0 3 minecraft:sand',
 '/fill 27 0 3 29 0 3 minecraft:snow_block',
 '/fill 30 0 3 30 0 3 minecraft:sand',
 '/fill 31 0 3 45 0 3 minecraft:diorite_slab',
 '/fill 0 0 4 13 0 4 minecraft:diorite_slab',
 '/fill 14 0 4 14 0 4 minecraft:block_of_raw_iron',
 '/fill 15 0 4 15 0 4 minecraft:sand',
 '/fill 16 0 4 18 0 4 minecraft:snow_block',
 '/fill 19 0 4 19 0 4 minecraft:sand',
 '/fill 20 0 4 20 0 4 minecraft:sponge',
 '/fill 21 0 4 21 0 4 minecraft:sand',
 '/fill 22 0 4 22 0 4 minecraft:snow_block',
 '/fill 23 0 4 23 0 4 minecraft:diorite_slab',
 '/fill 24 0 4 24 0 4 minecraft:block_of_gold',
 '/fill 25 0 4 25 0 4 minecraft:sponge',
 '/fill 26 0 4 26 0 4 minecraft:white_terracotta',
 '/fill 27 0 4 27 0 4 minecraft:snow_block',
 '/fill 28 0 4 28 0 4 minecraft:diorite_slab',
 '/fill 29 0 4 29 0 4 minecraft:sand',
 '/fill 30 0 4 30 0 4 minecraft:sponge',
 '/fill 31 0 4 31 0 4 minecraft:diorite_slab',
 '/fill 32 0 4 32 0 4 minecraft:snow_block',
 '/fill 33 0 4 45 0 4 minecraft:diorite_slab']

附录：使脚本相对于当前位置。

import numpy as np


def script(df, at=(0,0,0)):
    z = (df != df.shift()).cumsum()
    zri = z.reset_index()
    ix_name = z.index.name
    co_name = z.columns.name
    for i in z:
        v = zri.groupby(i)[ix_name].agg(['first', 'last'])
        s = {co_name:i}
        e = {co_name:i}
        for _, r in v.iterrows():
            s[ix_name] = r['first']
            e[ix_name] = r['last']
            material = df.loc[r['first'], i]
            sp = np.array((s['x'], 0, s['z'])) + at
            ep = np.array((e['x'], 0, e['z'])) + at
            line = ' '.join(tuple(sp.astype(str)) + tuple(ep.astype(str)) + (material, ))
            yield f'/fill {line}'

例子：

pos = (-5, 7, 3)
a = list(script(df, at=pos))
b = list(script(df.T, at=pos))
res = min([a, b], key=len)

>>> res
['/fill -5 7 3 -5 7 4 minecraft:diorite',
 '/fill -5 7 5 -5 7 5 minecraft:stone',
 '/fill -4 7 3 -4 7 4 minecraft:stone',
 '/fill -4 7 5 -4 7 5 minecraft:cobblestone',
 '/fill -3 7 3 -3 7 3 minecraft:block_of_raw_iron',
 '/fill -3 7 4 -3 7 4 minecraft:diamond_block',
 '/fill -3 7 5 -3 7 5 minecraft:gold_block']

【讨论】：

  • 你的解决方案就像一个魅力，但我仍然需要这个：> 此外，这些命令必须与玩家的 (x, y, z) 有一个相对位置，这应该在代码中通过一个元组什么的。我将如何使用您的解决方案来做到这一点？玩家并不总是@ 0 0 0
  • 很高兴听到这个消息；那么请考虑What should I do when someone answers。我添加了一些关于如何使脚本相对于位置的内容。
【解决方案2】：

我尝试根据un-pivoting 将值矩阵写入坐标表示的解决方案，但压缩代码最终变得非常复杂，所以我放弃了它，并编写了一个基于嵌套循环的解决方案，这最终更容易编写。

基本上，这会在行上循环，并且在每一行内，它会将相同材料的块分组，只要这些块是连续的。 （这就是 itertools.groupby() 的目的，它与 Pandas 的 groupby 不同，因为 Pandas 版本将相同的非连续值分组。）

import pandas as pd
import itertools
from collections import namedtuple

FillCommand = namedtuple('FillCommand', 'minx minz maxx maxz blocks material')

def compress_row(j, s):
    i = 0
    for material, group in itertools.groupby(s):
        num_elements = len(list(group))
        maxz = i + num_elements - 1
        yield FillCommand(
            minx=j,
            minz=i,
            maxx=j,
            maxz=maxz,
            blocks=num_elements,
            material=material,
        )
        i += num_elements

def compress_all(df):
    height = len(df.index)
    for j in range(height):
        yield from compress_row(j, df.iloc[j])

def fill_to_string(fill_commands):
    for cmd in fill_commands:
        yield f"/fill {cmd.minx} 0 {cmd.minz} {cmd.maxx} 0 {cmd.maxz} {cmd.material}"

def convert_pic_to_fill(df):
    return list(fill_to_string(compress_all(df)))

convert_pic_to_fill(df_naruto)

这是这段代码的输出：

/fill 0 0 0 0 0 45 minecraft:diorite_slab
/fill 1 0 0 1 0 45 minecraft:diorite_slab
/fill 2 0 0 2 0 19 minecraft:diorite_slab
/fill 2 0 20 2 0 20 minecraft:sand
/fill 2 0 21 2 0 24 minecraft:snow_block
/fill 2 0 25 2 0 25 minecraft:sand
/fill 2 0 26 2 0 45 minecraft:diorite_slab
/fill 3 0 0 3 0 15 minecraft:diorite_slab
/fill 3 0 16 3 0 18 minecraft:snow_block
/fill 3 0 19 3 0 19 minecraft:sand
/fill 3 0 20 3 0 20 minecraft:block_of_gold
/fill 3 0 21 3 0 21 minecraft:diorite_slab
/fill 3 0 22 3 0 23 minecraft:snow_block
/fill 3 0 24 3 0 24 minecraft:sand
/fill 3 0 25 3 0 25 minecraft:sponge
/fill 3 0 26 3 0 26 minecraft:sand
/fill 3 0 27 3 0 29 minecraft:snow_block
/fill 3 0 30 3 0 30 minecraft:sand
/fill 3 0 31 3 0 45 minecraft:diorite_slab
/fill 4 0 0 4 0 13 minecraft:diorite_slab
/fill 4 0 14 4 0 14 minecraft:block_of_raw_iron
/fill 4 0 15 4 0 15 minecraft:sand
/fill 4 0 16 4 0 18 minecraft:snow_block
/fill 4 0 19 4 0 19 minecraft:sand
/fill 4 0 20 4 0 20 minecraft:sponge
/fill 4 0 21 4 0 21 minecraft:sand
/fill 4 0 22 4 0 22 minecraft:snow_block
/fill 4 0 23 4 0 23 minecraft:diorite_slab
/fill 4 0 24 4 0 24 minecraft:block_of_gold
/fill 4 0 25 4 0 25 minecraft:sponge
/fill 4 0 26 4 0 26 minecraft:white_terracotta
/fill 4 0 27 4 0 27 minecraft:snow_block
/fill 4 0 28 4 0 28 minecraft:diorite_slab
/fill 4 0 29 4 0 29 minecraft:sand
/fill 4 0 30 4 0 30 minecraft:sponge
/fill 4 0 31 4 0 31 minecraft:diorite_slab
/fill 4 0 32 4 0 32 minecraft:snow_block
/fill 4 0 33 4 0 45 minecraft:diorite_slab

【讨论】：

  • 您的解决方案也运行良好，但我还需要能够将玩家的位置作为参数传递，就像我在问题中描述的那样：> 此外，这些命令必须具有相对位置玩家的 (x, y, z) 应该通过元组或其他东西在代码中通知。玩家不会一直处于 0 0 0
  • 好吧，可以修改 compress_row 或 fill_to_string 以获取偏移量并将其添加到填充命令中。您已经获得了源代码，并且可以进行修改。
  • 谢谢！我会努力的！
猜你喜欢
  • 1970-01-01
  • 1970-01-01
  • 2020-11-05
  • 1970-01-01
  • 2020-08-07
  • 2017-06-07
  • 2019-03-22
  • 2022-01-22
  • 1970-01-01
相关资源
最近更新 更多
热门标签
Java Python linux javascript Mysql C# Docker 算法 前端 SpringBoot Redis Vue spring 设计模式 .net core .net kubernetes c++ 数据库 数据结构 大数据 js 机器学习 微服务 Android Go 程序员 面试 JVM ASP.net core 云原生 人工智能 后端 PHP git CSS golang k8s Nginx Django mybatis 深度学习 多线程 React 架构 devops 爬虫 云计算 Spring Boot LeetCode