使用 AWS CLI 查询嵌套路径并输出为表答案

【问题标题】：query nested path with AWS CLI and output as Table使用 AWS CLI 查询嵌套路径并输出为表
【发布时间】：2018-08-20 17:27:06
【问题描述】：

我正在尝试使用 AWSCLI 中的 --query 命令输出一个表，但由于某种原因，我无法在同一行中获取值。错误是什么？

.json 文件是

{
"Reservations": [
    {
        "Groups": [],
        "Instances": [
            {
                "AmiLaunchIndex": 0,
                "ImageId": "ami-2a7d75c0",
                "InstanceId": "i-099569e17a368446b",
                "InstanceType": "t2.micro",
                "KeyName": "ar_ecs_key",
                "LaunchTime": "2018-08-18T17:59:49.000Z",
                "Monitoring": {
                    "State": "disabled"
                },
                "Placement": {
                    "AvailabilityZone": "eu-west-1c",
                    "GroupName": "",
                    "Tenancy": "default"
                },
                "PrivateDnsName": "ip-172-31-46-99.eu-west-1.compute.internal",
                "PrivateIpAddress": "172.31.46.99",
                "ProductCodes": [],
                "PublicDnsName": "ec2-34-245-58-217.eu-west-1.compute.amazonaws.com",
                "PublicIpAddress": "34.245.58.217",
                "State": {
                    "Code": 16,
                    "Name": "running"
                },
                "StateTransitionReason": "",
                "SubnetId": "subnet-3407646f",
                "VpcId": "vpc-24ddec43",
                "Architecture": "x86_64",
                "BlockDeviceMappings": [
                    {
                        "DeviceName": "/dev/sda1",
                        "Ebs": {
                            "AttachTime": "2018-08-18T17:59:49.000Z",
                            "DeleteOnTermination": true,
                            "Status": "attached",
                            "VolumeId": "vol-0d9f4ab048e7999b7"
                        }
                    }
                ],
                "ClientToken": "",
                "EbsOptimized": false,
                "EnaSupport": true,
                "Hypervisor": "xen",
                "NetworkInterfaces": [
                    {
                        "Association": {
                            "IpOwnerId": "amazon",
                            "PublicDnsName": "ec2-34-245-58-217.eu-west-1.compute.amazonaws.com",
                            "PublicIp": "34.245.58.217"
                        },
                        "Attachment": {
                            "AttachTime": "2018-08-18T17:59:49.000Z",
                            "AttachmentId": "eni-attach-0bbfc61bf0a6729ad",
                            "DeleteOnTermination": true,
                            "DeviceIndex": 0,
                            "Status": "attached"
                        },
                        "Description": "",
                        "Groups": [
                            {
                                "GroupName": "default",
                                "GroupId": "sg-98ce7ee3"
                            }
                        ],
                        "Ipv6Addresses": [],
                        "MacAddress": "0a:df:58:fe:e5:d2",
                        "NetworkInterfaceId": "eni-02dcc4cbc45726b77",
                        "OwnerId": "300746241447",
                        "PrivateDnsName": "ip-172-31-46-99.eu-west-1.compute.internal",
                        "PrivateIpAddress": "172.31.46.99",
                        "PrivateIpAddresses": [
                            {
                                "Association": {
                                    "IpOwnerId": "amazon",
                                    "PublicDnsName": "ec2-34-245-58-217.eu-west-1.compute.amazonaws.com",
                                    "PublicIp": "34.245.58.217"
                                },
                                "Primary": true,
                                "PrivateDnsName": "ip-172-31-46-99.eu-west-1.compute.internal",
                                "PrivateIpAddress": "172.31.46.99"
                            }
                        ],
                        "SourceDestCheck": true,
                        "Status": "in-use",
                        "SubnetId": "subnet-3407646f",
                        "VpcId": "vpc-24ddec43"
                    }
                ],
                "RootDeviceName": "/dev/sda1",
                "RootDeviceType": "ebs",
                "SecurityGroups": [
                    {
                        "GroupName": "default",
                        "GroupId": "sg-98ce7ee3"
                    }
                ],
                "SourceDestCheck": true,
                "Tags": [
                    {
                        "Key": "webserver",
                        "Value": "production"
                    }
                ],
                "VirtualizationType": "hvm"
            }
        ],
        "OwnerId": "300746241447",
        "ReservationId": "r-047aab5e090b741af"
    }
]

}

我的查询是：

$ aws ec2 describe-instances --instance-ids i-099569e17a368446b --query 'Reservations[*].Instances[].{InstanceId:InstanceId,type:InstanceType,Devicename:BlockDeviceMappings.DeviceName,Persistence_on:BlockDeviceMappings[].Ebs.DeleteOnTermination,Status:BlockDeviceMappings[*].Ebs.Status,Volume_id:BlockDeviceMappings.Ebs.VolumeId}' --output table

结果是：

我确定这与展平运算符 [] 有关，但我不知道是什么。所有版本都试过了...

提前谢谢

一个

【问题讨论】：

您想要使用 cli 查询或 jq 的解决方案吗？两者都将截然不同。
更重要的是，您期待什么结果？

标签： jq aws-cli

【解决方案1】：

嵌套BlockDeviceMappings 中的所有值都在一个数组中。因此，您需要将其扁平化为各个值。有几种方法可以使用 JMESPath 实现此目的，您可以只索引到第一个块设备。

Reservations[].Instances[].{
    InstanceId: InstanceId,
    type: InstanceType,
    Devicename: BlockDeviceMappings[0].DeviceName,
    Persistence_on: BlockDeviceMappings[0].Ebs.DeleteOnTermination,
    Status: BlockDeviceMappings[0].Ebs.Status,
    Volume_id: BlockDeviceMappings[0].Ebs.VolumeId
}

但我认为为了可读性，我会选择这种方法（假设 aws-cli 支持merge()）：

Reservations[].Instances[].merge(
    {InstanceId: InstanceId, type: InstanceType},
    BlockDeviceMappings[0].{
        Devicename: DeviceName,
        Persistence_on: Ebs.DeleteOnTermination,
        Status: Ebs.Status,
        Volume_id: Ebs.VolumeId
    }
)

另一方面，我发现jq 更容易使用。这应该会产生与 json 相同的结果。

$ aws-cli ... | jq '[.Reservations[].Instances[] |
    { InstanceId, type: .InstanceType } +
    (.BlockDeviceMappings[] | {
        Devicename: .DeviceName,
        Persistence_on: .Ebs.DeleteOnTermination,
        Status: .Ebs.Status,
        Volume_id: .Ebs.VolumeId
    })
]'

【讨论】：

嗨@Jeff Mercado，谢谢，我很想使用 jq 解决方案，但它不像 jmespath 那样提供表格输出......或者是这样吗？
效果很好：我刚刚做了$ aws ec2 describe-instances --instance-ids i-099569e17a368446b --query 'Reservations[].Instances[].{InstanceId: InstanceId,type: InstanceType,Devicename: BlockDeviceMappings[0].DeviceName,Persistence_on:BlockDeviceMappings[0].Ebs.DeleteOnTermination,Status: BlockDeviceMappings[0].Ebs.Status,Volume_id: BlockDeviceMappings[0].Ebs.VolumeId}' --output table
嗯，您可以输出为 csv 或 tsv，因此您可以将该输出传递给可以输出为表格的东西。当您想要的功能可以由其他人填充时，您不必限制自己使用单个程序。出于好奇，第二个 JMESPath 解决方案是否使用 merge() 工作？我无权对其进行测试。
实际上有没有办法在语句的 json 部分中进行换行，例如 shell 语句的 /？
没有合并没有工作。至于 jq - 你能给我一个简单的例子，如何在终端中用 jq 作为表格输出一些东西吗？谢谢A