PowerQuery M语言-展开类型为“记录列表的记录列表”的列

如何解决PowerQuery M语言-展开类型为“记录列表的记录列表”的列

我正在使用Excel Powerquery(M语言)来访问SNOMED CT服务器的RESTful API。服务器返回的JSON是一个深层嵌套的结构。

下面的示例被过滤以显示单个项目,通常items数组将包含多个结果。

示例-

{
  "items": [
    {
      "id": "258674000","released": true,"active": true,"effectiveTime": "20020131","moduleId": "900000000000207008","iconId": "362981000","definitionStatus": {
        "id": "900000000000074008"
      },"subclassDefinitionStatus": "NON_DISJOINT_SUBCLASSES","fsn": {
        "id": "3508354011","term": "Micrometer (qualifier value)","concept": {
          "id": "258674000"
        },"type": {
          "id": "900000000000003001"
        },"typeId": "900000000000003001","conceptId": "258674000","acceptability": {
          "900000000000509007": "PREFERRED","900000000000508004": "PREFERRED"
        }
      },"pt": {
        "id": "384891018","term": "um","type": {
          "id": "900000000000013009"
        },"typeId": "900000000000013009","descriptions": {
        "items": [
          {
            "id": "2609609012","active": false,"effectiveTime": "20170731","iconId": "900000000000003001","term": "micrometer (qualifier value)","semanticTag": "qualifier value","languageCode": "en","caseSignificance": {
              "id": "900000000000448009"
            },"concept": {
              "id": "258674000"
            },"type": {
              "id": "900000000000003001"
            },"caseSignificanceId": "900000000000448009","acceptability": {}
          },{
            "id": "384891018","iconId": "900000000000013009","semanticTag": "","caseSignificance": {
              "id": "900000000000017005"
            },"type": {
              "id": "900000000000013009"
            },"caseSignificanceId": "900000000000017005","acceptability": {
              "900000000000509007": "PREFERRED","900000000000508004": "PREFERRED"
            }
          },{
            "id": "650119013","effectiveTime": "20060731","term": "um (qualifier value)",{
            "id": "384888018","term": "micrometer",{
            "id": "3508354011",{
            "id": "3508411019","term": "Micrometer","acceptability": {
              "900000000000509007": "ACCEPTABLE"
            }
          },{
            "id": "384889014","term": "micrometre","acceptability": {
              "900000000000508004": "ACCEPTABLE"
            }
          },{
            "id": "384890017","term": "micron","acceptability": {
              "900000000000509007": "ACCEPTABLE","900000000000508004": "ACCEPTABLE"
            }
          }
        ],"limit": 8,"total": 8
      },"ancestorIds": [
        "-1","138875005","258667005","362981000","767524001"
      ],"parentIds": [
        "258668000"
      ],"statedAncestorIds": [
        "-1","statedParentIds": [
        "258668000"
      ],"definitionStatusId": "900000000000074008"
    }
  ],"searchAfter": "AoE_BTAxMzRlZWNhLTYxODEtNDFjYi1hNmJlLWQzN2IwMGFlYzEyNA==","limit": 50,"total": 1
}

JSON中的顶级对象表示M语言术语的记录列表。使用查询服务器的自定义函数fromServer(endpoint),我可以使用-

扩展JSON结果
let
    concepts = Table.FromRecords(fromServer("API_ENDPOINT")[items]),in
    concepts

这给了我一张概念表,每行一个。但是我被困在下一点。

每个概念都有一组可能的同义词。这些是SNOMED术语的描述。上述表格中的descriptions列是“记录”列,其中每个记录都有一个字段itemsitems是记录的列表,并且记录包含要访问的键/值对。我想做的是展开descriptions列,按名称展开选定的值,或展开最底层“记录”中的所有值。

因此,这类似于Table.ExpandTableColumn(),其中要扩展的值来自形状列-

descriptions (the column name)
  Records
    items: List
      Records
        Keys : Values

我必须承认,我不确定该如何着手,逐步进入表字段中的嵌套结构化值,然后累积结果。任何指针将不胜感激。

解决方法

如果我正确理解了您的问题,则认为您正在采取以下措施:

let
    json = "{""items"":[{""id"":""258674000"",""released"":true,""active"":true,""effectiveTime"":""20020131"",""moduleId"":""900000000000207008"",""iconId"":""362981000"",""definitionStatus"":{""id"":""900000000000074008""},""subclassDefinitionStatus"":""NON_DISJOINT_SUBCLASSES"",""fsn"":{""id"":""3508354011"",""term"":""Micrometer (qualifier value)"",""concept"":{""id"":""258674000""},""type"":{""id"":""900000000000003001""},""typeId"":""900000000000003001"",""conceptId"":""258674000"",""acceptability"":{""900000000000509007"":""PREFERRED"",""900000000000508004"":""PREFERRED""}},""pt"":{""id"":""384891018"",""term"":""um"",""type"":{""id"":""900000000000013009""},""typeId"":""900000000000013009"",""descriptions"":{""items"":[{""id"":""2609609012"",""active"":false,""effectiveTime"":""20170731"",""iconId"":""900000000000003001"",""term"":""micrometer (qualifier value)"",""semanticTag"":""qualifier value"",""languageCode"":""en"",""caseSignificance"":{""id"":""900000000000448009""},""caseSignificanceId"":""900000000000448009"",""acceptability"":{}},{""id"":""384891018"",""iconId"":""900000000000013009"",""semanticTag"":"""",""caseSignificance"":{""id"":""900000000000017005""},""caseSignificanceId"":""900000000000017005"",{""id"":""650119013"",""effectiveTime"":""20060731"",""term"":""um (qualifier value)"",{""id"":""384888018"",""term"":""micrometer"",{""id"":""3508354011"",{""id"":""3508411019"",""term"":""Micrometer"",""acceptability"":{""900000000000509007"":""ACCEPTABLE""}},{""id"":""384889014"",""term"":""micrometre"",""acceptability"":{""900000000000508004"":""ACCEPTABLE""}},{""id"":""384890017"",""term"":""micron"",""acceptability"":{""900000000000509007"":""ACCEPTABLE"",""900000000000508004"":""ACCEPTABLE""}}],""limit"":8,""total"":8},""ancestorIds"":[""-1"",""138875005"",""258667005"",""362981000"",""767524001""],""parentIds"":[""258668000""],""statedAncestorIds"":[""-1"",""statedParentIds"":[""258668000""],""definitionStatusId"":""900000000000074008""}],""searchAfter"":""AoE_BTAxMzRlZWNhLTYxODEtNDFjYi1hNmJlLWQzN2IwMGFlYzEyNA=="",""limit"":50,""total"":1}",parsed = Json.Document(json),toTable = Table.FromRecords(parsed[items]),flattenedDescriptions = Table.TransformColumns(toTable,{"descriptions",each Table.FromRecords([items]),type table}),// If the columns you want to expand are fixed/constant,you can hard code them. Something like this.
    expandHardCoded = Table.ExpandTableColumn(flattenedDescriptions,"descriptions",{"id","released","active","effectiveTime","moduleId","iconId","term","semanticTag","languageCode","caseSignificance","concept","type","typeId","conceptId","caseSignificanceId","acceptability"},{"id.1","released.1","active.1","effectiveTime.1","moduleId.1","iconId.1","acceptability"}),// If the columns you want to expand need to be determined dynamically but every table will have the same column names,then can look at first table and use its column names when expanding.
    expandBasedOnFirstRowOnly = 
        let
            columnsToExpand = Table.ColumnNames(flattenedDescriptions{0}[descriptions]),renamed = List.Transform(columnsToExpand,each "descriptions." & _),expanded = Table.ExpandTableColumn(flattenedDescriptions,columnsToExpand,renamed)
        in expanded,// If the columns you want to expand need to be determined dynamically but every table will not have the same column names,then create an exhaustive,unique list. This goes through every row in the table though,so might be a little slower.
    expandBasedOnAllRows =
        let
            columnsToExpand = List.Distinct(List.Combine(List.Transform(flattenedDescriptions[descriptions],Table.ColumnNames))),renamed)
        in expanded
in
    expandBasedOnAllRows
  • Table.TransformColumns将遍历descriptions列中的每个值,并将每个值的items字段转换为表格-然后可以对其进行扩展。
  • expandHardCodedexpandBasedOnFirstRowOnlyexpandBasedOnAllRows步骤只是扩展嵌套列的三种不同方法。根据您要处理的数据的性质,(n)您可能不适合使用这些方法中的一种。

版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。

相关推荐


依赖报错 idea导入项目后依赖报错,解决方案:https://blog.csdn.net/weixin_42420249/article/details/81191861 依赖版本报错:更换其他版本 无法下载依赖可参考:https://blog.csdn.net/weixin_42628809/a
错误1:代码生成器依赖和mybatis依赖冲突 启动项目时报错如下 2021-12-03 13:33:33.927 ERROR 7228 [ main] o.s.b.d.LoggingFailureAnalysisReporter : *************************** APPL
错误1:gradle项目控制台输出为乱码 # 解决方案:https://blog.csdn.net/weixin_43501566/article/details/112482302 # 在gradle-wrapper.properties 添加以下内容 org.gradle.jvmargs=-Df
错误还原:在查询的过程中,传入的workType为0时,该条件不起作用 <select id="xxx"> SELECT di.id, di.name, di.work_type, di.updated... <where> <if test=&qu
报错如下,gcc版本太低 ^ server.c:5346:31: 错误:‘struct redisServer’没有名为‘server_cpulist’的成员 redisSetCpuAffinity(server.server_cpulist); ^ server.c: 在函数‘hasActiveC
解决方案1 1、改项目中.idea/workspace.xml配置文件,增加dynamic.classpath参数 2、搜索PropertiesComponent,添加如下 <property name="dynamic.classpath" value="tru
删除根组件app.vue中的默认代码后报错:Module Error (from ./node_modules/eslint-loader/index.js): 解决方案:关闭ESlint代码检测,在项目根目录创建vue.config.js,在文件中添加 module.exports = { lin
查看spark默认的python版本 [root@master day27]# pyspark /home/software/spark-2.3.4-bin-hadoop2.7/conf/spark-env.sh: line 2: /usr/local/hadoop/bin/hadoop: No s
使用本地python环境可以成功执行 import pandas as pd import matplotlib.pyplot as plt # 设置字体 plt.rcParams['font.sans-serif'] = ['SimHei'] # 能正确显示负号 p
错误1:Request method ‘DELETE‘ not supported 错误还原:controller层有一个接口,访问该接口时报错:Request method ‘DELETE‘ not supported 错误原因:没有接收到前端传入的参数,修改为如下 参考 错误2:cannot r
错误1:启动docker镜像时报错:Error response from daemon: driver failed programming external connectivity on endpoint quirky_allen 解决方法:重启docker -> systemctl r
错误1:private field ‘xxx‘ is never assigned 按Altʾnter快捷键,选择第2项 参考:https://blog.csdn.net/shi_hong_fei_hei/article/details/88814070 错误2:启动时报错,不能找到主启动类 #
报错如下,通过源不能下载,最后警告pip需升级版本 Requirement already satisfied: pip in c:\users\ychen\appdata\local\programs\python\python310\lib\site-packages (22.0.4) Coll
错误1:maven打包报错 错误还原:使用maven打包项目时报错如下 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-resources-plugin:3.2.0:resources (default-resources)
错误1:服务调用时报错 服务消费者模块assess通过openFeign调用服务提供者模块hires 如下为服务提供者模块hires的控制层接口 @RestController @RequestMapping("/hires") public class FeignControl
错误1:运行项目后报如下错误 解决方案 报错2:Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project sb 解决方案:在pom.
参考 错误原因 过滤器或拦截器在生效时,redisTemplate还没有注入 解决方案:在注入容器时就生效 @Component //项目运行时就注入Spring容器 public class RedisBean { @Resource private RedisTemplate<String
使用vite构建项目报错 C:\Users\ychen\work>npm init @vitejs/app @vitejs/create-app is deprecated, use npm init vite instead C:\Users\ychen\AppData\Local\npm-