spark sql怎么处理嵌套的加数组的，而且是结构不一样的json数据（急）

Question

数据是这样的：{"name":"Yin","address":[{"city":"Columbus","state":"你好"},{"city":"Columbus2","state":"你好"},"android",123,"006","123"]}
我想用spark sql来拿里面的属性，该怎么拿

我这样会报错

    val result1DS = df.select(df("name"),functions.explode(df("address"))).toDF("name","address")
    val result2DS = result1DS.select("name","address.city","address.state").show(false)

Exception in thread "main" org.apache.spark.sql.AnalysisException: Can't extract value from address#14: need struct type but got string;

Answer 1

https://www.cnblogs.com/Gxiaobai/p/9818334.html