zhwITbird 2021-05-24 13:30 采纳率: 100%

已采纳

mongo 数组分页并返回数组中指定的字段

刚接触mongo，希望mongo大佬解惑，感谢。

需求

数据结构中有有个数组`malIps`,这个数组中有个字段`attack`，想对malIps这个数组进行分页，并且不返回`attack`这个数组对象。

mongo中存储的数据结构：

{
        "_id" : ObjectId("60ab1cd22119d970838a7db8"),
        "attackTypeAmount" : 7,
        "logTotal" : 48500,
        "attackTotal" : 9758,
        "attackTypeTotal" : {
                "scanrobots" : 330,
                "FileInclude" : 4020,
                "Javaouinstream" : 6,
                "Sensitivefile" : 4785,
                "SQLInjection" : 6,
                "Webshell" : 12,
                "XSS" : 599
        },
        "malIpTotal" : 3,
        "malIps" : [
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.112",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : "",
                        "attack" : [
                                {
                                        "dateTime" : "2020-12-03 16:05:46",
                                        "lineNo" : 48224,
                                        "log" : "192.168.0.112 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/css//../../../WEB-INF/web.xml\u0000.jsp HTTP/1.1\" 404 242 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"",
                                        "filePath" : "F:\\test\\logs\\apache\\access_log",
                                        "type" : "Sensitivefile",
                                        "status" : "404"
                                },
                                {
                                        "dateTime" : "2020-12-03 16:05:46",
                                        "lineNo" : 48272,
                                        "log" : "192.168.0.112 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/fonts/documents HTTP/1.1\" 404 228 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"",
                                        "filePath" : "F:\\test\\logs\\apache\\access_log",
                                        "type" : "XSS",
                                        "status" : "404"
                                }
                        ]
                },
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.113",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : "",
                        "attack" : [
                                {
                                        "dateTime" : "2020-12-03 16:05:46",
                                        "lineNo" : 48224,
                                        "log" : "192.168.0.113 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/css//../../../WEB-INF/web.xml\u0000.jsp HTTP/1.1\" 404 242 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"",
                                        "filePath" : "F:\\test\\logs\\apache\\access_log",
                                        "type" : "Sensitivefile",
                                        "status" : "404"
                                },
                                {
                                        "dateTime" : "2020-12-03 16:05:46",
                                        "lineNo" : 48300,
                                        "log" : "192.168.0.113 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/images/documents HTTP/1.1\" 404 229 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"",
                                        "filePath" : "F:\\test\\logs\\apache\\access_log",
                                        "type" : "XSS",
                                        "status" : "404"
                                }
                        ]
                },
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.114",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : "",
                        "attack" : [ ]
                }
        ]
}

想得到的数据结构，得到`malIps`的前两条数据，不要`attack`字段，如下：

{
        "_id" : ObjectId("60ab1cd22119d970838a7db8"),
        "attackTypeAmount" : 7,
        "logTotal" : 48500,
        "attackTotal" : 9758,
        "attackTypeTotal" : {
                "scanrobots" : 330,
                "FileInclude" : 4020,
                "Javaouinstream" : 6,
                "Sensitivefile" : 4785,
                "SQLInjection" : 6,
                "Webshell" : 12,
                "XSS" : 599
        },
        "malIpTotal" : 3,
        "malIps" : [
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.112",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : ""
                },
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.113",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : ""
                }
        ]
}

测试用数据插入：

insert({"attackTypeAmount":7,"logTotal":48500,"attackTotal":9758,"attackTypeTotal":{"scanrobots":330,"FileInclude":4020,"Javaouinstream":6,"Sensitivefile":4785,"SQLInjection":6,"Webshell":12,"XSS":599},"malIpTotal":3,"malIps":[{"attackCounts":9758,"telecomOperator":"","finishTime":"2020-12-03 16:05:46","isMalIp":false,"attackTypeAmount":9758,"ip":"192.168.0.112","latitude":"","location":"","startTime":"2020-12-02 13:55:59","attackTypeTotal":{"scanrobots":330,"FileInclude":4020,"Javaouinstream":6,"Sensitivefile":4785,"SQLInjection":6,"Webshell":12,"XSS":599},"longitude":"","attack":[{"dateTime":"2020-12-03 16:05:46","lineNo":48224,"log":"192.168.0.112 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/css//../../../WEB-INF/web.xml\u0000.jsp HTTP/1.1\" 404 242 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"","filePath":"F:\\test\\logs\\apache\\access_log","type":"Sensitivefile","status":"404"},{"dateTime":"2020-12-03 16:05:46","lineNo":48272,"log":"192.168.0.112 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/fonts/documents HTTP/1.1\" 404 228 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"","filePath":"F:\\test\\logs\\apache\\access_log","type":"XSS","status":"404"}]},{"attackCounts":9758,"telecomOperator":"","finishTime":"2020-12-03 16:05:46","isMalIp":false,"attackTypeAmount":9758,"ip":"192.168.0.113","latitude":"","location":"","startTime":"2020-12-02 13:55:59","attackTypeTotal":{"scanrobots":330,"FileInclude":4020,"Javaouinstream":6,"Sensitivefile":4785,"SQLInjection":6,"Webshell":12,"XSS":599},"longitude":"","attack":[{"dateTime":"2020-12-03 16:05:46","lineNo":48224,"log":"192.168.0.113 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/css//../../../WEB-INF/web.xml\u0000.jsp HTTP/1.1\" 404 242 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"","filePath":"F:\\test\\logs\\apache\\access_log","type":"Sensitivefile","status":"404"},{"dateTime":"2020-12-03 16:05:46","lineNo":48300,"log":"192.168.0.113 - - [03/Dec/2020:16:05:46  0800] \"GET /noindex/common/images/documents HTTP/1.1\" 404 229 \"-\" \"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.21 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.21\"","filePath":"F:\\test\\logs\\apache\\access_log","type":"XSS","status":"404"}]},{"attackCounts":9758,"telecomOperator":"","finishTime":"2020-12-03 16:05:46","isMalIp":false,"attackTypeAmount":9758,"ip":"192.168.0.114","latitude":"","location":"","startTime":"2020-12-02 13:55:59","attackTypeTotal":{"scanrobots":330,"FileInclude":4020,"Javaouinstream":6,"Sensitivefile":4785,"SQLInjection":6,"Webshell":12,"XSS":599},"longitude":"","attack":[]}]});

查了官方文档，find 和 slice好像实现不了，需要用aggregate() 并使用两个单独的$project可是官方没有对应的例子，咋都凑不出来。

写回答
好问题 0 提建议
追加酬金
关注问题
分享
邀请回答
编辑收藏删除结题
收藏举报

1条回答默认最新

zhwITbird 2021-05-24 14:47

关注

找到合适的方式了，自己回答一下吧，用到的操作：

aggregate：聚合，支持很多操作，目前一知半解

$project ：投影，我理解是对查询结果的数据结构进行重构

$slice：对数组结构进行分页

思路，通过两次$project()对查询结果进行两次投影：第一次：先去掉不需要的字段 attack ，第二次使用$slice对结果进行分页；

第一步：先去掉不需要的字段，查询语句如下：

aggregate([{$project:{"malIps.attack":0}}]).pretty();

第二步：对malIps进行分页：

aggregate([{$project:{"malIps":{$slice:["$malIps",0,1]}}}]).pretty();

第三步：将两次的投影结合起来：

aggregate([{$project:{"malIps":{$slice:["$malIps",0,1]}}},{$project:{"malIps.attack":0}}]).pretty();

最终查询结果如下：

{
        "_id" : ObjectId("60ab1cd22119d970838a7db8"),
        "malIps" : [
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.112",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : ""
                },
                {
                        "attackCounts" : 9758,
                        "telecomOperator" : "",
                        "finishTime" : "2020-12-03 16:05:46",
                        "isMalIp" : false,
                        "attackTypeAmount" : 9758,
                        "ip" : "192.168.0.113",
                        "latitude" : "",
                        "location" : "",
                        "startTime" : "2020-12-02 13:55:59",
                        "attackTypeTotal" : {
                                "scanrobots" : 330,
                                "FileInclude" : 4020,
                                "Javaouinstream" : 6,
                                "Sensitivefile" : 4785,
                                "SQLInjection" : 6,
                                "Webshell" : 12,
                                "XSS" : 599
                        },
                        "longitude" : ""
                }
        ]
}

希望能帮到有同样疑惑的同学。。。

参考：

https://docs.mongodb.com/manual/reference/operator/projection/slice/

https://docs.mongodb.com/manual/reference/method/db.collection.aggregate/

https://docs.mongodb.com/manual/reference/operator/aggregation/project/

本回答被题主选为最佳回答 , 对您是否有帮助呢?

报告相同问题？

关注问题

mongo 数组分页并返回数组中指定的字段 mongodb 有问必答
2021-05-24 13:30

回答 1 已采纳找到合适的方式了，自己回答一下吧，用到的操作： aggregate：聚合，支持很多操作，目前一知半解 $project ：投影，我理解是对查询结果的数据结构进行重构 $slice：对数组结构进行
如何将数组中存在的值与mongo中的字段进行匹配 mongodb php
2019-03-05 09:32

回答 1 已采纳 You were close, but there are a couple of things not quite right: [ '$project'=> [ 'data' =&
mongo 怎么实现查询一个数组
2017-06-13 02:48

回答 1 已采纳查询数组。此时你可能会使用到$all、$size。 > db.tianyc04.find() { "_id" : 1, "fruit" : [ "apple", "banana", "p
python mongodb分页查询_MongoDB在python中的使用
2020-12-19 14:53

weixin_39834205的博客 MongoDB在python中的使用文章目录MongoDB在python中的使用安装配置文件客户端Pychar插件Python链接Mongodb基本使用基本概念插入数据ObjectID文档查询数据统计排序分页更新删除mongoDB是由C++编写的分布式文档数据库...
MongoDB更新嵌套数组中的字段 database mongodb php
2012-03-08 01:44

回答 3 已采纳 You can't. The positional operator is only available for the first array in your document hierarch
如何使用Go更新Mongodb中的数组字段 mongodb
2017-04-11 09:19

回答 1 已采纳 You can use the $set operator and the dot notation : err := col.Update( bson.M{"_id": "123"},
从字符串为Mongo创建PHP数组 mongodb php
2019-01-07 13:13

回答 1 已采纳 If I understand correctly, You want to take input string f1/f2/f3/f4/f5/item and create array("f1"
mongoDB提高，分页查询+更新无重复
2020-01-15 14:53

flyinghe1986的博客在mongoDB中如何实现对子文档（数组等方式存储）的分页查询等本文就针对这些零散的功能点进行一个整理，并做成一个实现demo供大家参考。一、首先了解下mongoDB的更新，mongoDB的更新方式有2大类：save()和update...
Mongo嵌套对象数组更新 mongodb php
2014-10-01 17:14

回答 1 已采纳 Ok i figured it out. This is how you do it in the console: db.test.update({"foo.bar.0.email" : {
在Mongo-go-driver中创建一个唯一字段 mongodb
2019-04-30 12:34

回答 1 已采纳 You may use a unique index to enforce / allow only distinct values of a given field, e.g.: db.col
如何从数组MongoDB php中提取元素？ mongodb php
2017-05-21 14:43

回答 1 已采纳 $this->collection->update(['$unset' => ['parameters'=> ['_id'] => $id], ['multiple'
Mongodb04 - 数据操作（数组、嵌套集合、字段判断、where、正则、排序、分页显示、更新函数、修改器）...
2017-12-27 18:51

weixin_30323961的博客 1、首先在MongoDB里面是支持数组保存的，一旦支持数组保存，需要针对数组的数据进行匹配；　（01）、范例：保存一部分数组数据　db.students.insert({"name":"古大神 - A", "age":15, "sex": "男", "seore": 90,...
使用mgo Golang从MongoDB子文档数组中解组 mongodb
2018-12-07 21:36

回答 1 已采纳 It's because you don't capture a single player, you capture players. like in the response from the
Hadoop生态圈 大数据文档
2021-12-01 09:45

BigData_XiaoBai的博客文档基于介绍基于Hadoop的大数据生态圈。介绍下图每一个组件的使用场景及使用方法，同时还对每一个组件有更深入的介绍。 ...
mongoDB使用数据(数据的插入，查询等介绍）
2020-11-21 16:00

黎明之道的博客 use 数据库名吗，进入到指定的数据库中。例如 use library。该命令是如果存在该数据库，将焦点切换到该数据库，如果该数据库不存在，则会隐式的创建该数据库，并且将焦点切换到该数据库，然后我们可以操作该数据库...
没有解决我的问题, 去提问

悬赏问题

¥15 gdf格式的脑电数据如何处理matlab
¥20 重新写的代码替换了之后运行hbuliderx就这样了
¥100 监控抖音用户作品更新可以微信公众号提醒
¥15 UE5 如何可以不渲染HDRIBackdrop背景
¥70 2048小游戏毕设项目
¥20 mysql架构，按照姓名分表
¥15 MATLAB实现区间[a,b]上的Gauss-Legendre积分
¥15 Macbookpro 连接热点正常上网，连接不了Wi-Fi。
¥15 delphi webbrowser组件网页下拉菜单自动选择问题
¥15 linux驱动，linux应用，多线程

码龄粉丝数原力等级 --

mongo 数组分页并返回数组中指定的字段

1条回答默认最新

码龄粉丝数原力等级 --

悬赏问题

mongo 数组分页并返回数组中指定的字段

1条回答 默认 最新

悬赏问题

1条回答默认最新