es进阶语法查询
admin
2024-03-21 14:53:44
0

在看这篇前,先看下es基础语法,比较容易上手。

针对于最近做的车机平台系统一些常用的写法,做了一些记录。

数据格式如下:

{"took": 16,"timed_out": false,"_shards": {"total": 1,"successful": 1,"skipped": 0,"failed": 0},"hits": {"total": {"value": 2,"relation": "eq"},"max_score": 1.0,"hits": [{"_index": "vehicle_vip_data_202209","_type": "_doc","_id": "UZo9eIMBUZW80fpzWLp9","_score": 1.0,"_source": {"user_id": "1","vehicle_id": "2c","app_id": "12","os_ver": "ES6_kylo_BL1.0.1_101.6_20220720","tracking_type": "perf_vip_stat","timestamp": 1663149893,"datetime": "2022091418","day": "20220914","track_data": [{"key": "com.nio.carsystemui","cpu": 0.21635656,"mem": 202447.0}, {"key": "com.android.car","cpu": 0.2805656,"mem": 25879.0}]}}]}
}

1.查询某些字段列表下拉框

group_ver是自定义的名称,os_ver就是数据中的字段,根据这个字段分组得到你想要去重(分组)的list

@Override
public SearchRequest buildRequest() {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();searchSourceBuilder.size(0);TermsAggregationBuilder verTerms = AggregationBuilders.terms("group_ver").field("os_ver").size(10000).order(BucketOrder.key(true));searchSourceBuilder.aggregation(verTerms);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_system_data_202209");searchRequest.source(searchSourceBuilder);return searchRequest;
}

2.精确条件查询

查询day的时间范围

精确查询vehicle_id和os_ver

@Override
public SearchRequest buildRequest(AppMemDataQueryDTO appMemDataQueryDTO) {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();QueryBuilder daytime = QueryBuilders.rangeQuery("day").gte(appMemDataQueryDTO.getStartDay()).lte(appMemDataQueryDTO.getEndDay());BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(daytime);if(StringUtils.isNotBlank(appMemDataQueryDTO.getVehicleId())) {boolQueryBuilder.must(QueryBuilders.termQuery("vehicle_id",appMemDataQueryDTO.getVehicleId()));}if(StringUtils.isNotBlank(appMemDataQueryDTO.getOsVer())) {boolQueryBuilder.must(QueryBuilders.termQuery("os_ver", appMemDataQueryDTO.getOsVer()));}//最多展示10条searchSourceBuilder.size(10);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_vip_data_202209");searchRequest.source(searchSourceBuilder);return searchRequest;
}

3.聚合查询

时间范围

os_ver分组

求count,求平均数,求中位数

track_data.mem是一条数据中的子对象的属性

@Override
public SearchRequest buildMemRequest(MemDataQueryDTO memDataQueryDTO){SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(QueryBuilders.rangeQuery("day").from(memDataQueryDTO.getStartDay()).to(memDataQueryDTO.getEndDay()).format("yyMMdd"));searchSourceBuilder.size(0);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_system_data_202209");//分组TermsAggregationBuilder verTerms = AggregationBuilders.terms("ver_terms").field("os_ver").size(10000);//求countValueCountAggregationBuilder memCount = AggregationBuilders.count("mem_count").field("track_data.mem");//平均数AggregationBuilder memAvg = AggregationBuilders.avg("avg_cpu").field("track_data.mem");//中位数AggregationBuilder pointRanks = AggregationBuilders.percentiles("ranks").field("track.perf_system_mem").percentiles(25,50,75,90);searchSourceBuilder.aggregation(verTerms.subAggregation(pointRanks).subAggregation(memCount).subAggregation(memAvg));searchRequest.source(searchSourceBuilder);return searchRequest;
}

4.聚合查询(nested嵌套分组)

和第3条很像,具体参考nested和object区别

区别就是用nested就会把子对象的属性都会join关联上。默认子对象是不会关联,但是效率就会更差点

当你需要对一条数据的子对象分组并做聚合参数时,需要使用到es的nested特性

@Override
public SearchRequest buildCpuRequest(AppCpuDataQueryDTO query) {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();QueryBuilder daytime = QueryBuilders.rangeQuery("day").gte(query.getStartDay()).lte(query.getEndDay());BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(daytime);searchSourceBuilder.size(0);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_vip_data_202209");//分组TermsAggregationBuilder verTerms = AggregationBuilders.terms("ver_terms").field("os_ver").size(10000);//申明一个nested对象,名字自定义,属性是子对象名称track_dataNestedAggregationBuilder trackNested = AggregationBuilders.nested("track_data_nested", "track_data");TermsAggregationBuilder trackKey = AggregationBuilders.terms("data_key").field("track_data.key").size(10000);//根据子对象的filter条件精确查询(条件优化)FilterAggregationBuilder filterKey = AggregationBuilders.filter("nested_key",QueryBuilders.termQuery("track_data.key",query.getAppName()));//平均数AggregationBuilder cpuAvg = AggregationBuilders.avg("avg_cpu").field("track_data.cpu");//countValueCountAggregationBuilder memCount = AggregationBuilders.count("count").field("track_data.cpu");AggregationBuilder pointRanks = AggregationBuilders.percentiles("ranks").field("track_data.cpu").percentiles(25,50,75,90);searchSourceBuilder.aggregation(verTerms.subAggregation(trackNested.subAggregation(filterKey.subAggregation(trackKey.subAggregation(memCount).subAggregation(pointRanks).subAggregation(cpuAvg)))));searchRequest.source(searchSourceBuilder);return searchRequest;
}

4.聚合查询(nested嵌套分组)

和第3条很像,具体参考nested和object区别

区别就是用nested就会把子对象的属性都会join关联上。默认子对象是不会关联,但是效率就会更差点

当你需要对一条数据的子对象分组并做聚合参数时,需要使用到es的nested特性

@Override
public SearchRequest buildCpuRequest(AppCpuDataQueryDTO query) {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();QueryBuilder daytime = QueryBuilders.rangeQuery("day").gte(query.getStartDay()).lte(query.getEndDay());BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(daytime);searchSourceBuilder.size(0);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_vip_data_202209");//分组TermsAggregationBuilder verTerms = AggregationBuilders.terms("ver_terms").field("os_ver").size(10000);//申明一个nested对象,名字自定义,属性是子对象名称track_dataNestedAggregationBuilder trackNested = AggregationBuilders.nested("track_data_nested", "track_data");TermsAggregationBuilder trackKey = AggregationBuilders.terms("data_key").field("track_data.key").size(10000);//根据子对象的filter条件精确查询(条件优化)FilterAggregationBuilder filterKey = AggregationBuilders.filter("nested_key",QueryBuilders.termQuery("track_data.key",query.getAppName()));//平均数AggregationBuilder cpuAvg = AggregationBuilders.avg("avg_cpu").field("track_data.cpu");//countValueCountAggregationBuilder memCount = AggregationBuilders.count("count").field("track_data.cpu");AggregationBuilder pointRanks = AggregationBuilders.percentiles("ranks").field("track_data.cpu").percentiles(25,50,75,90);searchSourceBuilder.aggregation(verTerms.subAggregation(trackNested.subAggregation(filterKey.subAggregation(trackKey.subAggregation(memCount).subAggregation(pointRanks).subAggregation(cpuAvg)))));searchRequest.source(searchSourceBuilder);return searchRequest;
}

相关内容

热门资讯

飞天茅台,又涨了100块,陈华... 作者:王一行 不到四个月,飞天茅台又涨价了。 加上3月31日那次涨价,今年飞天茅台的出厂价和零售价累...
银行理财收益缩水,机构集体喊话... 【大河财立方 记者 吴海舒 杨萨】“我自己买股票都没它能亏”,某社交平台上,一位网友晒出了自己购买的...
蒙商银行行长牛冠荣拟任内蒙古自... 蒙商银行行长牛冠荣拟任内蒙古自治区党委管理领导班子企业正职 人民财讯7月25日电,内蒙古自治区党委组...
首发经济破局 激活消费新动能 在昆明顺城购物中心,占地1800平方米的蜜雪冰城旗舰店人气爆棚,门口排满了前来打卡的消费者;蜡笔小新...
原创 谁... 坐在深圳南山的写字楼里往窗外看,无人机送外卖、机器人巡逻、满街的新能源车,很多外地人第一次来都会愣一...
“硬件创新基础设施”嘉立创今日... 7月24日,深圳嘉立创科技集团股份有限公司(以下简称“嘉立创”)正式启动网上网下发行申购,申购简称为...
深化产教融合 推进数智育人 哈... 7月23日,由阿里国际人工智能人才孵化中心(以下简称“阿里国际AITIC”)主办的“智启未来·数智赋...
陈春玉够“稳”,但魔法原子还“... 今年上半年,魔法原子获得了春晚的热度,但是也受到了人事和商业化的质疑。面对外界疑问,陈春玉依靠扎实的...
实物黄金和纸黄金的交易成本如何... 在黄金投资领域,实物黄金和纸黄金是较为常见的两种投资方式,而了解它们的交易成本计算方法对于投资者来说...
这些绩优股发布拟增持计划(附股... 7月以来,上市公司密集发布拟增持计划。与此同时,德明利、广钢气体、柯力传感等多家公司还发布了承诺不减...
特斯拉一周跌没18%,马斯克自... 马斯克这周不好过——特斯拉周五跌超2%,本周累跌近18%,创2022年以来最大单周跌幅;SpaceX...
原创 世... 文|江月白 编辑|江月白 近期中东局势再度掀起波澜,也门胡塞武装突然宣布封锁红海的曼德海峡,这一举...
农业农村部:乡村消费韧性持续凸... 本报记者 刘萌 7月24日,国新办举行新闻发布会介绍2026年上半年农业农村经济运行情况。农业农村部...
一杯鲜啤引爆夏夜狂欢 如东啤酒... 扬子晚报讯(记者 郭小川 通讯员 王军)如火的夏夜,怎能少了一杯清凉爽口的鲜啤?连日来,夜色中的如东...
原创 通... 时间定了,下周油价大涨!2026年汽柴油第10次上涨在即,时间将于7月31日24时准时调价,倒计时仅...
Waymo计划独立进入两地Ro... 7 月 25 日消息,据《金融时报》报道,Alphabet 旗下自动驾驶出租车企业 Waymo 在一...
日均狂赚2.39亿!宁德时代拿... 图片来源:图虫 7月24日晚,宁德时代(300750.SZ)披露2026年半年报,报告期内,公司实现...
长鑫科技下周一上市:合肥产投集... 长鑫科技下周一上市,大股东 合肥产投 都有哪些布局? 长鑫上市,合肥产投能赚多少? 作为长鑫科技发起...
ETF市场周报 | 市场回升趋... 市场回顾: 本周(2026年7月20日-7月24日),A股市场触底反弹,前4日整体走势强劲,周五略有...
美股开盘:指数涨跌不一 ,存储... 7月24日晚间,美股三大指数开盘后涨跌不一。截至发稿,标普500指数涨0.24%,道指涨0.32%,...