es进阶语法查询
admin
2024-03-21 14:53:44
0

在看这篇前,先看下es基础语法,比较容易上手。

针对于最近做的车机平台系统一些常用的写法,做了一些记录。

数据格式如下:

{"took": 16,"timed_out": false,"_shards": {"total": 1,"successful": 1,"skipped": 0,"failed": 0},"hits": {"total": {"value": 2,"relation": "eq"},"max_score": 1.0,"hits": [{"_index": "vehicle_vip_data_202209","_type": "_doc","_id": "UZo9eIMBUZW80fpzWLp9","_score": 1.0,"_source": {"user_id": "1","vehicle_id": "2c","app_id": "12","os_ver": "ES6_kylo_BL1.0.1_101.6_20220720","tracking_type": "perf_vip_stat","timestamp": 1663149893,"datetime": "2022091418","day": "20220914","track_data": [{"key": "com.nio.carsystemui","cpu": 0.21635656,"mem": 202447.0}, {"key": "com.android.car","cpu": 0.2805656,"mem": 25879.0}]}}]}
}

1.查询某些字段列表下拉框

group_ver是自定义的名称,os_ver就是数据中的字段,根据这个字段分组得到你想要去重(分组)的list

@Override
public SearchRequest buildRequest() {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();searchSourceBuilder.size(0);TermsAggregationBuilder verTerms = AggregationBuilders.terms("group_ver").field("os_ver").size(10000).order(BucketOrder.key(true));searchSourceBuilder.aggregation(verTerms);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_system_data_202209");searchRequest.source(searchSourceBuilder);return searchRequest;
}

2.精确条件查询

查询day的时间范围

精确查询vehicle_id和os_ver

@Override
public SearchRequest buildRequest(AppMemDataQueryDTO appMemDataQueryDTO) {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();QueryBuilder daytime = QueryBuilders.rangeQuery("day").gte(appMemDataQueryDTO.getStartDay()).lte(appMemDataQueryDTO.getEndDay());BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(daytime);if(StringUtils.isNotBlank(appMemDataQueryDTO.getVehicleId())) {boolQueryBuilder.must(QueryBuilders.termQuery("vehicle_id",appMemDataQueryDTO.getVehicleId()));}if(StringUtils.isNotBlank(appMemDataQueryDTO.getOsVer())) {boolQueryBuilder.must(QueryBuilders.termQuery("os_ver", appMemDataQueryDTO.getOsVer()));}//最多展示10条searchSourceBuilder.size(10);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_vip_data_202209");searchRequest.source(searchSourceBuilder);return searchRequest;
}

3.聚合查询

时间范围

os_ver分组

求count,求平均数,求中位数

track_data.mem是一条数据中的子对象的属性

@Override
public SearchRequest buildMemRequest(MemDataQueryDTO memDataQueryDTO){SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(QueryBuilders.rangeQuery("day").from(memDataQueryDTO.getStartDay()).to(memDataQueryDTO.getEndDay()).format("yyMMdd"));searchSourceBuilder.size(0);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_system_data_202209");//分组TermsAggregationBuilder verTerms = AggregationBuilders.terms("ver_terms").field("os_ver").size(10000);//求countValueCountAggregationBuilder memCount = AggregationBuilders.count("mem_count").field("track_data.mem");//平均数AggregationBuilder memAvg = AggregationBuilders.avg("avg_cpu").field("track_data.mem");//中位数AggregationBuilder pointRanks = AggregationBuilders.percentiles("ranks").field("track.perf_system_mem").percentiles(25,50,75,90);searchSourceBuilder.aggregation(verTerms.subAggregation(pointRanks).subAggregation(memCount).subAggregation(memAvg));searchRequest.source(searchSourceBuilder);return searchRequest;
}

4.聚合查询(nested嵌套分组)

和第3条很像,具体参考nested和object区别

区别就是用nested就会把子对象的属性都会join关联上。默认子对象是不会关联,但是效率就会更差点

当你需要对一条数据的子对象分组并做聚合参数时,需要使用到es的nested特性

@Override
public SearchRequest buildCpuRequest(AppCpuDataQueryDTO query) {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();QueryBuilder daytime = QueryBuilders.rangeQuery("day").gte(query.getStartDay()).lte(query.getEndDay());BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(daytime);searchSourceBuilder.size(0);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_vip_data_202209");//分组TermsAggregationBuilder verTerms = AggregationBuilders.terms("ver_terms").field("os_ver").size(10000);//申明一个nested对象,名字自定义,属性是子对象名称track_dataNestedAggregationBuilder trackNested = AggregationBuilders.nested("track_data_nested", "track_data");TermsAggregationBuilder trackKey = AggregationBuilders.terms("data_key").field("track_data.key").size(10000);//根据子对象的filter条件精确查询(条件优化)FilterAggregationBuilder filterKey = AggregationBuilders.filter("nested_key",QueryBuilders.termQuery("track_data.key",query.getAppName()));//平均数AggregationBuilder cpuAvg = AggregationBuilders.avg("avg_cpu").field("track_data.cpu");//countValueCountAggregationBuilder memCount = AggregationBuilders.count("count").field("track_data.cpu");AggregationBuilder pointRanks = AggregationBuilders.percentiles("ranks").field("track_data.cpu").percentiles(25,50,75,90);searchSourceBuilder.aggregation(verTerms.subAggregation(trackNested.subAggregation(filterKey.subAggregation(trackKey.subAggregation(memCount).subAggregation(pointRanks).subAggregation(cpuAvg)))));searchRequest.source(searchSourceBuilder);return searchRequest;
}

4.聚合查询(nested嵌套分组)

和第3条很像,具体参考nested和object区别

区别就是用nested就会把子对象的属性都会join关联上。默认子对象是不会关联,但是效率就会更差点

当你需要对一条数据的子对象分组并做聚合参数时,需要使用到es的nested特性

@Override
public SearchRequest buildCpuRequest(AppCpuDataQueryDTO query) {SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();SearchRequest searchRequest = new SearchRequest();QueryBuilder daytime = QueryBuilders.rangeQuery("day").gte(query.getStartDay()).lte(query.getEndDay());BoolQueryBuilder boolQueryBuilder = QueryBuilders.boolQuery().filter(daytime);searchSourceBuilder.size(0);searchSourceBuilder.query(boolQueryBuilder);// 查询的索引//目前索引写死,后期与当前时间相关动态调整searchRequest.indices("vehicle_vip_data_202209");//分组TermsAggregationBuilder verTerms = AggregationBuilders.terms("ver_terms").field("os_ver").size(10000);//申明一个nested对象,名字自定义,属性是子对象名称track_dataNestedAggregationBuilder trackNested = AggregationBuilders.nested("track_data_nested", "track_data");TermsAggregationBuilder trackKey = AggregationBuilders.terms("data_key").field("track_data.key").size(10000);//根据子对象的filter条件精确查询(条件优化)FilterAggregationBuilder filterKey = AggregationBuilders.filter("nested_key",QueryBuilders.termQuery("track_data.key",query.getAppName()));//平均数AggregationBuilder cpuAvg = AggregationBuilders.avg("avg_cpu").field("track_data.cpu");//countValueCountAggregationBuilder memCount = AggregationBuilders.count("count").field("track_data.cpu");AggregationBuilder pointRanks = AggregationBuilders.percentiles("ranks").field("track_data.cpu").percentiles(25,50,75,90);searchSourceBuilder.aggregation(verTerms.subAggregation(trackNested.subAggregation(filterKey.subAggregation(trackKey.subAggregation(memCount).subAggregation(pointRanks).subAggregation(cpuAvg)))));searchRequest.source(searchSourceBuilder);return searchRequest;
}

相关内容

热门资讯

原创 刚... 4月21日下午,当宁德时代超级科技日的大屏幕亮起时,台下不少行业人士都愣了一下。宁德时代宣布,备受瞩...
俄罗斯知名巧克力品牌优化增效 【环球时报综合报道】俄罗斯最大巧克力生产商之一“联合糖果”正优化生产。“联合糖果”公司(旗下品牌包括...
三星半导体员工协商达成年均奖金... 但这份协议对三星而言仍可能是一次胜利,因为其奖金总额低于本土竞争对手SK海力士。 三星与曾威胁发起罢...
Google亲手把搜索框做成了... Google I/O 2026开完了。如果你以为这家公司又在炫酷炫技术,那你猜对了一半——另一半是,...
女子把2万多克黄金存珠宝店,金... 浙江杭州的林女士反映,她是做黄金生意的,从2024年7月开始,分48次陆续将22917.462克黄金...
000638,终止上市!9股获... 今日(5月25日),A股三大指数集体收涨,上证指数报收4152.57点,上涨0.96%;深证成指上涨...
原创 人... 人民币这波行情,最戏剧性的一幕发生在5月13日。当天即期收盘价直接砸到6.7905,正式踏进6.7区...
燕文物流、闪回科技、金龙电机、... 每经记者:李旭馗 每经编辑:袁东 |2026年5月26日 星期二| NO.1燕文物流、闪回科技、金龙...
一代互联网招聘神话,破产了 消费赛道雷声滚滚,招聘赛道也未能幸免。 近日,招聘行业再传重磅消息,曾被无数互联网人视作“跳槽圣地”...
字节反击腾讯称“都是卖猪食的,... 澎湃新闻记者 范佳来 实习生 吴亦菲 抖音副总裁李亮辟谣“反击腾讯”。 近日,有传言称腾讯、字节跳动...
国有大型银行板块5月25日涨0... 证券之星消息,5月25日国有大型银行板块较上一交易日上涨0.02%,中国银行领涨。当日上证指数报收于...
金属包装行业的主流发展趋势 绿色环保、智能化生产、高端化与个性化、行业整合及国际化拓展是当前金属包装行业的主要发展趋势。 绿色...
投资也有流量密码?带你了解自由... 风险提示:基金有风险,投资需谨慎。
美债收益率破5%:全球资产定价... 导读 4月美国通胀数据超预期反弹、美联储新主席沃什近期就任、中东地缘冲突推升油价、美国财政赤字高企与...
烁威光电同步完成两轮Pre-A... 【大河财立方消息】近日,北京烁威光电科技有限公司(以下简称“烁威光电”)同步完成两轮合计金额超亿元融...
库克将迎CEO告别演讲,此后转... 5月25日,知名科技记者马克 · 古尔曼发文称,今年苹果全球开发者大会 (WWDC) 将是库克作为苹...
北京集中约谈17家重点平台企业... 据北京市市场监督管理局5月25日消息,为加强平台经济监管,规范6·18期间平台经营行为,近日,北京市...
原创 日... 你是否听过下面这些管理名言:”永远站在顾客的立场思考问题“、”盯住客户,而不是竞争对手“、”比业绩更...
玄机科技申报北交所IPO收到首... ● 本报记者 杨梓岩 凭借《秦时明月》系列打开国产3D动画市场的杭州玄机科技股份有限公司,正谋求登陆...
2026年茅台不设经营目标,白... 资本市场必须学习用“真实动销”“库存健康度”“消费者触达效率”这些新的尺度来重新丈量一家酒企的价值。...