MapReduce怎么在MongoDB中使用
本篇文章为大家展示了MapReduce怎么在MongoDB中使用,内容简明扼要并且容易理解,绝对能使你眼前一亮,通过这篇文章的详细介绍希望你能有所收获。
stringmap=@"function(){varview=this;emit(view.activity,{pv:1});}";stringreduce=@"function(key,values){varresult={pv:0};values.forEach(function(value){result.pv+=value.pv;});returnresult;}";stringfinalize=@"function(key,value){returnvalue;}";
mapReduce
MongoDB中的MapReduce可以用来实现更复杂的聚合命令,使用MapReduce主要实现两个函数:map函数和reduce函数,map函数用来生成键值对序列,map函数的结果作为reduce函数的参数,reduce函数中再做进一步的统计,比如我的数据集如下:
{"_id":ObjectId("59fa71d71fd59c3b2cd908d7"),"name":"鲁迅","book":"呐喊","price":38.0,"publisher":"人民文学出版社"}{"_id":ObjectId("59fa71d71fd59c3b2cd908d8"),"name":"曹雪芹","book":"红楼梦","price":22.0,"publisher":"人民文学出版社"}{"_id":ObjectId("59fa71d71fd59c3b2cd908d9"),"name":"钱钟书","book":"宋诗选注","price":99.0,"publisher":"人民文学出版社"}{"_id":ObjectId("59fa71d71fd59c3b2cd908da"),"name":"钱钟书","book":"谈艺录","price":66.0,"publisher":"三联书店"}{"_id":ObjectId("59fa71d71fd59c3b2cd908db"),"name":"鲁迅","book":"彷徨","price":55.0,"publisher":"花城出版社"}
假如我想查询每位作者所出的书的总价,操作如下:
varmap=function(){emit(this.name,this.price)}varreduce=function(key,value){returnArray.sum(value)}varoptions={out:"totalPrice"}db.sang_books.mapReduce(map,reduce,options);db.totalPrice.find()
emit函数主要用来实现分组,接收两个参数,第一个参数表示分组的字段,第二个参数表示要统计的数据,reduce来做具体的数据处理操作,接收两个参数,对应emit方法的两个参数,这里使用了Array中的sum函数对price字段进行自加处理,options中定义了将结果输出的集合,届时我们将在这个集合中去查询数据,默认情况下,这个集合即使在数据库重启后也会保留,并且保留集合中的数据。
查询结果如下:
{"_id":"曹雪芹","value":22.0}{"_id":"钱钟书","value":165.0}{"_id":"鲁迅","value":93.0}
再比如我想查询每位作者出了几本书,如下:
varmap=function(){emit(this.name,1)}varreduce=function(key,value){returnArray.sum(value)}varoptions={out:"bookNum"}db.sang_books.mapReduce(map,reduce,options);db.bookNum.find()
查询结果如下:
{"_id":"曹雪芹","value":1.0}{"_id":"钱钟书","value":2.0}{"_id":"鲁迅","value":2.0}
将每位作者的书列出来,如下:
varmap=function(){emit(this.name,this.book)}varreduce=function(key,value){returnvalue.join(',')}varoptions={out:"books"}db.sang_books.mapReduce(map,reduce,options);db.books.find()
结果如下:
{"_id":"曹雪芹","value":"红楼梦"}{"_id":"钱钟书","value":"宋诗选注,谈艺录"}{"_id":"鲁迅","value":"呐喊,彷徨"}
比如查询每个人售价在¥40以上的书:
varmap=function(){emit(this.name,this.book)}varreduce=function(key,value){returnvalue.join(',')}varoptions={query:{price:{$gt:40}},out:"books"}db.sang_books.mapReduce(map,reduce,options);db.books.find()
query表示对查到的集合再进行筛选。
结果如下:
{"_id":"钱钟书","value":"宋诗选注,谈艺录"}{"_id":"鲁迅","value":"彷徨"}
runCommand实现
我们也可以利用runCommand命令来执行MapReduce。格式如下:
db.runCommand({mapReduce:<collection>,map:<function>,reduce:<function>,finalize:<function>,out:<output>,query:<document>,sort:<document>,limit:<number>,scope:<document>,jsMode:<boolean>,verbose:<boolean>,bypassDocumentValidation:<boolean>,collation:<document>})
含义如下:
如下操作,表示执行MapReduce操作并对统计的集合限制返回条数,限制返回条数之后再进行统计操作,如下:
varmap=function(){emit(this.name,this.book)}varreduce=function(key,value){returnvalue.join(',')}db.runCommand({mapreduce:'sang_books',map,reduce,out:"books",limit:4,verbose:true})db.books.find()
执行结果如下:
{"_id":"曹雪芹","value":"红楼梦"}{"_id":"钱钟书","value":"宋诗选注,谈艺录"}{"_id":"鲁迅","value":"呐喊"}
小伙伴们看到,鲁迅有一本书不见了,就是因为limit是先限制集合返回条数,然后再执行统计操作。
finalize操作表示最终处理函数,如下:
varf1=function(key,reduceValue){varobj={};obj.author=key;obj.books=reduceValue;returnobj}varmap=function(){emit(this.name,this.book)}varreduce=function(key,value){returnvalue.join(',')}db.runCommand({mapreduce:'sang_books',map,reduce,out:"books",finalize:f1})db.books.find()
f1第一个参数key表示emit中的第一个参数,第二个参数表示reduce的执行结果,我们可以在f1中对这个结果进行再处理,结果如下:
{"_id":"曹雪芹","value":{"author":"曹雪芹","books":"红楼梦"}}{"_id":"钱钟书","value":{"author":"钱钟书","books":"宋诗选注,谈艺录"}}{"_id":"鲁迅","value":{"author":"鲁迅","books":"呐喊,彷徨"}}
scope则可以用来定义一个在map、reduce和finalize中都可见的变量,如下:
varf1=function(key,reduceValue){varobj={};obj.author=key;obj.books=reduceValue;obj.sang=sang;returnobj}varmap=function(){emit(this.name,this.book)}varreduce=function(key,value){returnvalue.join(',--'+sang+'--,')}db.runCommand({mapreduce:'sang_books',map,reduce,out:"books",finalize:f1,scope:{sang:"haha"}})db.books.find()
执行结果如下:
{"_id":"曹雪芹","value":{"author":"曹雪芹","books":"红楼梦","sang":"haha"}}{"_id":"钱钟书","value":{"author":"钱钟书","books":"宋诗选注,--haha--,谈艺录","sang":"haha"}}{"_id":"鲁迅","value":{"author":"鲁迅","books":"呐喊,--haha--,彷徨","sang":"haha"}}
上述内容就是MapReduce怎么在MongoDB中使用,你们学到知识或技能了吗?如果还想学到更多技能或者丰富自己的知识储备,欢迎关注亿速云行业资讯频道。
声明:本站所有文章资源内容,如无特殊说明或标注,均为采集网络资源。如若本站内容侵犯了原著者的合法权益,可联系本站删除。