ElasticSearch - Average aggregation/sort over multivalued non-unique numeric fields -

-

i trying handle sorting on average of multivalued field called 'rating_average'. in example i'm giving you, values field [1, 2, 2]. i'm expecting average (1+2+2)/3 = 1.66666667. reality i'm getting 1.5 average.

after few tests , analyzing extended stats, i've discovered happens because average calculated on non-unique items. statistical operators applied on set [1, 2] instead of [1, 2, 2]. i've proved end adding aggregations section query double check average calculated sort block identical 1 in stats aggregation.

an example document following:

{   "_source": {   "content_uri": "http://data.semint.co.uk/resource/testcontent1",   "rating_average": [     "1",     "2",     "2"   ],   "fordesk": "http://data.semint.co.uk/resource/kmfmjd1rtkd" }

the query i'm performing following:

{   "from": 0,   "size": 20,   "aggs": {   "rating_stats": {     "extended_stats": {         "field": "rating_average"       }     }   },   "query": {     "filtered": {       "filter": {         "bool": {           "must": [             {               "terms": {                 "mediatype": [                   "http://data.semint.co.uk/resource/testmediatype3"               ],               "execution": "and"               }             }           ]         }       }     }   },   "fields": [ "content_uri", "rating_average"],   "sort": [     {       "rating_average": {         "order": "desc",         "mode": "avg"       }     }   ] }

and these results executing query on document aforementioned.

{   "took": 1,   "timed_out": false,   "_shards": {     "total": 1,     "successful": 1,     "failed": 0   },   "hits": {     "total": 1,     "max_score": null,     "hits": [       {         "_index": "travel_content6",         "_type": "semantic-index",         "_id": "http://data.semint.co.uk/resource/testcontent1",         "_score": null,         "fields": {           "content_uri": [             "http://data.semint.co.uk/resource/testcontent1"           ],           "rating_average": [1, 2, 2]         },         "sort": [           1.5         ]       }     ]   },   "aggregations": {     "rating_stats": {       "count": 2,       "min": 1,       "max": 2,       "avg": 1.5,       "sum": 3,       "sum_of_squares": 5,       "variance": 0.25,       "std_deviation": 0.5,       "std_deviation_bounds": {         "upper": 2.5,         "lower": 0.5       }     }   } }


Comments

Post a Comment

Popular posts from this blog

matlab - error with cyclic autocorrelation function -

-
Image
i'm trying code cyclic autocorrelation function in matlab follows: t=0:(n-1); t=t*te; i_alpha=0; tau=-n2*te:te:n2*te; alpha=-1/2:1/n:1/2; ryy_cl=zeros(length(alpha),length(tau)); alpha=alpha/te ind_tau=0; i_alpha=i_alpha+1; k=tau ind_tau=ind_tau+1; if k>0 % ryy_cl(i_alpha,ind_tau)=1/length(sig_bin_syl_mod(1:end- k))*sum((sig_bin_syl_mod(1:end-k)).*sig_bin_syl_mod(k+1:end)).*exp(1i*2*pi*alpha*t(1+k:length(sig_bin_syl_mod(1:end)))); ryy_cl(i_alpha,ind_tau)=(1/n)*sum((sig_bin_syl_mod(1:end-k)).*sig_bin_syl_mod(k+1:end)).*exp(-1i*2*pi*alpha*t(1:end-k)); else ryy_cl(i_alpha,ind_tau)=(1/n)*sum((sig_bin_syl_mod(1-k:end)).*sig_bin_syl_mod(1:end+k)).*exp(-1i*2*pi*alpha*t(1-k:end)); end end end i'm getting errors, , doesn't show expecting. according below formulae, how can fix it? the code provided incomplete, difficult confidently reproduce error. in particular, haven't de...
Read more

django - (fields.E300) Field defines a relation with model 'AbstractEmailUser' which is either not installed, or is abstract -

-
i trying create customuser django project email username , add radio button truck , company. in registration process email-id registered per truck or company. mentioned radio button 'tag' , add manytomany field tag in emailuser model. when makemigrations, raising error : (fields.e300) field defines relation model 'abstractemailuser' either not installed, or abstract. i quite new django , not sure whether have created correct code wants. please me solving this. here code, models.py: import django django.contrib.auth.models import ( abstractbaseuser, baseusermanager, permissionsmixin) django.core.mail import send_mail django.db import models django.utils import timezone django.utils.translation import ugettext_lazy _ class emailusermanager(baseusermanager): """custom manager emailuser.""" def _create_user(self, email, password, is_staff, is_superuser, **extra_fields): """create , save emailus...
Read more

c# - What is a good .Net RefEdit control to use with ExcelDna? -

-
i using exceldna , c# build suite of tools. part of forms i'd want user select cells/ranges workbook. i've got application.inputbox route working...but doesn't cool... i haven't read many things excel's refedit control, , see many have in past written workarounds, in (shudder) vba or vb.net. however, none of these seem recent... best approach/control refedit functionality on form run via exceldna (if applicable)? the refedit sample project of github explores different ways of dealing threading when showing form excel add-in, main issue making refedit control .net add-in. check page links various other implementations: https://github.com/excel-dna/exceldna/wiki/links-about-refedit
Read more