From borising at gmail.com Mon Mar 17 22:55:12 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Mon, 17 Mar 2014 23:55:12 +0100 Subject: [Reconnoiter-devel] counter_dev In-Reply-To: References: <5307C1E3.5080300@gmail.com> <5309CC99.5000404@gmail.com> Message-ID: <53277D50.8070705@gmail.com> Hi Theo, Have had some thoughts about this, and took some samples. Where I see counters changing in the 5m rollup, I only see NULL values in the counter_dev for the 20m rollup for the same metric. So maybe something is wrong? Are there anything I can do to troubleshoot this somehow? Query: select counter_dev from noit.metric_numeric_rollup_20m where sid='1' AND name='feed`de01-stratcon`last_connection_ms'; Result: [0:504]={NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,N ULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NU LL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NUL L,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL ,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL, NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,N ULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NU LL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NUL L,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL ,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL, NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,N ULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NU LL} Theo Schlossnagle wrote: > Any time the counter field varies over time you should see a deviation > over a containing time window) that is non-zero. > > e.g. if you looking in the 5m tables and see counters changing, you > should see a non-zero deviation in the 20m table. > > If you're seeing zeros everywhere, something is wrong -- maybe the code > is broken. > > > On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising > wrote: > > Hi Theo, > > Thanks for the explanation of the counter_dev field. > > In which situations, would I expect data in this field? > > Regards, > Bo > > Theo Schlossnagle wrote: > > IIRC, counter_dev should be the standard deviation of counter > calculations. > > > > There are already rollups in the database. If you were to write > custom > > aggregations funtions you'd need to write those yourself in > PL/pgsql to > > run over the arrays in those tables. (summing or whatever). > > > > > > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising > > > >> wrote: > > > > Hi guys, > > > > I was wondering whats the idea behind the counter_dev field, > when you > > question the stratcon.fetch_dataset function? I can't really > find any > > uuid's that uses this field yet, neither any really good > explanations in > > the code that explains it in plain layman terms :) > > > > Also I am working on making a summarizing function in the UI, > which > > would sum the values of a metric hourly, weekly and so forth, > and was > > wondering which fields in the DB schema that I would use for that? > > > > Regards, > > Bo > > _______________________________________________ > > Reconnoiter-devel mailing list > > Reconnoiter-devel at lists.omniti.com > > > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > -- > > Theo Schlossnagle > > http://omniti.com/is/theo-schlossnagle >