From borising at gmail.com Tue Jun 3 07:53:09 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Tue, 03 Jun 2014 09:53:09 +0200 Subject: [Reconnoiter-devel] counter_dev In-Reply-To: References: <5307C1E3.5080300@gmail.com> <5309CC99.5000404@gmail.com> <5362C5D4.4000701@gmail.com> <53856D44.3070608@gmail.com> Message-ID: <538D7EE5.7000808@gmail.com> Hi Theo, Thanks for the pointers :) Is stratcon.rollup_metric_numeric the correct function to start with? I have just migrated back to a 9.1.13 instance, and it now populates the counter_dev column. Regards, Bo Theo Schlossnagle wrote: > print statements in the routines that do those calculations. That's where > I'd start. > > > On Wed, May 28, 2014 at 12:59 AM, Bo Agerskov Rising > wrote: > >> Hi again, >> >> After experimenting with upgrading from 8.4 -> 9.0 -> 9.1 -> 9.2 -> 9.3, >> I experienced a breaking change when you upgrade to 9.2, where the >> counter_dev will not update anymore. >> >> Then I made a pg_dumpall of my prod system, running on 9.3.2, and >> imported it again into an 9.1.13 test system, and after running the >> rollup script it began to populate the counter_dev again. >> >> Any hints to where in the code, one should troubleshoot this issue? >> >> Regards, >> Bo >> >> Bo Agerskov Rising wrote: >>> Just spinned up a postgresql 8.4.17 instance in my testlab, and tested >>> with the same data coming into my prod 9.3 system, and now the >>> counter_dev column get's updated properly. >>> >>> So it seems to me, that the issue is to be found in version 9.x. >>> >>> Regards, >>> Bo >>> >>> Theo Schlossnagle wrote: >>>> Any time the counter field varies over time you should see a deviation >>>> over a containing time window) that is non-zero. >>>> >>>> e.g. if you looking in the 5m tables and see counters changing, you >>>> should see a non-zero deviation in the 20m table. >>>> >>>> If you're seeing zeros everywhere, something is wrong -- maybe the code >>>> is broken. >>>> >>>> >>>> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising >>> > wrote: >>>> >>>> Hi Theo, >>>> >>>> Thanks for the explanation of the counter_dev field. >>>> >>>> In which situations, would I expect data in this field? >>>> >>>> Regards, >>>> Bo >>>> >>>> Theo Schlossnagle wrote: >>>> > IIRC, counter_dev should be the standard deviation of counter >>>> calculations. >>>> > >>>> > There are already rollups in the database. If you were to write >>>> custom >>>> > aggregations funtions you'd need to write those yourself in >>>> PL/pgsql to >>>> > run over the arrays in those tables. (summing or whatever). >>>> > >>>> > >>>> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising >>>> >>>> > >> wrote: >>>> > >>>> > Hi guys, >>>> > >>>> > I was wondering whats the idea behind the counter_dev field, >>>> when you >>>> > question the stratcon.fetch_dataset function? I can't really >>>> find any >>>> > uuid's that uses this field yet, neither any really good >>>> explanations in >>>> > the code that explains it in plain layman terms :) >>>> > >>>> > Also I am working on making a summarizing function in the UI, >>>> which >>>> > would sum the values of a metric hourly, weekly and so forth, >>>> and was >>>> > wondering which fields in the DB schema that I would use for >> that? >>>> > >>>> > Regards, >>>> > Bo >>>> > _______________________________________________ >>>> > Reconnoiter-devel mailing list >>>> > Reconnoiter-devel at lists.omniti.com >>>> >>>> > >>> > >>>> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel >>>> > >>>> > >>>> > >>>> > >>>> > -- >>>> > >>>> > Theo Schlossnagle >>>> > >>>> > http://omniti.com/is/theo-schlossnagle >>>> > >>>> >>>> >>>> >>>> >>>> -- >>>> >>>> Theo Schlossnagle >>>> >>>> http://omniti.com/is/theo-schlossnagle >>>> > > > From michal at taborsky.cz Mon Jun 9 08:59:15 2014 From: michal at taborsky.cz (Michal Taborsky) Date: Mon, 9 Jun 2014 10:59:15 +0200 Subject: [Reconnoiter-devel] counter_dev In-Reply-To: <538D7EE5.7000808@gmail.com> References: <5307C1E3.5080300@gmail.com> <5309CC99.5000404@gmail.com> <5362C5D4.4000701@gmail.com> <53856D44.3070608@gmail.com> <538D7EE5.7000808@gmail.com> Message-ID: Hi Bo, I upgraded to 9.3, ran into the same problem. Here is the fix: https://github.com/circonus-labs/reconnoiter/pull/203 Michal 2014-06-03 9:53 GMT+02:00 Bo Agerskov Rising : > Hi Theo, > > Thanks for the pointers :) Is stratcon.rollup_metric_numeric the correct > function to start with? > > I have just migrated back to a 9.1.13 instance, and it now populates the > counter_dev column. > > Regards, > Bo > > Theo Schlossnagle wrote: > > print statements in the routines that do those calculations. That's > where > > I'd start. > > > > > > On Wed, May 28, 2014 at 12:59 AM, Bo Agerskov Rising > > > wrote: > > > >> Hi again, > >> > >> After experimenting with upgrading from 8.4 -> 9.0 -> 9.1 -> 9.2 -> 9.3, > >> I experienced a breaking change when you upgrade to 9.2, where the > >> counter_dev will not update anymore. > >> > >> Then I made a pg_dumpall of my prod system, running on 9.3.2, and > >> imported it again into an 9.1.13 test system, and after running the > >> rollup script it began to populate the counter_dev again. > >> > >> Any hints to where in the code, one should troubleshoot this issue? > >> > >> Regards, > >> Bo > >> > >> Bo Agerskov Rising wrote: > >>> Just spinned up a postgresql 8.4.17 instance in my testlab, and tested > >>> with the same data coming into my prod 9.3 system, and now the > >>> counter_dev column get's updated properly. > >>> > >>> So it seems to me, that the issue is to be found in version 9.x. > >>> > >>> Regards, > >>> Bo > >>> > >>> Theo Schlossnagle wrote: > >>>> Any time the counter field varies over time you should see a deviation > >>>> over a containing time window) that is non-zero. > >>>> > >>>> e.g. if you looking in the 5m tables and see counters changing, you > >>>> should see a non-zero deviation in the 20m table. > >>>> > >>>> If you're seeing zeros everywhere, something is wrong -- maybe the > code > >>>> is broken. > >>>> > >>>> > >>>> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising < > borising at gmail.com > >>>> > wrote: > >>>> > >>>> Hi Theo, > >>>> > >>>> Thanks for the explanation of the counter_dev field. > >>>> > >>>> In which situations, would I expect data in this field? > >>>> > >>>> Regards, > >>>> Bo > >>>> > >>>> Theo Schlossnagle wrote: > >>>> > IIRC, counter_dev should be the standard deviation of counter > >>>> calculations. > >>>> > > >>>> > There are already rollups in the database. If you were to write > >>>> custom > >>>> > aggregations funtions you'd need to write those yourself in > >>>> PL/pgsql to > >>>> > run over the arrays in those tables. (summing or whatever). > >>>> > > >>>> > > >>>> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising > >>>> > >>>> > >> wrote: > >>>> > > >>>> > Hi guys, > >>>> > > >>>> > I was wondering whats the idea behind the counter_dev field, > >>>> when you > >>>> > question the stratcon.fetch_dataset function? I can't really > >>>> find any > >>>> > uuid's that uses this field yet, neither any really good > >>>> explanations in > >>>> > the code that explains it in plain layman terms :) > >>>> > > >>>> > Also I am working on making a summarizing function in the > UI, > >>>> which > >>>> > would sum the values of a metric hourly, weekly and so > forth, > >>>> and was > >>>> > wondering which fields in the DB schema that I would use for > >> that? > >>>> > > >>>> > Regards, > >>>> > Bo > >>>> > _______________________________________________ > >>>> > Reconnoiter-devel mailing list > >>>> > Reconnoiter-devel at lists.omniti.com > >>>> > >>>> > >>>> > > >>>> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > >>>> > > >>>> > > >>>> > > >>>> > > >>>> > -- > >>>> > > >>>> > Theo Schlossnagle > >>>> > > >>>> > http://omniti.com/is/theo-schlossnagle > >>>> > > >>>> > >>>> > >>>> > >>>> > >>>> -- > >>>> > >>>> Theo Schlossnagle > >>>> > >>>> http://omniti.com/is/theo-schlossnagle > >>>> > > > > > > > _______________________________________________ > Reconnoiter-devel mailing list > Reconnoiter-devel at lists.omniti.com > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Mon Jun 9 18:29:32 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Mon, 09 Jun 2014 20:29:32 +0200 Subject: [Reconnoiter-devel] counter_dev In-Reply-To: References: <5307C1E3.5080300@gmail.com> <5309CC99.5000404@gmail.com> <5362C5D4.4000701@gmail.com> <53856D44.3070608@gmail.com> <538D7EE5.7000808@gmail.com> Message-ID: <5395FD0C.8090404@gmail.com> Hi Michal, Great! And thank you for the heads up :) Regards, Bo Michal Taborsky wrote: > Hi Bo, > > I upgraded to 9.3, ran into the same problem. Here is the fix: > https://github.com/circonus-labs/reconnoiter/pull/203 > > Michal > > > > 2014-06-03 9:53 GMT+02:00 Bo Agerskov Rising : > >> Hi Theo, >> >> Thanks for the pointers :) Is stratcon.rollup_metric_numeric the correct >> function to start with? >> >> I have just migrated back to a 9.1.13 instance, and it now populates the >> counter_dev column. >> >> Regards, >> Bo >> >> Theo Schlossnagle wrote: >>> print statements in the routines that do those calculations. That's >> where >>> I'd start. >>> >>> >>> On Wed, May 28, 2014 at 12:59 AM, Bo Agerskov Rising >> >>> wrote: >>> >>>> Hi again, >>>> >>>> After experimenting with upgrading from 8.4 -> 9.0 -> 9.1 -> 9.2 -> 9.3, >>>> I experienced a breaking change when you upgrade to 9.2, where the >>>> counter_dev will not update anymore. >>>> >>>> Then I made a pg_dumpall of my prod system, running on 9.3.2, and >>>> imported it again into an 9.1.13 test system, and after running the >>>> rollup script it began to populate the counter_dev again. >>>> >>>> Any hints to where in the code, one should troubleshoot this issue? >>>> >>>> Regards, >>>> Bo >>>> >>>> Bo Agerskov Rising wrote: >>>>> Just spinned up a postgresql 8.4.17 instance in my testlab, and tested >>>>> with the same data coming into my prod 9.3 system, and now the >>>>> counter_dev column get's updated properly. >>>>> >>>>> So it seems to me, that the issue is to be found in version 9.x. >>>>> >>>>> Regards, >>>>> Bo >>>>> >>>>> Theo Schlossnagle wrote: >>>>>> Any time the counter field varies over time you should see a deviation >>>>>> over a containing time window) that is non-zero. >>>>>> >>>>>> e.g. if you looking in the 5m tables and see counters changing, you >>>>>> should see a non-zero deviation in the 20m table. >>>>>> >>>>>> If you're seeing zeros everywhere, something is wrong -- maybe the >> code >>>>>> is broken. >>>>>> >>>>>> >>>>>> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising < >> borising at gmail.com >>>>>> > wrote: >>>>>> >>>>>> Hi Theo, >>>>>> >>>>>> Thanks for the explanation of the counter_dev field. >>>>>> >>>>>> In which situations, would I expect data in this field? >>>>>> >>>>>> Regards, >>>>>> Bo >>>>>> >>>>>> Theo Schlossnagle wrote: >>>>>> > IIRC, counter_dev should be the standard deviation of counter >>>>>> calculations. >>>>>> > >>>>>> > There are already rollups in the database. If you were to write >>>>>> custom >>>>>> > aggregations funtions you'd need to write those yourself in >>>>>> PL/pgsql to >>>>>> > run over the arrays in those tables. (summing or whatever). >>>>>> > >>>>>> > >>>>>> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising >>>>>> >>>>>> > >> wrote: >>>>>> > >>>>>> > Hi guys, >>>>>> > >>>>>> > I was wondering whats the idea behind the counter_dev field, >>>>>> when you >>>>>> > question the stratcon.fetch_dataset function? I can't really >>>>>> find any >>>>>> > uuid's that uses this field yet, neither any really good >>>>>> explanations in >>>>>> > the code that explains it in plain layman terms :) >>>>>> > >>>>>> > Also I am working on making a summarizing function in the >> UI, >>>>>> which >>>>>> > would sum the values of a metric hourly, weekly and so >> forth, >>>>>> and was >>>>>> > wondering which fields in the DB schema that I would use for >>>> that? >>>>>> > >>>>>> > Regards, >>>>>> > Bo >>>>>> > _______________________________________________ >>>>>> > Reconnoiter-devel mailing list >>>>>> > Reconnoiter-devel at lists.omniti.com >>>>>> >>>>>> > >>>>> > >>>>>> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel >>>>>> > >>>>>> > >>>>>> > >>>>>> > >>>>>> > -- >>>>>> > >>>>>> > Theo Schlossnagle >>>>>> > >>>>>> > http://omniti.com/is/theo-schlossnagle >>>>>> > >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Theo Schlossnagle >>>>>> >>>>>> http://omniti.com/is/theo-schlossnagle >>>>>> >>> >>> >> _______________________________________________ >> Reconnoiter-devel mailing list >> Reconnoiter-devel at lists.omniti.com >> http://lists.omniti.com/mailman/listinfo/reconnoiter-devel >> >