From borising at gmail.com Tue Jun 3 07:53:09 2014
From: borising at gmail.com (Bo Agerskov Rising)
Date: Tue, 03 Jun 2014 09:53:09 +0200
Subject: [Reconnoiter-devel] counter_dev
In-Reply-To:
References: <5307C1E3.5080300@gmail.com>
<5309CC99.5000404@gmail.com>
<5362C5D4.4000701@gmail.com> <53856D44.3070608@gmail.com>
Message-ID: <538D7EE5.7000808@gmail.com>
Hi Theo,
Thanks for the pointers :) Is stratcon.rollup_metric_numeric the correct
function to start with?
I have just migrated back to a 9.1.13 instance, and it now populates the
counter_dev column.
Regards,
Bo
Theo Schlossnagle wrote:
> print statements in the routines that do those calculations. That's where
> I'd start.
>
>
> On Wed, May 28, 2014 at 12:59 AM, Bo Agerskov Rising
> wrote:
>
>> Hi again,
>>
>> After experimenting with upgrading from 8.4 -> 9.0 -> 9.1 -> 9.2 -> 9.3,
>> I experienced a breaking change when you upgrade to 9.2, where the
>> counter_dev will not update anymore.
>>
>> Then I made a pg_dumpall of my prod system, running on 9.3.2, and
>> imported it again into an 9.1.13 test system, and after running the
>> rollup script it began to populate the counter_dev again.
>>
>> Any hints to where in the code, one should troubleshoot this issue?
>>
>> Regards,
>> Bo
>>
>> Bo Agerskov Rising wrote:
>>> Just spinned up a postgresql 8.4.17 instance in my testlab, and tested
>>> with the same data coming into my prod 9.3 system, and now the
>>> counter_dev column get's updated properly.
>>>
>>> So it seems to me, that the issue is to be found in version 9.x.
>>>
>>> Regards,
>>> Bo
>>>
>>> Theo Schlossnagle wrote:
>>>> Any time the counter field varies over time you should see a deviation
>>>> over a containing time window) that is non-zero.
>>>>
>>>> e.g. if you looking in the 5m tables and see counters changing, you
>>>> should see a non-zero deviation in the 20m table.
>>>>
>>>> If you're seeing zeros everywhere, something is wrong -- maybe the code
>>>> is broken.
>>>>
>>>>
>>>> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising >>> > wrote:
>>>>
>>>> Hi Theo,
>>>>
>>>> Thanks for the explanation of the counter_dev field.
>>>>
>>>> In which situations, would I expect data in this field?
>>>>
>>>> Regards,
>>>> Bo
>>>>
>>>> Theo Schlossnagle wrote:
>>>> > IIRC, counter_dev should be the standard deviation of counter
>>>> calculations.
>>>> >
>>>> > There are already rollups in the database. If you were to write
>>>> custom
>>>> > aggregations funtions you'd need to write those yourself in
>>>> PL/pgsql to
>>>> > run over the arrays in those tables. (summing or whatever).
>>>> >
>>>> >
>>>> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising
>>>>
>>>> > >> wrote:
>>>> >
>>>> > Hi guys,
>>>> >
>>>> > I was wondering whats the idea behind the counter_dev field,
>>>> when you
>>>> > question the stratcon.fetch_dataset function? I can't really
>>>> find any
>>>> > uuid's that uses this field yet, neither any really good
>>>> explanations in
>>>> > the code that explains it in plain layman terms :)
>>>> >
>>>> > Also I am working on making a summarizing function in the UI,
>>>> which
>>>> > would sum the values of a metric hourly, weekly and so forth,
>>>> and was
>>>> > wondering which fields in the DB schema that I would use for
>> that?
>>>> >
>>>> > Regards,
>>>> > Bo
>>>> > _______________________________________________
>>>> > Reconnoiter-devel mailing list
>>>> > Reconnoiter-devel at lists.omniti.com
>>>>
>>>> > >>> >
>>>> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> >
>>>> > Theo Schlossnagle
>>>> >
>>>> > http://omniti.com/is/theo-schlossnagle
>>>> >
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Theo Schlossnagle
>>>>
>>>> http://omniti.com/is/theo-schlossnagle
>>>>
>
>
>
From michal at taborsky.cz Mon Jun 9 08:59:15 2014
From: michal at taborsky.cz (Michal Taborsky)
Date: Mon, 9 Jun 2014 10:59:15 +0200
Subject: [Reconnoiter-devel] counter_dev
In-Reply-To: <538D7EE5.7000808@gmail.com>
References: <5307C1E3.5080300@gmail.com>
<5309CC99.5000404@gmail.com>
<5362C5D4.4000701@gmail.com> <53856D44.3070608@gmail.com>
<538D7EE5.7000808@gmail.com>
Message-ID:
Hi Bo,
I upgraded to 9.3, ran into the same problem. Here is the fix:
https://github.com/circonus-labs/reconnoiter/pull/203
Michal
2014-06-03 9:53 GMT+02:00 Bo Agerskov Rising :
> Hi Theo,
>
> Thanks for the pointers :) Is stratcon.rollup_metric_numeric the correct
> function to start with?
>
> I have just migrated back to a 9.1.13 instance, and it now populates the
> counter_dev column.
>
> Regards,
> Bo
>
> Theo Schlossnagle wrote:
> > print statements in the routines that do those calculations. That's
> where
> > I'd start.
> >
> >
> > On Wed, May 28, 2014 at 12:59 AM, Bo Agerskov Rising >
> > wrote:
> >
> >> Hi again,
> >>
> >> After experimenting with upgrading from 8.4 -> 9.0 -> 9.1 -> 9.2 -> 9.3,
> >> I experienced a breaking change when you upgrade to 9.2, where the
> >> counter_dev will not update anymore.
> >>
> >> Then I made a pg_dumpall of my prod system, running on 9.3.2, and
> >> imported it again into an 9.1.13 test system, and after running the
> >> rollup script it began to populate the counter_dev again.
> >>
> >> Any hints to where in the code, one should troubleshoot this issue?
> >>
> >> Regards,
> >> Bo
> >>
> >> Bo Agerskov Rising wrote:
> >>> Just spinned up a postgresql 8.4.17 instance in my testlab, and tested
> >>> with the same data coming into my prod 9.3 system, and now the
> >>> counter_dev column get's updated properly.
> >>>
> >>> So it seems to me, that the issue is to be found in version 9.x.
> >>>
> >>> Regards,
> >>> Bo
> >>>
> >>> Theo Schlossnagle wrote:
> >>>> Any time the counter field varies over time you should see a deviation
> >>>> over a containing time window) that is non-zero.
> >>>>
> >>>> e.g. if you looking in the 5m tables and see counters changing, you
> >>>> should see a non-zero deviation in the 20m table.
> >>>>
> >>>> If you're seeing zeros everywhere, something is wrong -- maybe the
> code
> >>>> is broken.
> >>>>
> >>>>
> >>>> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising <
> borising at gmail.com
> >>>> > wrote:
> >>>>
> >>>> Hi Theo,
> >>>>
> >>>> Thanks for the explanation of the counter_dev field.
> >>>>
> >>>> In which situations, would I expect data in this field?
> >>>>
> >>>> Regards,
> >>>> Bo
> >>>>
> >>>> Theo Schlossnagle wrote:
> >>>> > IIRC, counter_dev should be the standard deviation of counter
> >>>> calculations.
> >>>> >
> >>>> > There are already rollups in the database. If you were to write
> >>>> custom
> >>>> > aggregations funtions you'd need to write those yourself in
> >>>> PL/pgsql to
> >>>> > run over the arrays in those tables. (summing or whatever).
> >>>> >
> >>>> >
> >>>> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising
> >>>>
> >>>> > >> wrote:
> >>>> >
> >>>> > Hi guys,
> >>>> >
> >>>> > I was wondering whats the idea behind the counter_dev field,
> >>>> when you
> >>>> > question the stratcon.fetch_dataset function? I can't really
> >>>> find any
> >>>> > uuid's that uses this field yet, neither any really good
> >>>> explanations in
> >>>> > the code that explains it in plain layman terms :)
> >>>> >
> >>>> > Also I am working on making a summarizing function in the
> UI,
> >>>> which
> >>>> > would sum the values of a metric hourly, weekly and so
> forth,
> >>>> and was
> >>>> > wondering which fields in the DB schema that I would use for
> >> that?
> >>>> >
> >>>> > Regards,
> >>>> > Bo
> >>>> > _______________________________________________
> >>>> > Reconnoiter-devel mailing list
> >>>> > Reconnoiter-devel at lists.omniti.com
> >>>>
> >>>> > >>>> >
> >>>> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel
> >>>> >
> >>>> >
> >>>> >
> >>>> >
> >>>> > --
> >>>> >
> >>>> > Theo Schlossnagle
> >>>> >
> >>>> > http://omniti.com/is/theo-schlossnagle
> >>>> >
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>>
> >>>> Theo Schlossnagle
> >>>>
> >>>> http://omniti.com/is/theo-schlossnagle
> >>>>
> >
> >
> >
> _______________________________________________
> Reconnoiter-devel mailing list
> Reconnoiter-devel at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/reconnoiter-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
From borising at gmail.com Mon Jun 9 18:29:32 2014
From: borising at gmail.com (Bo Agerskov Rising)
Date: Mon, 09 Jun 2014 20:29:32 +0200
Subject: [Reconnoiter-devel] counter_dev
In-Reply-To:
References: <5307C1E3.5080300@gmail.com>
<5309CC99.5000404@gmail.com>
<5362C5D4.4000701@gmail.com> <53856D44.3070608@gmail.com>
<538D7EE5.7000808@gmail.com>
Message-ID: <5395FD0C.8090404@gmail.com>
Hi Michal,
Great! And thank you for the heads up :)
Regards,
Bo
Michal Taborsky wrote:
> Hi Bo,
>
> I upgraded to 9.3, ran into the same problem. Here is the fix:
> https://github.com/circonus-labs/reconnoiter/pull/203
>
> Michal
>
>
>
> 2014-06-03 9:53 GMT+02:00 Bo Agerskov Rising :
>
>> Hi Theo,
>>
>> Thanks for the pointers :) Is stratcon.rollup_metric_numeric the correct
>> function to start with?
>>
>> I have just migrated back to a 9.1.13 instance, and it now populates the
>> counter_dev column.
>>
>> Regards,
>> Bo
>>
>> Theo Schlossnagle wrote:
>>> print statements in the routines that do those calculations. That's
>> where
>>> I'd start.
>>>
>>>
>>> On Wed, May 28, 2014 at 12:59 AM, Bo Agerskov Rising >>
>>> wrote:
>>>
>>>> Hi again,
>>>>
>>>> After experimenting with upgrading from 8.4 -> 9.0 -> 9.1 -> 9.2 -> 9.3,
>>>> I experienced a breaking change when you upgrade to 9.2, where the
>>>> counter_dev will not update anymore.
>>>>
>>>> Then I made a pg_dumpall of my prod system, running on 9.3.2, and
>>>> imported it again into an 9.1.13 test system, and after running the
>>>> rollup script it began to populate the counter_dev again.
>>>>
>>>> Any hints to where in the code, one should troubleshoot this issue?
>>>>
>>>> Regards,
>>>> Bo
>>>>
>>>> Bo Agerskov Rising wrote:
>>>>> Just spinned up a postgresql 8.4.17 instance in my testlab, and tested
>>>>> with the same data coming into my prod 9.3 system, and now the
>>>>> counter_dev column get's updated properly.
>>>>>
>>>>> So it seems to me, that the issue is to be found in version 9.x.
>>>>>
>>>>> Regards,
>>>>> Bo
>>>>>
>>>>> Theo Schlossnagle wrote:
>>>>>> Any time the counter field varies over time you should see a deviation
>>>>>> over a containing time window) that is non-zero.
>>>>>>
>>>>>> e.g. if you looking in the 5m tables and see counters changing, you
>>>>>> should see a non-zero deviation in the 20m table.
>>>>>>
>>>>>> If you're seeing zeros everywhere, something is wrong -- maybe the
>> code
>>>>>> is broken.
>>>>>>
>>>>>>
>>>>>> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising <
>> borising at gmail.com
>>>>>> > wrote:
>>>>>>
>>>>>> Hi Theo,
>>>>>>
>>>>>> Thanks for the explanation of the counter_dev field.
>>>>>>
>>>>>> In which situations, would I expect data in this field?
>>>>>>
>>>>>> Regards,
>>>>>> Bo
>>>>>>
>>>>>> Theo Schlossnagle wrote:
>>>>>> > IIRC, counter_dev should be the standard deviation of counter
>>>>>> calculations.
>>>>>> >
>>>>>> > There are already rollups in the database. If you were to write
>>>>>> custom
>>>>>> > aggregations funtions you'd need to write those yourself in
>>>>>> PL/pgsql to
>>>>>> > run over the arrays in those tables. (summing or whatever).
>>>>>> >
>>>>>> >
>>>>>> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising
>>>>>>
>>>>>> > >> wrote:
>>>>>> >
>>>>>> > Hi guys,
>>>>>> >
>>>>>> > I was wondering whats the idea behind the counter_dev field,
>>>>>> when you
>>>>>> > question the stratcon.fetch_dataset function? I can't really
>>>>>> find any
>>>>>> > uuid's that uses this field yet, neither any really good
>>>>>> explanations in
>>>>>> > the code that explains it in plain layman terms :)
>>>>>> >
>>>>>> > Also I am working on making a summarizing function in the
>> UI,
>>>>>> which
>>>>>> > would sum the values of a metric hourly, weekly and so
>> forth,
>>>>>> and was
>>>>>> > wondering which fields in the DB schema that I would use for
>>>> that?
>>>>>> >
>>>>>> > Regards,
>>>>>> > Bo
>>>>>> > _______________________________________________
>>>>>> > Reconnoiter-devel mailing list
>>>>>> > Reconnoiter-devel at lists.omniti.com
>>>>>>
>>>>>> > >>>>> >
>>>>>> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> > --
>>>>>> >
>>>>>> > Theo Schlossnagle
>>>>>> >
>>>>>> > http://omniti.com/is/theo-schlossnagle
>>>>>> >
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Theo Schlossnagle
>>>>>>
>>>>>> http://omniti.com/is/theo-schlossnagle
>>>>>>
>>>
>>>
>> _______________________________________________
>> Reconnoiter-devel mailing list
>> Reconnoiter-devel at lists.omniti.com
>> http://lists.omniti.com/mailman/listinfo/reconnoiter-devel
>>
>
