From borising at gmail.com Tue Apr 29 05:53:58 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Tue, 29 Apr 2014 07:53:58 +0200 Subject: [Reconnoiter-devel] SNMP Counter32 overflow Message-ID: <535F3E76.8050608@gmail.com> Hi all, I have some HP 1810 switches with 1G interfaces, which I monitor with SNMP. The problem is that these switches only support Counter32 values, and as such the counters quickly overflow when they run at max speed. I was wondering if anything could be done inside reconnoiter to accommodate for this? Or perhaps something smart source math inside the UI? :) Have any run into the same issue? Thanks in advance Bo From jesus at omniti.com Tue Apr 29 13:40:23 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Tue, 29 Apr 2014 15:40:23 +0200 Subject: [Reconnoiter-devel] SNMP Counter32 overflow In-Reply-To: <535F3E76.8050608@gmail.com> References: <535F3E76.8050608@gmail.com> Message-ID: Reconnoiter already should completely accommodate this (in the DB). The difference between the "derive" and "counter" types acknowledge rollover. "counter" is the rate of change assuming a monotonically increasing source, so if the source sample a T1 is of lesser value than the sample at T0, the rate of change during that time interval is ignored for the purposes of calculating the rate. If your interface is rolling the Counter32 too quickly, just up the frequency of the check for that interface to every second and you should get fairly accurate numbers. On Tue, Apr 29, 2014 at 7:53 AM, Bo Agerskov Rising wrote: > Hi all, > > I have some HP 1810 switches with 1G interfaces, which I monitor with > SNMP. The problem is that these switches only support Counter32 values, > and as such the counters quickly overflow when they run at max speed. > > I was wondering if anything could be done inside reconnoiter to > accommodate for this? Or perhaps something smart source math inside the > UI? :) > > Have any run into the same issue? > > Thanks in advance > Bo > _______________________________________________ > Reconnoiter-devel mailing list > Reconnoiter-devel at lists.omniti.com > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > -- Theo Schlossnagle http://omniti.com/is/theo-schlossnagle -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Tue Apr 29 19:55:09 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Tue, 29 Apr 2014 21:55:09 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? Message-ID: <5360039D.1070908@gmail.com> Hi, Would it be possible for 2 stratcon's to subscribe to 1 noit? It would be nice getting the ability to feed a production and a test environment, with the same live data. Regards, Bo From jesus at omniti.com Tue Apr 29 20:07:33 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Tue, 29 Apr 2014 22:07:33 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: <5360039D.1070908@gmail.com> References: <5360039D.1070908@gmail.com> Message-ID: Yes it is. Make sure they have different CNs (in their SSL certs). A valid signed cert will connect and establish a new subscriber. Keep in mind that if it goes away, the noitd will continue to queue all message for that node until ti comes back.. If you don't want this, you'll want to use the noitd's "GET /feed" API and "DELETE /feed/" API to find and move the subscriber if you intend to not use it and don't want backlogged information. On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising wrote: > Hi, > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > It would be nice getting the ability to feed a production and a test > environment, with the same live data. > > Regards, > Bo > _______________________________________________ > Reconnoiter-devel mailing list > Reconnoiter-devel at lists.omniti.com > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > -- Theo Schlossnagle http://omniti.com/is/theo-schlossnagle -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Wed Apr 30 10:44:13 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 12:44:13 +0200 Subject: [Reconnoiter-devel] counter_dev In-Reply-To: <53277D50.8070705@gmail.com> References: <5307C1E3.5080300@gmail.com> <5309CC99.5000404@gmail.com> <53277D50.8070705@gmail.com> Message-ID: <5360D3FD.60206@gmail.com> Hi again, Still having this issue, and was wondering if it would help if I migrated the rollup tables to a new db? And would it even work to only move those tables? Regards, Bo Bo Agerskov Rising wrote: > Hi Theo, > > Have had some thoughts about this, and took some samples. > > Where I see counters changing in the 5m rollup, I only see NULL values > in the counter_dev for the 20m rollup for the same metric. > > So maybe something is wrong? > > Are there anything I can do to troubleshoot this somehow? > > Query: > select counter_dev from noit.metric_numeric_rollup_20m where sid='1' AND > name='feed`de01-stratcon`last_connection_ms'; > > Result: > [0:504]={NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,N > ULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NU > LL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NUL > L,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL > ,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL, > NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,N > ULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NU > LL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NUL > L,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL > ,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL, > NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,N > ULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NU > LL} > > > > Theo Schlossnagle wrote: >> Any time the counter field varies over time you should see a deviation >> over a containing time window) that is non-zero. >> >> e.g. if you looking in the 5m tables and see counters changing, you >> should see a non-zero deviation in the 20m table. >> >> If you're seeing zeros everywhere, something is wrong -- maybe the code >> is broken. >> >> >> On Sun, Feb 23, 2014 at 2:25 AM, Bo Agerskov Rising > > wrote: >> >> Hi Theo, >> >> Thanks for the explanation of the counter_dev field. >> >> In which situations, would I expect data in this field? >> >> Regards, >> Bo >> >> Theo Schlossnagle wrote: >> > IIRC, counter_dev should be the standard deviation of counter >> calculations. >> > >> > There are already rollups in the database. If you were to write >> custom >> > aggregations funtions you'd need to write those yourself in >> PL/pgsql to >> > run over the arrays in those tables. (summing or whatever). >> > >> > >> > On Fri, Feb 21, 2014 at 1:15 PM, Bo Agerskov Rising >> >> > >> wrote: >> > >> > Hi guys, >> > >> > I was wondering whats the idea behind the counter_dev field, >> when you >> > question the stratcon.fetch_dataset function? I can't really >> find any >> > uuid's that uses this field yet, neither any really good >> explanations in >> > the code that explains it in plain layman terms :) >> > >> > Also I am working on making a summarizing function in the UI, >> which >> > would sum the values of a metric hourly, weekly and so forth, >> and was >> > wondering which fields in the DB schema that I would use for that? >> > >> > Regards, >> > Bo >> > _______________________________________________ >> > Reconnoiter-devel mailing list >> > Reconnoiter-devel at lists.omniti.com >> >> > > > >> > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel >> > >> > >> > >> > >> > -- >> > >> > Theo Schlossnagle >> > >> > http://omniti.com/is/theo-schlossnagle >> > >> >> >> >> >> -- >> >> Theo Schlossnagle >> >> http://omniti.com/is/theo-schlossnagle >> From borising at gmail.com Wed Apr 30 10:45:39 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 12:45:39 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: References: <5360039D.1070908@gmail.com> Message-ID: <5360D453.10403@gmail.com> Great, thank you for the quick reply! Are there any limitations in doing this? Regards, Bo Theo Schlossnagle wrote: > Yes it is. Make sure they have different CNs (in their SSL certs). A > valid signed cert will connect and establish a new subscriber. Keep in > mind that if it goes away, the noitd will continue to queue all message > for that node until ti comes back.. If you don't want this, you'll want > to use the noitd's "GET /feed" API and "DELETE /feed/" API to > find and move the subscriber if you intend to not use it and don't want > backlogged information. > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > wrote: > > Hi, > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > It would be nice getting the ability to feed a production and a test > environment, with the same live data. > > Regards, > Bo > _______________________________________________ > Reconnoiter-devel mailing list > Reconnoiter-devel at lists.omniti.com > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > -- > > Theo Schlossnagle > > http://omniti.com/is/theo-schlossnagle > From borising at gmail.com Wed Apr 30 10:56:28 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 12:56:28 +0200 Subject: [Reconnoiter-devel] SNMP Counter32 overflow In-Reply-To: <53600184.6010207@gmail.com> References: <535F3E76.8050608@gmail.com> <53600184.6010207@gmail.com> Message-ID: <5360D6DC.3030705@gmail.com> Hi, I am still getting the same amount of overflows, as I had before changing the period from 60000 to 1000. Do you think that my other issue with missing counter_dev values, be having any effect on this? Regards, Bo Bo Agerskov Rising wrote: > Hi Theo, > > Until now I had used the default 60s period, will try out setting it to > 1s for the interfaces that are problematic. > > Thanks :) > > Regards, > Bo > > Theo Schlossnagle wrote: >> Reconnoiter already should completely accommodate this (in the DB). The >> difference between the "derive" and "counter" types acknowledge >> rollover. "counter" is the rate of change assuming a monotonically >> increasing source, so if the source sample a T1 is of lesser value than >> the sample at T0, the rate of change during that time interval is >> ignored for the purposes of calculating the rate. >> >> If your interface is rolling the Counter32 too quickly, just up the >> frequency of the check for that interface to every second and you should >> get fairly accurate numbers. >> >> >> On Tue, Apr 29, 2014 at 7:53 AM, Bo Agerskov Rising > > wrote: >> >> Hi all, >> >> I have some HP 1810 switches with 1G interfaces, which I monitor with >> SNMP. The problem is that these switches only support Counter32 values, >> and as such the counters quickly overflow when they run at max speed. >> >> I was wondering if anything could be done inside reconnoiter to >> accommodate for this? Or perhaps something smart source math inside the >> UI? :) >> >> Have any run into the same issue? >> >> Thanks in advance >> Bo >> _______________________________________________ >> Reconnoiter-devel mailing list >> Reconnoiter-devel at lists.omniti.com >> >> http://lists.omniti.com/mailman/listinfo/reconnoiter-devel >> >> >> >> >> -- >> >> Theo Schlossnagle >> >> http://omniti.com/is/theo-schlossnagle >> From jesus at omniti.com Wed Apr 30 12:29:40 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Wed, 30 Apr 2014 14:29:40 +0200 Subject: [Reconnoiter-devel] SNMP Counter32 overflow In-Reply-To: <5360D6DC.3030705@gmail.com> References: <535F3E76.8050608@gmail.com> <53600184.6010207@gmail.com> <5360D6DC.3030705@gmail.com> Message-ID: No, counter should accommodate for this exact situation. We have counters roll ask the time here and things seem to work fine. On Apr 30, 2014 6:56 AM, "Bo Agerskov Rising" wrote: > Hi, > > I am still getting the same amount of overflows, as I had before > changing the period from 60000 to 1000. > > Do you think that my other issue with missing counter_dev values, be > having any effect on this? > > Regards, > Bo > > Bo Agerskov Rising wrote: > > Hi Theo, > > > > Until now I had used the default 60s period, will try out setting it to > > 1s for the interfaces that are problematic. > > > > Thanks :) > > > > Regards, > > Bo > > > > Theo Schlossnagle wrote: > >> Reconnoiter already should completely accommodate this (in the DB). The > >> difference between the "derive" and "counter" types acknowledge > >> rollover. "counter" is the rate of change assuming a monotonically > >> increasing source, so if the source sample a T1 is of lesser value than > >> the sample at T0, the rate of change during that time interval is > >> ignored for the purposes of calculating the rate. > >> > >> If your interface is rolling the Counter32 too quickly, just up the > >> frequency of the check for that interface to every second and you should > >> get fairly accurate numbers. > >> > >> > >> On Tue, Apr 29, 2014 at 7:53 AM, Bo Agerskov Rising >> > wrote: > >> > >> Hi all, > >> > >> I have some HP 1810 switches with 1G interfaces, which I monitor > with > >> SNMP. The problem is that these switches only support Counter32 > values, > >> and as such the counters quickly overflow when they run at max > speed. > >> > >> I was wondering if anything could be done inside reconnoiter to > >> accommodate for this? Or perhaps something smart source math inside > the > >> UI? :) > >> > >> Have any run into the same issue? > >> > >> Thanks in advance > >> Bo > >> _______________________________________________ > >> Reconnoiter-devel mailing list > >> Reconnoiter-devel at lists.omniti.com > >> > >> http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > >> > >> > >> > >> > >> -- > >> > >> Theo Schlossnagle > >> > >> http://omniti.com/is/theo-schlossnagle > >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jesus at omniti.com Wed Apr 30 12:30:55 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Wed, 30 Apr 2014 14:30:55 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: <5360D453.10403@gmail.com> References: <5360039D.1070908@gmail.com> <5360D453.10403@gmail.com> Message-ID: Other than those already described, no. We use this to do active-active datacenters. On Apr 30, 2014 6:45 AM, "Bo Agerskov Rising" wrote: > Great, thank you for the quick reply! > > Are there any limitations in doing this? > > Regards, > Bo > > Theo Schlossnagle wrote: > > Yes it is. Make sure they have different CNs (in their SSL certs). A > > valid signed cert will connect and establish a new subscriber. Keep in > > mind that if it goes away, the noitd will continue to queue all message > > for that node until ti comes back.. If you don't want this, you'll want > > to use the noitd's "GET /feed" API and "DELETE /feed/" API to > > find and move the subscriber if you intend to not use it and don't want > > backlogged information. > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > wrote: > > > > Hi, > > > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > > > It would be nice getting the ability to feed a production and a test > > environment, with the same live data. > > > > Regards, > > Bo > > _______________________________________________ > > Reconnoiter-devel mailing list > > Reconnoiter-devel at lists.omniti.com > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Wed Apr 30 12:43:36 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 14:43:36 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: References: <5360039D.1070908@gmail.com> <5360D453.10403@gmail.com> Message-ID: <5360EFF8.7080002@gmail.com> Talking about redundancy, any thoughts of how I could loadbalance the noit? Regards, Bo Theo Schlossnagle wrote: > Other than those already described, no. We use this to do active-active > datacenters. > > On Apr 30, 2014 6:45 AM, "Bo Agerskov Rising" > wrote: > > Great, thank you for the quick reply! > > Are there any limitations in doing this? > > Regards, > Bo > > Theo Schlossnagle wrote: > > Yes it is. Make sure they have different CNs (in their SSL certs). A > > valid signed cert will connect and establish a new subscriber. > Keep in > > mind that if it goes away, the noitd will continue to queue all > message > > for that node until ti comes back.. If you don't want this, you'll > want > > to use the noitd's "GET /feed" API and "DELETE /feed/" > API to > > find and move the subscriber if you intend to not use it and don't > want > > backlogged information. > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > > >> wrote: > > > > Hi, > > > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > > > It would be nice getting the ability to feed a production and > a test > > environment, with the same live data. > > > > Regards, > > Bo > > _______________________________________________ > > Reconnoiter-devel mailing list > > Reconnoiter-devel at lists.omniti.com > > > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > From jesus at omniti.com Wed Apr 30 12:46:30 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Wed, 30 Apr 2014 14:46:30 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: <5360EFF8.7080002@gmail.com> References: <5360039D.1070908@gmail.com> <5360D453.10403@gmail.com> <5360EFF8.7080002@gmail.com> Message-ID: Load balancing: We do that but putting some checks on one and some on another. Redundancy: Noitd doesn't currently support hot standby itself, you'd have to do that on a systems level. On Apr 30, 2014 8:43 AM, "Bo Agerskov Rising" wrote: > Talking about redundancy, any thoughts of how I could loadbalance the noit? > > Regards, > Bo > > Theo Schlossnagle wrote: > > Other than those already described, no. We use this to do active-active > > datacenters. > > > > On Apr 30, 2014 6:45 AM, "Bo Agerskov Rising" > > wrote: > > > > Great, thank you for the quick reply! > > > > Are there any limitations in doing this? > > > > Regards, > > Bo > > > > Theo Schlossnagle wrote: > > > Yes it is. Make sure they have different CNs (in their SSL > certs). A > > > valid signed cert will connect and establish a new subscriber. > > Keep in > > > mind that if it goes away, the noitd will continue to queue all > > message > > > for that node until ti comes back.. If you don't want this, you'll > > want > > > to use the noitd's "GET /feed" API and "DELETE /feed/" > > API to > > > find and move the subscriber if you intend to not use it and don't > > want > > > backlogged information. > > > > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > > > > >> wrote: > > > > > > Hi, > > > > > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > > > > > It would be nice getting the ability to feed a production and > > a test > > > environment, with the same live data. > > > > > > Regards, > > > Bo > > > _______________________________________________ > > > Reconnoiter-devel mailing list > > > Reconnoiter-devel at lists.omniti.com > > > > > > > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > > > > > > -- > > > > > > Theo Schlossnagle > > > > > > http://omniti.com/is/theo-schlossnagle > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Wed Apr 30 20:25:04 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 22:25:04 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: References: <5360039D.1070908@gmail.com> Message-ID: <53615C20.9090809@gmail.com> Hi Theo, After connecting a second stratcon to my noit, I get the following error in the test stratcon log (dk01-stratcon): [2014-04-30 22:12:54.039152] [error] [xxx.yyy.xxx.yyy:43191] [de01] jlog reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER This is the config from the noit: And the result when querying the API: de01-stratcon ~0000006 I remember when I initially configured the noit, that I had to change the conf from using /var/log/noitd.feed(stratcon) to /var/log/noitd.feed(de01-stratcon), before the noit wanted to have anything to do with the prod stratcon, which has the CN name of 'de01-stratcon'. Any ideas to whats wrong? Regards, Bo Theo Schlossnagle wrote: > Yes it is. Make sure they have different CNs (in their SSL certs). A > valid signed cert will connect and establish a new subscriber. Keep in > mind that if it goes away, the noitd will continue to queue all message > for that node until ti comes back.. If you don't want this, you'll want > to use the noitd's "GET /feed" API and "DELETE /feed/" API to > find and move the subscriber if you intend to not use it and don't want > backlogged information. > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > wrote: > > Hi, > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > It would be nice getting the ability to feed a production and a test > environment, with the same live data. > > Regards, > Bo > _______________________________________________ > Reconnoiter-devel mailing list > Reconnoiter-devel at lists.omniti.com > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > -- > > Theo Schlossnagle > > http://omniti.com/is/theo-schlossnagle > From jesus at omniti.com Wed Apr 30 20:37:26 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Wed, 30 Apr 2014 16:37:26 -0400 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: <53615C20.9090809@gmail.com> References: <5360039D.1070908@gmail.com> <53615C20.9090809@gmail.com> Message-ID: You want just one of feed log that looks like: On Wed, Apr 30, 2014 at 4:25 PM, Bo Agerskov Rising wrote: > Hi Theo, > > After connecting a second stratcon to my noit, I get the following error > in the test stratcon log (dk01-stratcon): > > [2014-04-30 22:12:54.039152] [error] [xxx.yyy.xxx.yyy:43191] [de01] jlog > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > > This is the config from the noit: > > path="/var/log/noitd.feed(de01-stratcon)"/> > path="/var/log/noitd.feed(dk01-stratcon)"/> > > > And the result when querying the API: > > > > de01-stratcon > ~0000006 > > > > I remember when I initially configured the noit, that I had to change > the conf from using /var/log/noitd.feed(stratcon) to > /var/log/noitd.feed(de01-stratcon), before the noit wanted to have > anything to do with the prod stratcon, which has the CN name of > 'de01-stratcon'. > > Any ideas to whats wrong? > > Regards, > Bo > > Theo Schlossnagle wrote: > > Yes it is. Make sure they have different CNs (in their SSL certs). A > > valid signed cert will connect and establish a new subscriber. Keep in > > mind that if it goes away, the noitd will continue to queue all message > > for that node until ti comes back.. If you don't want this, you'll want > > to use the noitd's "GET /feed" API and "DELETE /feed/" API to > > find and move the subscriber if you intend to not use it and don't want > > backlogged information. > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > wrote: > > > > Hi, > > > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > > > It would be nice getting the ability to feed a production and a test > > environment, with the same live data. > > > > Regards, > > Bo > > _______________________________________________ > > Reconnoiter-devel mailing list > > Reconnoiter-devel at lists.omniti.com > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > -- Theo Schlossnagle http://omniti.com/is/theo-schlossnagle -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Wed Apr 30 20:52:22 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 22:52:22 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: References: <5360039D.1070908@gmail.com> <53615C20.9090809@gmail.com> Message-ID: <53616286.2060705@gmail.com> Hmm, after changing that setting, I get the following: ~0000003 de01-stratcon ~0000001 And still getting the following in the test stratcon: [2014-04-30 22:49:07.853431] [error] [xxx.yyy.xxx.yyy:43191] [de01] jlog reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER [2014-04-30 22:49:07.853541] [debug] Next jlog_streamer attempt in 15000ms [2014-04-30 22:49:08.096118] [debug] Pushing transient/iep batch async [144.76.81.4:43191] [de01]: [27553/2204] [2014-04-30 22:49:08.096244] [debug] Pushing transient/iep checkpoint [144.76.81.4:43191] [de01]: [27553/2204] [2014-04-30 22:49:08.151252] [debug] Pushing transient/iep batch async [192.168.87.14:43191] [dk01]: [2284/95] [2014-04-30 22:49:08.151372] [debug] Pushing transient/iep checkpoint [192.168.87.14:43191] [dk01]: [2284/95] I don't get anything logged in the DB, but see traffic in the IEP. Any ideas? :) Regards, Bo Theo Schlossnagle wrote: > You want just one of feed log that looks like: > > > > > On Wed, Apr 30, 2014 at 4:25 PM, Bo Agerskov Rising > wrote: > > Hi Theo, > > After connecting a second stratcon to my noit, I get the following error > in the test stratcon log (dk01-stratcon): > > [2014-04-30 22:12:54.039152] [error] [xxx.yyy.xxx.yyy:43191] [de01] jlog > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > > This is the config from the noit: > > path="/var/log/noitd.feed(de01-stratcon)"/> > path="/var/log/noitd.feed(dk01-stratcon)"/> > > > And the result when querying the API: > > > > de01-stratcon > ~0000006 > > > > I remember when I initially configured the noit, that I had to change > the conf from using /var/log/noitd.feed(stratcon) to > /var/log/noitd.feed(de01-stratcon), before the noit wanted to have > anything to do with the prod stratcon, which has the CN name of > 'de01-stratcon'. > > Any ideas to whats wrong? > > Regards, > Bo > > Theo Schlossnagle wrote: > > Yes it is. Make sure they have different CNs (in their SSL certs). A > > valid signed cert will connect and establish a new subscriber. > Keep in > > mind that if it goes away, the noitd will continue to queue all > message > > for that node until ti comes back.. If you don't want this, you'll > want > > to use the noitd's "GET /feed" API and "DELETE /feed/" > API to > > find and move the subscriber if you intend to not use it and don't > want > > backlogged information. > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > > >> wrote: > > > > Hi, > > > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > > > It would be nice getting the ability to feed a production and > a test > > environment, with the same live data. > > > > Regards, > > Bo > > _______________________________________________ > > Reconnoiter-devel mailing list > > Reconnoiter-devel at lists.omniti.com > > > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > -- > > Theo Schlossnagle > > http://omniti.com/is/theo-schlossnagle > From jesus at omniti.com Wed Apr 30 20:55:57 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Wed, 30 Apr 2014 16:55:57 -0400 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: <53616286.2060705@gmail.com> References: <5360039D.1070908@gmail.com> <53615C20.9090809@gmail.com> <53616286.2060705@gmail.com> Message-ID: You restarted the noitd, right? On Wed, Apr 30, 2014 at 4:52 PM, Bo Agerskov Rising wrote: > Hmm, after changing that setting, I get the following: > > > > > ~0000003 > de01-stratcon > ~0000001 > > > > And still getting the following in the test stratcon: > > [2014-04-30 22:49:07.853431] [error] [xxx.yyy.xxx.yyy:43191] [de01] jlog > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > [2014-04-30 22:49:07.853541] [debug] Next jlog_streamer attempt in 15000ms > [2014-04-30 22:49:08.096118] [debug] Pushing transient/iep batch async > [144.76.81.4:43191] [de01]: [27553/2204] > [2014-04-30 22:49:08.096244] [debug] Pushing transient/iep checkpoint > [144.76.81.4:43191] [de01]: [27553/2204] > [2014-04-30 22:49:08.151252] [debug] Pushing transient/iep batch async > [192.168.87.14:43191] [dk01]: [2284/95] > [2014-04-30 22:49:08.151372] [debug] Pushing transient/iep checkpoint > [192.168.87.14:43191] [dk01]: [2284/95] > > I don't get anything logged in the DB, but see traffic in the IEP. > > Any ideas? :) > > Regards, > Bo > > Theo Schlossnagle wrote: > > You want just one of feed log that looks like: > > > > > > > > > > On Wed, Apr 30, 2014 at 4:25 PM, Bo Agerskov Rising > > wrote: > > > > Hi Theo, > > > > After connecting a second stratcon to my noit, I get the following > error > > in the test stratcon log (dk01-stratcon): > > > > [2014-04-30 22:12:54.039152] [error] [xxx.yyy.xxx.yyy:43191] [de01] > jlog > > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > > > > This is the config from the noit: > > > > > path="/var/log/noitd.feed(de01-stratcon)"/> > > > path="/var/log/noitd.feed(dk01-stratcon)"/> > > > > > > And the result when querying the API: > > > > > > > > de01-stratcon > > ~0000006 > > > > > > > > I remember when I initially configured the noit, that I had to change > > the conf from using /var/log/noitd.feed(stratcon) to > > /var/log/noitd.feed(de01-stratcon), before the noit wanted to have > > anything to do with the prod stratcon, which has the CN name of > > 'de01-stratcon'. > > > > Any ideas to whats wrong? > > > > Regards, > > Bo > > > > Theo Schlossnagle wrote: > > > Yes it is. Make sure they have different CNs (in their SSL > certs). A > > > valid signed cert will connect and establish a new subscriber. > > Keep in > > > mind that if it goes away, the noitd will continue to queue all > > message > > > for that node until ti comes back.. If you don't want this, you'll > > want > > > to use the noitd's "GET /feed" API and "DELETE /feed/" > > API to > > > find and move the subscriber if you intend to not use it and don't > > want > > > backlogged information. > > > > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > > > > >> wrote: > > > > > > Hi, > > > > > > Would it be possible for 2 stratcon's to subscribe to 1 noit? > > > > > > It would be nice getting the ability to feed a production and > > a test > > > environment, with the same live data. > > > > > > Regards, > > > Bo > > > _______________________________________________ > > > Reconnoiter-devel mailing list > > > Reconnoiter-devel at lists.omniti.com > > > > > > > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > > > > > > -- > > > > > > Theo Schlossnagle > > > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > -- Theo Schlossnagle http://omniti.com/is/theo-schlossnagle -------------- next part -------------- An HTML attachment was scrubbed... URL: From borising at gmail.com Wed Apr 30 21:14:23 2014 From: borising at gmail.com (Bo Agerskov Rising) Date: Wed, 30 Apr 2014 23:14:23 +0200 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: References: <5360039D.1070908@gmail.com> <53615C20.9090809@gmail.com> <53616286.2060705@gmail.com> Message-ID: <536167AF.2080407@gmail.com> I initiated a restart from the console, which apparently didn't completey restart noitd. After completely restarting it it now doesn't complain anymore :) de01-stratcon ~0000002 ~0000001 dk01-stratcon Are the 2 ~0000 subsribers supposed to be there? Regards, Bo Theo Schlossnagle wrote: > You restarted the noitd, right? > > > On Wed, Apr 30, 2014 at 4:52 PM, Bo Agerskov Rising > wrote: > > Hmm, after changing that setting, I get the following: > > > > > ~0000003 > de01-stratcon > ~0000001 > > > > And still getting the following in the test stratcon: > > [2014-04-30 22:49:07.853431] [error] [xxx.yyy.xxx.yyy:43191] [de01] jlog > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > [2014-04-30 22:49:07.853541] [debug] Next jlog_streamer attempt in > 15000ms > [2014-04-30 22:49:08.096118] [debug] Pushing transient/iep batch async > [144.76.81.4:43191 ] [de01]: [27553/2204] > [2014-04-30 22:49:08.096244] [debug] Pushing transient/iep checkpoint > [144.76.81.4:43191 ] [de01]: [27553/2204] > [2014-04-30 22:49:08.151252] [debug] Pushing transient/iep batch async > [192.168.87.14:43191 ] [dk01]: [2284/95] > [2014-04-30 22:49:08.151372] [debug] Pushing transient/iep checkpoint > [192.168.87.14:43191 ] [dk01]: [2284/95] > > I don't get anything logged in the DB, but see traffic in the IEP. > > Any ideas? :) > > Regards, > Bo > > Theo Schlossnagle wrote: > > You want just one of feed log that looks like: > > > > > > > > > > On Wed, Apr 30, 2014 at 4:25 PM, Bo Agerskov Rising > > > >> wrote: > > > > Hi Theo, > > > > After connecting a second stratcon to my noit, I get the > following error > > in the test stratcon log (dk01-stratcon): > > > > [2014-04-30 22:12:54.039152] [error] [xxx.yyy.xxx.yyy:43191] > [de01] jlog > > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > > > > This is the config from the noit: > > > > > path="/var/log/noitd.feed(de01-stratcon)"/> > > > path="/var/log/noitd.feed(dk01-stratcon)"/> > > > > > > And the result when querying the API: > > > > > > > > de01-stratcon > > ~0000006 > > > > > > > > I remember when I initially configured the noit, that I had to > change > > the conf from using /var/log/noitd.feed(stratcon) to > > /var/log/noitd.feed(de01-stratcon), before the noit wanted to have > > anything to do with the prod stratcon, which has the CN name of > > 'de01-stratcon'. > > > > Any ideas to whats wrong? > > > > Regards, > > Bo > > > > Theo Schlossnagle wrote: > > > Yes it is. Make sure they have different CNs (in their SSL > certs). A > > > valid signed cert will connect and establish a new subscriber. > > Keep in > > > mind that if it goes away, the noitd will continue to queue all > > message > > > for that node until ti comes back.. If you don't want this, > you'll > > want > > > to use the noitd's "GET /feed" API and "DELETE /feed/" > > API to > > > find and move the subscriber if you intend to not use it and > don't > > want > > > backlogged information. > > > > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > > > > > > > >>> wrote: > > > > > > Hi, > > > > > > Would it be possible for 2 stratcon's to subscribe to 1 > noit? > > > > > > It would be nice getting the ability to feed a > production and > > a test > > > environment, with the same live data. > > > > > > Regards, > > > Bo > > > _______________________________________________ > > > Reconnoiter-devel mailing list > > > Reconnoiter-devel at lists.omniti.com > > > > > > > > > >> > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > > > > > > -- > > > > > > Theo Schlossnagle > > > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > -- > > Theo Schlossnagle > > http://omniti.com/is/theo-schlossnagle > From jesus at omniti.com Wed Apr 30 21:25:25 2014 From: jesus at omniti.com (Theo Schlossnagle) Date: Wed, 30 Apr 2014 17:25:25 -0400 Subject: [Reconnoiter-devel] Possible to subscribe 2 stratcons to 1 noit? In-Reply-To: <536167AF.2080407@gmail.com> References: <5360039D.1070908@gmail.com> <53615C20.9090809@gmail.com> <53616286.2060705@gmail.com> <536167AF.2080407@gmail.com> Message-ID: Those are the IEP feeds and real-time playing feeds. They are fine. On Wed, Apr 30, 2014 at 5:14 PM, Bo Agerskov Rising wrote: > I initiated a restart from the console, which apparently didn't > completey restart noitd. After completely restarting it it now doesn't > complain anymore :) > > > > > de01-stratcon > ~0000002 > ~0000001 > dk01-stratcon > > > > Are the 2 ~0000 subsribers supposed to be there? > > Regards, > Bo > > Theo Schlossnagle wrote: > > You restarted the noitd, right? > > > > > > On Wed, Apr 30, 2014 at 4:52 PM, Bo Agerskov Rising > > wrote: > > > > Hmm, after changing that setting, I get the following: > > > > > > > > > > ~0000003 > > de01-stratcon > > ~0000001 > > > > > > > > And still getting the following in the test stratcon: > > > > [2014-04-30 22:49:07.853431] [error] [xxx.yyy.xxx.yyy:43191] [de01] > jlog > > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > > [2014-04-30 22:49:07.853541] [debug] Next jlog_streamer attempt in > > 15000ms > > [2014-04-30 22:49:08.096118] [debug] Pushing transient/iep batch > async > > [144.76.81.4:43191 ] [de01]: [27553/2204] > > [2014-04-30 22:49:08.096244] [debug] Pushing transient/iep checkpoint > > [144.76.81.4:43191 ] [de01]: [27553/2204] > > [2014-04-30 22:49:08.151252] [debug] Pushing transient/iep batch > async > > [192.168.87.14:43191 ] [dk01]: [2284/95] > > [2014-04-30 22:49:08.151372] [debug] Pushing transient/iep checkpoint > > [192.168.87.14:43191 ] [dk01]: [2284/95] > > > > I don't get anything logged in the DB, but see traffic in the IEP. > > > > Any ideas? :) > > > > Regards, > > Bo > > > > Theo Schlossnagle wrote: > > > You want just one of feed log that looks like: > > > > > > > > > > > > > > > On Wed, Apr 30, 2014 at 4:25 PM, Bo Agerskov Rising > > > > > >> wrote: > > > > > > Hi Theo, > > > > > > After connecting a second stratcon to my noit, I get the > > following error > > > in the test stratcon log (dk01-stratcon): > > > > > > [2014-04-30 22:12:54.039152] [error] [xxx.yyy.xxx.yyy:43191] > > [de01] jlog > > > reader[dk01-stratcon] error: JLOG_ERR_INVALID_SUBSCRIBER > > > > > > This is the config from the noit: > > > > > > > > path="/var/log/noitd.feed(de01-stratcon)"/> > > > > > path="/var/log/noitd.feed(dk01-stratcon)"/> > > > > > > > > > And the result when querying the API: > > > > > > > > > > > > de01-stratcon > > > ~0000006 > > > > > > > > > > > > I remember when I initially configured the noit, that I had to > > change > > > the conf from using /var/log/noitd.feed(stratcon) to > > > /var/log/noitd.feed(de01-stratcon), before the noit wanted to > have > > > anything to do with the prod stratcon, which has the CN name of > > > 'de01-stratcon'. > > > > > > Any ideas to whats wrong? > > > > > > Regards, > > > Bo > > > > > > Theo Schlossnagle wrote: > > > > Yes it is. Make sure they have different CNs (in their SSL > > certs). A > > > > valid signed cert will connect and establish a new > subscriber. > > > Keep in > > > > mind that if it goes away, the noitd will continue to queue > all > > > message > > > > for that node until ti comes back.. If you don't want this, > > you'll > > > want > > > > to use the noitd's "GET /feed" API and "DELETE > /feed/" > > > API to > > > > find and move the subscriber if you intend to not use it and > > don't > > > want > > > > backlogged information. > > > > > > > > > > > > On Tue, Apr 29, 2014 at 9:55 PM, Bo Agerskov Rising > > > > > > > > > > > > >>> wrote: > > > > > > > > Hi, > > > > > > > > Would it be possible for 2 stratcon's to subscribe to 1 > > noit? > > > > > > > > It would be nice getting the ability to feed a > > production and > > > a test > > > > environment, with the same live data. > > > > > > > > Regards, > > > > Bo > > > > _______________________________________________ > > > > Reconnoiter-devel mailing list > > > > Reconnoiter-devel at lists.omniti.com > > > > > > > > > > > > > > > > >> > > > > > http://lists.omniti.com/mailman/listinfo/reconnoiter-devel > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > Theo Schlossnagle > > > > > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > > > > > > > > > > > > > -- > > > > > > Theo Schlossnagle > > > > > > http://omniti.com/is/theo-schlossnagle > > > > > > > > > > > > > -- > > > > Theo Schlossnagle > > > > http://omniti.com/is/theo-schlossnagle > > > -- Theo Schlossnagle http://omniti.com/is/theo-schlossnagle -------------- next part -------------- An HTML attachment was scrubbed... URL: