In order to make more efficient use of disk space, let's change the
default retention policy. Being able to react to changes with a
10-seccond precision less likely to be usefule as the data gets older,
and our historic data does not give much insight beyond a 1-hour
precision.
This change does not effect already created metrics, changing that would
require a manual run of whisper-resize.py on the data directories. This
only effects new metrics.
Old retention:
10-second precision for 6 hours
60-second precision for 7 days
10-minute precision for 5 years
New retention
10-second precision for 8 hours
60-second precision for 7 days
1-hour precision for 1 year
1-day precision for 5 years
Change-Id: I08d73d092fc73c271e9092f551f38f395e006ca4
Over time, graphite seems to have acquired a range of keys that are no
longer updated and can be quite confusing when trying to find data.
This small cron job (cribbed from suggestions in [1]) should remove
all old data that hasn't been updated in nine months (this should be
long-enough to cover all manner of periodic jobs)
[1] http://stackoverflow.com/questions/9587161/how-to-cleanup-the-graphite-whispers-data
Change-Id: I598b9d370a337866e9086cbe0238569da70aa471
The name of the apache package and service are different on different
operating systems. Fortunately, the apache module populates a variable
with the correct name for us. This is also true of the apache ssl
package.
Change-Id: I7d93e56281f828cba9262c135b0beb43dce9748a
The vcsrepo module doesn't really like the combo of latest and a
specific sha. It keeps grabbing it over and over again. Guess what?
The sha hasn't updated since the last time you looked for the same
sha.
Change-Id: I1a017278b83af11541794bf03644b3346e9869c2
The onlyif test is looking for a different path than the scripts
install the database file to. Adjust it so that we don't run
every time.
Change-Id: I96c8496fb678e99facc65a01a7d34ab08290416d
For some reason graphite 0.9.x now depends on unreleased changes
on whisper master (rather than whisper 0.9.x).
Switch whisper to master since that's what the instructions say.
Change-Id: Ia823fc61fe6bafde77a632d1826de9c171bcb268
These were not initially switched to pip installs because they are
different. Put the necessary different pip stuff in place to deal with
graphite-web and carbon so that their installs are consistent with
everything else.
Change-Id: Ieef60a228e284c936307291c4ed44930791cc631
The pip vs. easy_install interactions continually get the systems
into a weird state. pip install $path_to_repo, on the other hand,
works like a charm.
Left out two graphite installs because they are doing path manipulation
and I want to do further testing before touching that.
Change-Id: I373b29aca03f1ebd20e533ebaaf5de9ef2db017e
grahpite.o.o currently has a manually installed fix for carbon
issue #55 in place, but in case we lose that, setting MAX_CPM
to >=60 should work around the problem.
https://github.com/graphite-project/carbon/issues/55
Change-Id: I53bbe348737edc0c513bb1b34b753018d20c3d60
Reviewed-on: https://review.openstack.org/18750
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
This matches the rule for summing .count metrics. It means
that a minimum of 0% of the existing values must be non-null
in order for the new value to be non-null. That's good for
sums of exact counts.
Change-Id: Ic3f50888ada274a36e8f0385e6fffddf88ba6dfe
Reviewed-on: https://review.openstack.org/18747
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Change-Id: I13fc4d58b74c816ec2329ef792544e88e3c15594
Reviewed-on: https://review.openstack.org/18746
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Change-Id: I7d57a77f8c778403d40e7cb151feafe38867e1d7
Reviewed-on: https://review.openstack.org/18739
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Most of this is from the statsd README.
Change-Id: I22e4619375c10de2cb010b06071ed3b473197e92
Reviewed-on: https://review.openstack.org/18737
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Some paths were not set correctly in graphite config files.
Fix up permissions in /var/lib/graphite.
Use 'service', but don't ensure it's running.
Change-Id: I363319473a332c16687e16887bfe83e1468c8ece
Reviewed-on: https://review.openstack.org/17617
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
