Currently Browsing: database

Backuping Full Database

Dump doesn’t work. If you have huge tables with billions of rows your backup process could become a nightmare, mainly if you need to restore it. This method aims to perform a full backup of a large MySQL database, as Zabbix (any version), focusing on a fast recovery from disaster. So I chose XtraBackup for this task, a backup tool from Percona, which works using the hotcopy mode. First, you need to download and install XtraBackup: http://www.percona.com/downloads/XtraBackup/LATEST/ XtraBackup offers a lot of parameters, so this script is intented to be the simplest possible. Make sure that...
read more

MySQL database is the most used for Zabbix

In March 2011, I create a poll in Zabbix Forum with this question: It received 92 votes and MySQL was the most voted with 71.74% followed by PostgreSQL with 21.74% Personally I found many problems with Oracle 11g when reach more than 1000 nvps (new values per second). My results with MySQL was very good reaching more than 3500 nvps. Unfortunately I still could not test PostgreSQL, but there are many positive posts in Forum. And you, which database are you...
read more

MySQL performance tips for Zabbix

Most of these tips is useful for many application, but I’ll keep focus on Zabbix. Use a Dedicated Server Database is the main bottleneck from Zabbix. Try to use a Dedicated Server for MySQL and make sure that server has great resources (CPU, memory and fast disks). This is the specs for an environment with 3000 values per second: Dell PowerEdge R610 CPU: Intel Xeon L5520 2.27GHz (16 cores) Memory: 24GB RAM Disks: 6x SAS 10k with RAID10 by hardware Create one file per...
read more

Backuping only the Zabbix Configuration

This script is a simple way to backup all configuration tables (eg. templates, hostgroups, hosts, triggers…) without the history data. If you need do a full backup (history included) I recommend you this post: http://zabbixzone.com/zabbix/backuping-full-database/ As the result is very small (around 30 MB), is possible run this backup many times per day. https://github.com/xsbr/zabbixzone/blob/master/zabbix-mysql-backupconf.sh #!/bin/bash # # zabbix-mysql-backupconf.sh # v0.2 - 20111105 # # Configuration Backup for Zabbix 1.8 w/MySQL # # Author: Ricardo Santos...
read more

Partitioning Tables on Zabbix 1.8

Many performance problems on Zabbix are related to the database and it became visible only when we have thousands of items. On another side, we have to handle enormous tables and it makes impossible operational routines like housekeeping and backup. Use all information and scripts at your own risk. Make backups! My suggestion is disable housekeeping and to partition some tables based on clock, an unix timestamp field. If you wanna know more about partitioning access the MySQL Reference Manual – Partitioning Overview.   The Concept An easy way to handle partitioning is splitting the tables...
read more

History Tables – Housekeeper

First, I recommend to you read about the differences between the history and trends table. Each item on Zabbix can have your own housekeeper value. But this feature turns housekeeping process a performance killer, because delete_history() function executes a DELETE per item every turn. If you have 100k items, 100k DELETE queries will be executed. This can be a big problem using InnoDB engine on MySQL, because DELETE is extremelly slow on large tables and deleted rows doesn’t release space on disk. My proposed and tested solution is disable housekeeping and partitioning some tables. To know more...
read more

History and Trends

These two terms can cause some confusion, but their understanding is crucial for small and medium environments. History All collected data, doesn’t matter what type, will be stored on history tables. Trends Trends basically are the collected data (only numeric) consolidated by hour. Zabbix Server hourly takes all values from history tables and calculates minimum, average and maximum for one hour period. Note: string items, like character, log and text, doesn’t have trends Housekeeper Both data still remains on database until Housekeeper from Zabbix Server deletes it based on┬áKeep history...
read more