Bloom - Cacti Migration Tool (Teaser)

Announcements concerning Plugins for Cacti

Moderators: Developers, Moderators

User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Bloom - Cacti Migration Tool (Teaser)

Post by streaker69 »

N3ncy and I teamed up to make this plugin. The porpoise, to make the migration from one Cacti Box to another as easy as it can possibly be. Every couple of days it seems we have someone on the forums asking how to migrate. Yes there are instructions, but it's still a time consuming process to even learn the steps to do it.

We've come up with this plugin to dump the MySQL database, Export the RRA's to XML, copy your scripts and copy your Plugins directory, it will then either Tar.Gz or Zip all that together into one file so it can be easily transported to your new machine and imported using the included Perl script.

Attached is a screen shot of the interface and a link to a video of how the Perl Script will work. Hopefully this gets your mouths watering for the actual release.

Teaser Video (normal people)

Teaser Video (everyone else)
Attachments
SP32-20080714-080915.gif
SP32-20080714-080915.gif (32.37 KiB) Viewed 24917 times
Last edited by streaker69 on Mon Jul 14, 2008 7:38 am, edited 2 times in total.
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
User avatar
Howie
Cacti Guru User
Posts: 5508
Joined: Thu Sep 16, 2004 5:53 am
Location: United Kingdom
Contact:

Post by Howie »

Cool idea!

Just FYI, the video doesn't play in anything on the mac - might be better to reencode with a more common codec?

(edit: or windows)
Weathermap 0.98a is out! & QuickTree 1.0. Superlinks is over there now (and built-in to Cacti 1.x).
Some Other Cacti tweaks, including strip-graphs, icons and snmp/netflow stuff.
(Let me know if you have UK DevOps or Network Ops opportunities, too!)
User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Post by streaker69 »

Howie wrote:Cool idea!

Just FYI, the video doesn't play in anything on the mac - might be better to reencode with a more common codec?

(edit: or windows)
I re-encoded it to Mpeg format. I would do it to QT, but I don't want to be known as one of those people that caters to the whims of Mac people. ;)
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
User avatar
Howie
Cacti Guru User
Posts: 5508
Joined: Thu Sep 16, 2004 5:53 am
Location: United Kingdom
Contact:

Post by Howie »

streaker69 wrote:
Howie wrote:Cool idea!

Just FYI, the video doesn't play in anything on the mac - might be better to reencode with a more common codec?

(edit: or windows)
I re-encoded it to Mpeg format. I would do it to QT, but I don't want to be known as one of those people that caters to the whims of Mac people. ;)
:-P I know what you mean... just .avi with a codec that has is somewhat heard of (e.g. divx, mp4, cinepak) works OK :-)
Weathermap 0.98a is out! & QuickTree 1.0. Superlinks is over there now (and built-in to Cacti 1.x).
Some Other Cacti tweaks, including strip-graphs, icons and snmp/netflow stuff.
(Let me know if you have UK DevOps or Network Ops opportunities, too!)
eternal
Cacti User
Posts: 68
Joined: Thu Dec 14, 2006 4:38 pm
Location: Kingsport TN
Contact:

Post by eternal »

Thanks for the re encoding

Great idea


From Abi Normal
User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Post by streaker69 »

Just for an update. I spoke with N3ncy lastnight about the import script for the Bloom project. He's close to having it done. A few more days and it should be ready to test out.
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
apperrault
Cacti User
Posts: 379
Joined: Fri Feb 16, 2007 11:37 am
Location: Emeryville, CA
Contact:

Post by apperrault »

Woo Hoo!!! I can't wait for this release.

Thanks for the effort guys, i am sure many people will benefit from it

app
[b]Cacti Version[/b] - 0.8.7b
[b]Plugin Architecture[/b] - 2.2 Beta
[b]Poller Type[/b] - CMD.php
[b]Server Info[/b] - Linux 2.6.9-78.0.1.ELsmp
[b]Web Server[/b] - Apache/2.0.52 (Red Hat)
[b]PHP[/b] - 4.3.9
[b]MySQL[/b] - 4.1.22
[b]RRDTool[/b] - 1.2.23
[b]SNMP[/b] - 5.1.2
[b]Plugins[/b][list]Global Plugin Settings (settings - v0.5)
SuperLinks (superlinks - v0.72)
Host Info (hostinfo - v0.2)
Report Creator (reports - v0.3)
Update Checker (update - v0.4)
Realtime for Cacti (realtime - v0.35)
Cacti Log View (clog - v1.1)
RRD File Cleaner (rrdclean - v0.36)
Network Discovery (discovery - v0.9)
Uptime (uptime - v0.4)[/list]
cdnvballer
Cacti User
Posts: 89
Joined: Fri May 25, 2007 1:18 pm

Post by cdnvballer »

This is great to hear, can't wait...
I have to migrate my existing data to another device and this sounds like the perfect solution :)
User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Post by streaker69 »

A little more of a teaser.

N3ncy's part is almost completed, my part is almost completed. We're almost ready for testers. I'll be sending my changes over to him today for testing with his script.
Attachments
SP32-20080806-122928.gif
SP32-20080806-122928.gif (17.45 KiB) Viewed 24084 times
SP32-20080806-122912.gif
SP32-20080806-122912.gif (33.49 KiB) Viewed 24084 times
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Post by streaker69 »

N3ncy noticed while he was testing the import function that I was exporting the entire MySQL database with the initial version I gave him. We decided that could be bad. I ended up re-writing a large portion of the export code so that individual databases can be selected for exporting instead of dumping everything in MySQL.

Here's a screencap of the result. We should be back on track for testing now that this is complete.

We're open to suggestions and comments now, as changes will be much easier to implement while we're still actively working on this. If you have an idea or you see something we missed, please post it here so we can address those concerns now.
Attachments
SP32-20080813-124940.gif
SP32-20080813-124940.gif (26.18 KiB) Viewed 23861 times
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
curious_user2000
Posts: 1
Joined: Tue Aug 19, 2008 11:06 pm

Waiting with baited breath

Post by curious_user2000 »

How is the tool comming along, I know we are all looking forward to testing it!
User avatar
Linegod
Developer
Posts: 1626
Joined: Thu Feb 20, 2003 10:16 am
Location: Canada
Contact:

Post by Linegod »

streaker69 wrote:We decided that could be bad. I ended up re-writing a large portion of the export code so that individual databases can be selected for exporting instead of dumping everything in MySQL.
Why not just dump the database that is global.php?
--
Live fast, die young
You're sucking up my bandwidth.

J.P. Pasnak,CD
CCNA, LPIC-1
http://www.warpedsystems.sk.ca
User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Post by streaker69 »

Linegod wrote:
streaker69 wrote:We decided that could be bad. I ended up re-writing a large portion of the export code so that individual databases can be selected for exporting instead of dumping everything in MySQL.
Why not just dump the database that is global.php?
Well, I was looking at it from the aspect that other people might be doing what I'm doing, which is running a Snort database, an OpenAudIT database and maybe some others and in the process of migrating, they might want to migrate those as well.

Plus it also gives them a method to do a backup of any of their databases that can quickly re-imported or moved to another machine.

N3ncy and I decided we wanted to try to make this all encompassing as much as we can.

As for where we're at in progress, I'm not too sure. I think N3ncy has been a little busy, so I haven't heard from him for a few days, and I've been working on a new project, but that doesn't mean I've abandoned this one, just found something new to play with.

http://members.netjunkies.net/streaker/files/mame
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
User avatar
Linegod
Developer
Posts: 1626
Joined: Thu Feb 20, 2003 10:16 am
Location: Canada
Contact:

Post by Linegod »

streaker69 wrote: N3ncy and I decided we wanted to try to make this all encompassing as much as we can.
Down that path lies madness. Are you going to tar up the snort directory as well? Are you transferring cronjobs?
--
Live fast, die young
You're sucking up my bandwidth.

J.P. Pasnak,CD
CCNA, LPIC-1
http://www.warpedsystems.sk.ca
User avatar
streaker69
Cacti Pro User
Posts: 712
Joined: Mon Mar 27, 2006 10:35 am
Location: Psychic Amish Network Administrator

Post by streaker69 »

Linegod wrote:
streaker69 wrote: N3ncy and I decided we wanted to try to make this all encompassing as much as we can.
Down that path lies madness. Are you going to tar up the snort directory as well? Are you transferring cronjobs?
Yeah, I realize that part as well. We're gonna leave it up to people to do those kinds of configurations. Regardless, I already have the code written to list all the DB's and select the ones that should be exported.
[b]Cacti Version[/b] - 0.8.7d
[b]Plugin Architecture[/b] - 2.4
[b]Poller Type[/b] - Cactid v
[b]Server Info[/b] - Linux 2.6.18-128.1.6.el5
[b]Web Server[/b] - Apache/2.2.3 (CentOS)
[b]PHP[/b] - 5.2.9
[b]MySQL[/b] - 5.0.45-log
[b]RRDTool[/b] - 1.3.0
[b]SNMP[/b] - 5.3.2.2
[b]Plugins[/b]PHP Network Managing v0.6.1, Global Plugin Settings v0.6,thold v0.4.1,XMLPort v0.3.5,CactiCam v0.1.5,NetTools v0.1.5,pollperf v0.32,RRD Cleaner v1.1,sqlqueries v0.2,superlinks v0.8,syslog v0.5.2,update v0.4,discovery v0.9,zond v0.34a,hostinfo v0.2,Bloom v0.6.5,mactrack v1.1,weathermap v0.96a,mobile v0.1
Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests