CyrusIMAP based email service - scalable [CLOSED]

All about messaging softwares and associated plugins

CyrusIMAP based email service - scalable [CLOSED]

New postby pongraczi » Fri Nov 09, 2012 11:13 am

Hi Everybody,

I plan to build up an infrastructure, focused on email services.
Main goals:
* SMTP - can filter all (spam, virus, etc.) incoming/outcoming emails, including local and remote domains (remote: such as M$ exchange, in this case: internet -> artica -> remote email server)
* Scalable, but starting with 2 MX (smtp relay) servers
* Scalable, but starting 2 imap/pop3 frontend servers
* CyrusIMAP/POP3 with sieve filters, in cluster (master-slave) with 2 servers
* Using VPS (Openvz) infrastructure in virtualization environment
* Could be scalable by adding more Hardware nodes to serve frontends, relays, storage
* Clients can access the service (smtp, imap/pop3) from outside (internet), including
* their own sw clients or
* 3rd party webmail
* Artica mailbox management (quarantine, filters etc. - for fine tuning)
* Used openvz templates will be debian 64 bit (if necessary, it is possible to move MX/spamfilters to specific mini-pc hardwares as they do not really need HA/big storage, will see).
* Expected users around 1000 accounts (starting).
* Virtualization environment, storage, specific groupware (including calendar, addressbook etc.) provided by 3rd party suite, this part not an issue.
* In attached you can see the sketch about the configuration. First, 3-3 vps can located on 2 hardware nodes to provide higher availability than one server.
email-structure.jpg
Overview about a config
email-structure.jpg (54.58 KiB) Viewed 9187 times


So, my question what is your opinion or recommendation for this kind of setup?
I will start to build it soon, based on specific docements can be found on artica.fr, including front-ends, cyrus replication.

Thanks in advance.
István
pongraczi
 
Posts: 8
Joined: Wed Aug 01, 2012 4:21 pm
Location: Hungary
Artica servers number: 1
Linux System: Debian
Technical skills: A Linux System Administrator

Re: CyrusIMAP based email service - scalable

New postby admin » Fri Nov 09, 2012 4:20 pm

Have you take a look about Zarafa Mail server.

Cyrus-imap -> only active/passive

Zarafa -> MySQL -> active/active
User avatar
admin
Site Admin
 
Posts: 11946
Joined: Wed Oct 17, 2007 7:59 am
Location: France

Re: CyrusIMAP based email service - scalable

New postby pongraczi » Fri Nov 09, 2012 6:48 pm

Thank you very much for your recommendation!
Unfortunatelly I do not see any benefits of Zarafa over cyrus/egroupware, except active/active.
I checked the Zarafa community version, only 3 outlook users supported, no multiuser calendar, backup, usually I have to pay a lot of money etc.

I use proxmox virtualization with customized ZFS local/remote storage, so, a lot of exciting features already covered by ZFS (local snapshots, backup, compression, transaction like access, protect data even for silent error etc.).
eGroupware provides very good services, which is similar to Zarafa and I have experience with it. Of course, the full features of eGroupware needs more knowledge than outlook, but the benefits are more (integrated ticketing system, project/timesheet/task management, multilevel categories, groups with fine-tuning ACL etc.).
Using your framework (a very feature rich solution, I really appreciate your work) with the background I wrote (proxmox with ZFS etc.) seems excellent platform, I feel Zarafa to step back to M$ direction to a closed system with vendor-lock (more ore less).

So, as I can see, Zarafa is good as drop-in replacement for M$ exchange for companies, who have budget to buy an other system instead of M$ exchange, but I do not see the advantage in my case (expected >1000 users for free, basically using email/calendar/tasks/contacts using android devices) which is suitable for multidomain installation.

Anyway, what is the real benefits of Zarafa (community?) with Artica over Cyrus imap?
Of course it is possible, I am wrong, so, any comments warmly welcome! :)
pongraczi
 
Posts: 8
Joined: Wed Aug 01, 2012 4:21 pm
Location: Hungary
Artica servers number: 1
Linux System: Debian
Technical skills: A Linux System Administrator

Re: CyrusIMAP based email service - scalable

New postby pongraczi » Fri Nov 09, 2012 7:15 pm

Hmmm, I checked the demo of Zarafa webaccess.
Probably I need to learn a LOT about Zarafa, because as I tried the demo, I have to tell, seems really cool.

So, I am afraid, to support 1000 users with Zarafa, needs very strong servers. What is your experience?

Edit: I found some interesting information about zarafa in real world usage. Some guys reported 1100 users with 4GB ram, so, I will give it a try.
pongraczi
 
Posts: 8
Joined: Wed Aug 01, 2012 4:21 pm
Location: Hungary
Artica servers number: 1
Linux System: Debian
Technical skills: A Linux System Administrator

Re: CyrusIMAP based email service - scalable

New postby admin » Fri Nov 09, 2012 9:31 pm

Zarafa is very strong while you tune correctly MySQL system .
Zarafa commercial features are only for:

Multiple Calendar sharing:
Outlook MAPI connector.
backup tools more scalable.

But free/open source for:
Strong webmail
IMAP/POP3
smartphones
Publics folders...

If you objective is to provide Web Access to mailboxes, Zarafa even in free mode is better...
Anyway, Artica manage both Cyrus-imapd Or Zarafa, so for me it is just a recommandation not "your" choose.
I suggest to just try the Artica for Zarafa ISO..
http://sourceforge.net/projects/artica-zarafa/files/
User avatar
admin
Site Admin
 
Posts: 11946
Joined: Wed Oct 17, 2007 7:59 am
Location: France

Re: CyrusIMAP based email service - scalable

New postby pongraczi » Sat Nov 10, 2012 2:05 pm

Thank you Admin, I already installed Zarafa inside an openvz container, seems working.
Now I am playing with it, try to find, how to upgrade zarafa to the latest stable, where to find admin interface for zarafa, what kind of plugins are available and how to use them.

So, if I choose zarafa, it is possible to create 2 zarafa servers in active-active cluster and using 2 smtp relay servers, where postfix/spam/virus stb. filters are working and all authentication working against the zarafa central servers, as shown here.
Image
pongraczi
 
Posts: 8
Joined: Wed Aug 01, 2012 4:21 pm
Location: Hungary
Artica servers number: 1
Linux System: Debian
Technical skills: A Linux System Administrator

Re: CyrusIMAP based email service - scalable

New postby admin » Sun Nov 11, 2012 12:14 am

With Zarafa/Artica an ISP/ASP architecture look like this:

zarafa-full.png
zarafa-full.png (137.04 KiB) Viewed 9170 times
User avatar
admin
Site Admin
 
Posts: 11946
Joined: Wed Oct 17, 2007 7:59 am
Location: France

Re: CyrusIMAP based email service - scalable

New postby pongraczi » Sun Nov 11, 2012 7:41 pm

Admin, thank you for this structure image! Yes, the very end must be like this.
pongraczi
 
Posts: 8
Joined: Wed Aug 01, 2012 4:21 pm
Location: Hungary
Artica servers number: 1
Linux System: Debian
Technical skills: A Linux System Administrator

Re: CyrusIMAP based email service - scalable

New postby pongraczi » Fri Feb 15, 2013 1:16 pm

I tested Zarafa, but seems for my purposes it is not really good, so, I back to cyrus instead.

The basic model will be the following:

SMTP/MX 1 ____________ Cyrus 1 ------ forward all mails ------ Cyrus 2 (as backup)
SMTP/MX 2 _____/
pongraczi
 
Posts: 8
Joined: Wed Aug 01, 2012 4:21 pm
Location: Hungary
Artica servers number: 1
Linux System: Debian
Technical skills: A Linux System Administrator


Return to Messaging

Who is online

Users browsing this forum: No registered users and 1 guest

cron