slow slave performance

[Jefferson Davis]

I am trying to move from a central to a master-slave setup. everything works, buyt as soon as I put the server in slave mode performance gets very poor.

Replication works fine.

I am running on centos 4.8 w/openldap-servers-2.2.13-12.el4_8.2

TLS is enabled, though removing it seems to make no difference.

Where should I direct my troubleshooting efforts, adn what additional information would you need to see in order to point me to the error of my ways?

Thanks
--
Jefferson K Davis
Technology and Information Systems Manager
Standard School District
1200 North Chester Ave
Bakersfield, CA 93308
661.392.2110

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.

[Quanah Gibson-Mount]

--On Monday, March 29, 2010 9:30 AM -0700 Jefferson Davis

I am running on centos 4.8 w/openldap-servers-2.2.13-12.el4_8.2

Past Releases
OpenLDAP 2.2 (released December 2003)
This version is not actively maintained.

OpenLDAP 2.3 (released June 2005)

Current Release(s)

OpenLDAP 2.4 (released October 2007)



OpenLDAP 2.2 is so dead and gone, it's not worthwhile to use. Particularly
the patch level you mention. If you have no option of going to 2.4, then I
would advise you build at least the most current version of OpenLDAP 2.2.
However, you'll not get the improvements that came along in later releases.

--Quanah


--

Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Quanah Gibson-Mount]

--On Monday, March 29, 2010 11:41 AM -0700 Jefferson Davis

not quite the answer I was hoping for...
However, I will look for more updated repo's - this 2.2 is the latest
and greatest for rhel/centos 4.8...
While i'm not averse to compiling source, it's generally simpler to
maintain via package mgt than patching/compiling, etc...
and wholesale upgrade of server os is not an option I want to look at
right now.
In the meantime... nothing I can do w/2.2?

You can try basic tuning (via DB_CONFIG for Berkeley DB) and the cachesize.
But some of the options for tuning available in later releases are not
valid for 2.2.

For running a production LDAP service, I near always recommend building and
maintaining it yourself.

--Quanah


--

Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Jefferson Davis]

I think I'm hosed - wants bdb 4.4+ - CentOS 4.8 has 4.2.

so I shift to source on that - and what'll THAT break?

----- Message from ***@zimbra.com ---------
Date: Mon, 29 Mar 2010 12:11:19 -0700
From: Quanah Gibson-Mount <***@zimbra.com>
Subject: Re: slow slave performance

Post by Quanah Gibson-Mount
--On Monday, March 29, 2010 11:41 AM -0700 Jefferson Davis

not quite the answer I was hoping for...
However, I will look for more updated repo's - this 2.2 is the latest
and greatest for rhel/centos 4.8...
While i'm not averse to compiling source, it's generally simpler to
maintain via package mgt than patching/compiling, etc...
and wholesale upgrade of server os is not an option I want to look at
right now.
In the meantime... nothing I can do w/2.2?

You can try basic tuning (via DB_CONFIG for Berkeley DB) and the
cachesize. But some of the options for tuning available in later
releases are not valid for 2.2.
For running a production LDAP service, I near always recommend
building and maintaining it yourself.
--Quanah
--
Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra :: the leader in open source messaging and collaboration

----- End message from ***@zimbra.com -----
--
Jefferson K Davis
Technology and Information Systems Manager
Standard School District
1200 North Chester Ave
Bakersfield, CA 93308
661.392.2110

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.

[Owen Marshall]

Post by Jefferson Davis
I think I'm hosed - wants bdb 4.4+ - CentOS 4.8 has 4.2.
so I shift to source on that - and what'll THAT break?

Assuming you keep it in a separate prefix, as you will do for OpenLDAP
2.4.21, it shouldn't break anything on the rest of your system.

You will want to slapcat your existing data and slapadd it once you've
built OpenLDAP 2.4.21/BDB 4.8, as IIRC you will not be able to just use
4.2 files with DB 4.8.

Building from source really isn't that difficult, as both BDB and
OpenLDAP have good documentation on the subject.

[Thierry Lacoste]

Post by Quanah Gibson-Mount
For running a production LDAP service, I near always recommend
building and maintaining it yourself.

I'm interested in the exceptions you have in mind with "near always".

What do you think about building via ports on *BSD systems (pkgsrc on
NetBSD) ?
AFAICT it generally produces a resonably up-to-date release (provided
you have
an up-to-date port tree of course).

Best regards,
Thierry

[Quanah Gibson-Mount]

--On Tuesday, March 30, 2010 7:31 PM +0200 Thierry Lacoste

Post by Thierry Lacoste

Post by Quanah Gibson-Mount
For running a production LDAP service, I near always recommend
building and maintaining it yourself.

I'm interested in the exceptions you have in mind with "near always".

Symas provides packages, and so does Buchan Milne.

Post by Thierry Lacoste
What do you think about building via ports on *BSD systems (pkgsrc on
NetBSD) ?
AFAICT it generally produces a resonably up-to-date release (provided you
have
an up-to-date port tree of course).

No idea, I've never used the BSD port systems.

--Quanah

--

Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra :: the leader in open source messaging and collaboration

[FRLinux]

Post by Thierry Lacoste
What do you think about building via ports on *BSD systems (pkgsrc on
NetBSD) ?
AFAICT it generally produces a resonably up-to-date release (provided you
have
an up-to-date port tree of course).

I do that on FreeBSD and it really kicks ass:

put that in your /etc/make.conf:
WITH_BDB_VER=48

Then build it
cd /usr/ports/net/openldap24-server/
make install clean

(currently build with OpenLDAP 2.4.21 which is served us well as
slave). As a Master, we have yet to migrate our oldish 2.3 setup, this
is on the list for the next month.

Cheers,
Steph

[Michael Ströder]

Post by Jefferson Davis
I am trying to move from a central to a master-slave setup. everything
works, buyt as soon as I put the server in slave mode performance gets
very poor.
Replication works fine.
I am running on centos 4.8 w/openldap-servers-2.2.13-12.el4_8.2

You really should not waste your time with using such an ancient version since
there have been many many many fixes to syncrepl. Consider upgrading to 2.4.21.

Ciao, Michael.

[Michael Ströder]

I know I need to remove the rpm packages before I install the new stuff.

Not necessarily. You could leave all the RPM-based stuff depending on libldap
and compile the server software to a completely separate prefix.

Ciao, Michael.

[Michael Ströder]

HI!

Please keep replies on the mailing list so others can answer and learn as well.

what version of bdb shoudl I use - the latest stable openldap does not
like the 4.2 version currently installed.
Same deal, just different previx?

Yupp, different prefix. You can use the same for BDB 4.8.x, OpenLDAP 2.4 etc.
That's how I recently did on RHEL 5.

Ciao, Michael.

[Buchan Milne]

I know I need to remove the rpm packages before I install the new stuff.

Really?

http://staff.telkomsa.net/packages/rhel4/openldap/

(you can get 2.3.43 there that won't interfere with any of your RHEL4 original
packages ... the 2.4.x packages have been giving build trouble on RHEL4 and
are thus *very* old, and I have no motivation to fix the build on RHEL4. If
people on RHEL4 would benefit from 2.4.x packages I can consider having a look
again ...).

Regards,
Buchan

[Jefferson Davis]

Is there a repo to point to or just dl the rpms and update?

Very cool thanks for your efforts!

----- Message from ***@staff.telkomsa.net ---------
Date: Tue, 30 Mar 2010 12:04:58 +0100
From: Buchan Milne <***@staff.telkomsa.net>
Subject: Re: slow slave performance

Post by Buchan Milne

I know I need to remove the rpm packages before I install the new stuff.

Really?
http://staff.telkomsa.net/packages/rhel4/openldap/
(you can get 2.3.43 there that won't interfere with any of your RHEL4 original
packages ... the 2.4.x packages have been giving build trouble on RHEL4 and
are thus *very* old, and I have no motivation to fix the build on RHEL4. If
people on RHEL4 would benefit from 2.4.x packages I can consider having a look
again ...).
Regards,
Buchan

----- End message from ***@staff.telkomsa.net -----
--
Jefferson K Davis
Technology and Information Systems Manager
Standard School District
1200 North Chester Ave
Bakersfield, CA 93308
661.392.2110

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.

[Michael Ströder]

Post by Jefferson Davis
Is there a repo to point to or just dl the rpms and update?
Very cool thanks for your efforts!

While I appreciate the packaging work done I'd still recommend to compile
2.4.21 yourself. 2.4.7 is quite old and 2.3.x is also not actively maintained
anymore.

Ciao, Michael.

Post by Jefferson Davis
Date: Tue, 30 Mar 2010 12:04:58 +0100
Subject: Re: slow slave performance

Post by Buchan Milne

I know I need to remove the rpm packages before I install the new

stuff.

Post by Buchan Milne
Really?
http://staff.telkomsa.net/packages/rhel4/openldap/
(you can get 2.3.43 there that won't interfere with any of your RHEL4 original
packages ... the 2.4.x packages have been giving build trouble on

RHEL4 and

Post by Buchan Milne
are thus *very* old, and I have no motivation to fix the build on

RHEL4. If

Post by Buchan Milne
people on RHEL4 would benefit from 2.4.x packages I can consider having a look
again ...).
Regards,
Buchan

[Buchan Milne]

Post by Jefferson Davis
Is there a repo to point to or just dl the rpms and update?
Very cool thanks for your efforts!

http://staff.telkomsa.net/packages/OpenLDAP.repo

(But, I haven't tried that file with RHEL4, which doesn't ship with yum ... I
was using smart on RHEL4 with a manually configured repo).

Regards,
Buchan

[Jefferson Davis]

I'll give it a shot...

----- Message from ***@staff.telkomsa.net ---------
Date: Wed, 31 Mar 2010 09:45:49 +0100
From: Buchan Milne <***@staff.telkomsa.net>
Subject: Re: slow slave performance

Post by Buchan Milne

Post by Jefferson Davis
Is there a repo to point to or just dl the rpms and update?
Very cool thanks for your efforts!

http://staff.telkomsa.net/packages/OpenLDAP.repo
(But, I haven't tried that file with RHEL4, which doesn't ship with yum ... I
was using smart on RHEL4 with a manually configured repo).
Regards,
Buchan

----- End message from ***@staff.telkomsa.net -----
--
Jefferson K Davis
Technology and Information Systems Manager
Standard School District
1200 North Chester Ave
Bakersfield, CA 93308
661.392.2110

----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.