This is a quick and easy fix. I frequently have to update Apache to the latest version to pass PCI compliancy tests for one of my servers, and like most people who rely on Ubuntu packages through aptitude, get stuck with the old version due to lack of updates.
Though I find it interesting that the newer versions of Ubuntu have the latest Apache packages and yet LTS versions don't. Anyway, it's real easy to grab the latest version of Apache from the newest package(Oneiric at the time of writing this) while still being on 10.04 LTS.
$ sudo nano /etc/apt/sources.list
Add deb http://cz.archive.ubuntu.com/ubuntu oneiric main to the bottom of the file.
## main & restricted repositories
deb http://us.archive.ubuntu.com/ubuntu/ lucid main restricted
deb-src http://us.archive.ubuntu.com/ubuntu/ lucid main restricteddeb http://security.ubuntu.com/ubuntu lucid-updates main restricted
deb-src http://security.ubuntu.com/ubuntu lucid-updates main restricteddeb http://security.ubuntu.com/ubuntu lucid-security main restricted
deb-src http://security.ubuntu.com/ubuntu lucid-security main restricted## universe repositories - uncomment to enable
deb http://us.archive.ubuntu.com/ubuntu/ lucid universe
deb-src http://us.archive.ubuntu.com/ubuntu/ lucid universedeb http://us.archive.ubuntu.com/ubuntu/ lucid-updates universe
deb-src http://us.archive.ubuntu.com/ubuntu/ lucid-updates universedeb http://security.ubuntu.com/ubuntu lucid-security universe
deb-src http://security.ubuntu.com/ubuntu lucid-security universe# use oneiric packages
deb http://cz.archive.ubuntu.com/ubuntu oneiric main
$ sudo apt-get update
$ sudo apt-get install apache2
Make sure to comment the line out after updating.