I found a company that can help me solve that!
BitRock makes open source software easier to use by providing a complete automated solution for Open Source Application Deployment.
Its quite cool and they have a LAMP stack installer here.
Now I am suggesting that someone at Erlang does it too. They have a Lyme stack which is Linux + Yaws + Mnesia + Erlang. (a comparison can be found here)
Anyway, I am still stuck on installing yaws :(
I asked a friend to help until someone makes a cool installer.