Everex and Dell make laptops with Linux installed. Although a used Lenovo ThinkPad can have Ubuntu put on it very easily.

I was looking @ the Acer ex5620, dual core pentium 1.7G w/3G ram 12G H.D. for around $500 and most likely Ubuntu. though i am a mac guy