To disable you CAPS key use the xmodmap program.
# xmodmap -e "clear Lock"
You may as well add the line
clear Lock
to your "~/.xmodmaprc" file.
