For 12V batteries, anything less than 10.5 volts means the batteries are completely drained. This is usually bad for wet cell batteries. Keep trying to charge them, but you will need to get them to at least 12.1 to be able to use them for anything substantial.
Here is a chart that shows 12V batteries and how they stand when checked with a volt meter (from the 12 Volt Side of Life