If you'd like to remove an entire directory, I recommend the following process. First, physically delete and "cvs remove" all files in the directory:

# rm *.c
# cvs remove