C & AA battery tech Q's

Is there away to tell with a multimetter if a battery is good? Mine has a setting for checking 1.5v and 9v batteries. When I check some batteries that i know should be bad it says they are putting out 1.4v still. I am assuming that batteries should put out close to their rated volts till dead right? So would I need to test?