Consumers Checkbook Masthead Logo
How We Rated the Insurers

Customer Ratings 

We regularly survey area CHECKBOOK and Consumer Reports subscribers for their feedback on services they have used. For our survey on auto insurers, we asked consumers who had had a claim or claims against their auto insurance policies to rate their experiences “inferior,” “adequate,” or “superior” on several aspects of service. Policyholders could rate their companies on “simplicity of claims procedures,” “speed of claims payment,” “adequacy of payment,” and “courtesy and helpfulness.” Our Ratings Tables show the percent of each company’s surveyed policyholders who rated it “superior” (as opposed to “adequate” or “inferior”) on each question. 

We have included in our ratings tables all of the insurance groups or companies for which we received at least 10 ratings on our customer surveys. If a company is not listed in our ratings tables, it simply means we did not receive at least 10 ratings for it; that fact has no negative or positive implications. 

The insurer names we use are short-hand and may relate to a group of companies; the customer survey ratings are all that we received from customers who identified what we judged to be the company or group associated with this name. 

Since some companies were rated by rather small numbers of raters, small differences between two firms in the percentage of raters who gave a particular rating (say, “superior”) should be ignored. The table below gives a rough guide to minimum differences you should look for in deciding on one firm over another. 

When using these survey data, remember that the questions are to some degree subjective and that the differences among firms might be explained by differences in the personalities, backgrounds, critical standards, and other characteristics of the raters or by biases these raters might have. 

Survey of Auto Body Shops 

We also sent surveys to area auto body shops, asking them to name the two insurers they considered “most desirable” for “treating their customers (car owners) fairly” and the two insurers they considered “least desirable.” 

For each company that received at least five total mentions (either favorable or unfavorable), our Ratings Tables show the total number of times the company was mentioned and the percentage of the mentions that were favorable. 

Keep in mind that in cases where companies were mentioned either favorably or unfavorably only a small number of times, a high or low score may be largely a matter of luck. 

Complaint Counts and Rates 

On our Ratings Tables, we have reported the number of private passenger auto insurance complaints filed in 2005, 2006, and 2007 with the Massachusetts Division of Insurance. We have also reported a “complaint rate” for each company. The complaint rate is intended to take into account the fact that some companies do much more business than others and therefore are more exposed to incurring complaints. It is calculated as a company’s total number of complaints in 2005, 2006, and 2007 per million dollars in direct private passenger auto insurance premiums written for that time period. 

Our Top Ratings 

We give checkmarks to firms that score highest on a scoring system that we devise for each service field, which weights the various data in our ratings tables based on our subjective judgment of their importance. Since the scores are based entirely on information presented, you can apply your own judgments, and decide whether you prefer firms we have not given checkmarks. 


A rough guide for deciding whether the difference between two percentages is important If one firm had this number of ratings: And a second had this number of ratings: Do not give much importance to the difference between percentages unless the difference is at least this many percentage points:
Assuming the average of the two firms' percentages is 50 percent 10
30
60
120
10
30
60
120
45
26
18
13
Assuming the average of the two firms' percentages is 80 percent 10
30
60
120
10
30
60
120
36
21
15
10

Return to Auto Insurance Homepage Back to top


CHECKBOOK Home      CarBargains      Privacy      Security      About      Donate      Press      Contact Us
Copyright © 2009 Center for the Study of Services. All Rights Reserved.
CHECKBOOK is a trademark and service mark of the Center for the Study of Services and is registered with the US Patent and Trademark Office.
No commercial use: CHECKBOOK's ratings and reports are solely for the use of its readers and may not be used in advertising or for any commercial purpose.
The Center for the Study of Services will take steps to prevent or prosecute commercial uses of excerpted materials, its name, or the CHECKBOOK name.
Checkbook.org is optimized for viewing at 1024 x 768 or higher resolution.