|
Our tables rating individual firms will be more valuable to you if you know how the data were gathered and how they should be interpreted.
Customer survey scores reported on our tables are from our surveys of Consumer Reports and CHECKBOOK subscribers, conducted via mail and the Internet.
Since many firms were rated by rather small numbers of raters, small differences between two firms in the percentage of raters who gave a particular rating (say, "superior") should be ignored. The table below gives a rough guide to minimum differences you should look for in deciding on one firm over another.
When using these survey data, remember that the questions are to some degree subjective and that the differences among firms might be explained by differences in the personalities, backgrounds, critical standards, and other characteristics of the raters or by biases these raters might have.
Our ratings tables show the number of complaints filed against individual firms with the government offices of consumer affairs in Alexandria; Fairfax, Howard, and Montgomery counties; the Office of the Attorney General for the District of Columbia; the Consumer Protection Division of the Maryland Attorney General's Office; and at the Virginia Office of Consumer Affairs. These complaint counts are for a two-year period.
The ratings tables also show counts of complaints filed with the Better Business Bureau of Metropolitan Washington, DC (BBB), during a three-year period.
On the ratings tables we calculate complaint rates, where we are able, by dividing the number of complaints by the best measure we can devise of each firm's business volume and exposure to complaints.
There are limitations to the complaint data. One problem is that some complaints may be unjustified, simply filed by cranks. Another problem is that, in some cases, we didn't have a measure of business volume and therefore couldn't control for differences in firms' exposure to complaints.
We always recommend that you look for substantial differences in complaint counts and rates. We also advise giving little weight to complaint counts if the total count against a firm is less than three or four.
To gather much of the other information on our tables, we surveyed the firms. In general, our researchers surveyed firms by phone (sometimes without revealing their affiliation with CHECKBOOK), but in some cases data were collected by mail or from firms' websites, or phone responses were confirmed by mail follow-up.
All of the data must be interpreted in view of timeliness. Our customer survey data are from surveys conducted from April 2000 to April 2011. Survey respondents were asked to report on experiences in the preceding year. Our data on complaints for the government offices of consumer affairs are for a two-year period dating back from September 30, 2005. For the BBB, the data are for a three-year period dating back from a date from January to February 2006 (different three-year periods for different articles). The data from our survey of firms were collected from March to May 2006. Our price data were collected from September 2005 to March 2006.
For the most part, our tables include firms for which we collected 10 or more ratings on our customer survey during the customer survey period mentioned above, but we do not report data for periods prior to firms' changes of name and ownership. As a result, some large firms are not listed at all. If only name or ownership changed, we do report the data. Changes subsequent to the dates listed above may not be taken into account.
We give checkmarks to firms that score highest on a scoring system that we devise for each service field. Our scoring systems weight the various data in our tables and text based on our subjective judgment of their importance. Since the scores are based entirely on information presented, you can apply your own subjective judgments, and decide whether you prefer firms we have not given checkmarks. Where we do not have important data on a firm, we cannot give our checkmark.
|
Nonprofit & unbiased
