Consumers' CHECKBOOK Logo

Nonprofit Ratings of Local Service
Companies and Health Care Providers

CHECKBOOK is a Unique Rating Service:
Nonprofit & unbiased
Accepts no advertising
Prevents ballot-box stuffing
Price comparisons
Quality comparisons
Expert articles and advice

Only $34 for Two Full years!
(View All Rating Categories)
How We Gather (and How to Interpret) Our Data

Opinion Surveys

We regularly survey area CHECKBOOK and Consumer Reports subscribers for their feedback on services they have used. For our survey on lawn care services, we asked consumers to rate their experiences with firms they had most recently used "inferior," "adequate," or "superior" on several aspects of service, including "doing service properly on the first try," "starting and completing service promptly," "letting you know cost early," "advice on service options and costs," and "overall performance." Our Ratings Tables show the percent of each firm's surveyed customers who rated it "superior" (as opposed to "inferior" or "adequate") on each question. Our Ratings Tables also show the percent of each firm's surveyed customers who rated it "superior" or "adequate" (as opposed to "inferior") for "overall performance."

We have included on our Ratings Tables all of the firms for which we received at least 10 ratings on our customer surveys. If a firm is not listed on our Ratings Tables, it simply means we did not receive at least 10 ratings for it.

Since many firms were rated by rather small numbers of raters, small differences between two firms in the percentage of raters who gave a particular rating (say, "superior") should be ignored. The table below gives a rough guide to minimum differences you should look for in deciding on one firm over another.

When using these survey data, remember that the questions are to some degree subjective and that the differences among firms might be explained by differences in the personalities, backgrounds, critical standards, and other characteristics of the raters or by biases these raters might have.

Complaints

For firms that were evaluated in our last full, published report, our Ratings Tables show counts of complaints we gathered from the Better Business Bureau (BBB) for a recent three-year period and the number of complaints on file with local government consumer protection offices for a recent two-year period.

For the counts of complaints we have reported for the local government consumer offices, we have attempted to include only complaints regarding lawn care work. For the counts of complaints we have reported for the BBB, we were unable to be so selective; we have included all complaints against a firm, not just complaints relating to lawn care work; so these complaints may be related to disputes that arose from other types of business the firms conduct.

Where we were able to, we have also reported on our Ratings Tables a complaint rate for each firm, calculated by dividing the number of complaints by our measure of the number of full-time-equivalent employees who perform residential work for the firms. These complaint rates are intended as a rough way to take into account volume of work and the fact that firms that do more work are exposed to a greater risk of incurring complaints.

When using the complaint information, keep in mind that complaints are not always justified; sometimes the customer is unreasonable. Also, be aware that some firms may be at greater risk than others of incurring complaints because of the specific types of business they do. And remember that the measure of business volume we use in calculating complaint rates (the number of full-time-equivalent employees who perform residential work) is at best a very rough indicator.

We always recommend that you look for substantial differences in complaint counts and rates. We also advise giving little weight to complaint counts if the total count against a firm is less than three or four.

Areas Served

Information reported on our Ratings Tables regarding areas served came directly from the firms' representatives. We called each firm to complete a survey over the phone and then followed up with a mailed verification form.

Timeliness of the Data

All of the data must be interpreted in view of timeliness. Our customer survey data are from surveys conducted from January 2004 to August 2011. Survey respondents were asked to report on experiences in the preceding year. Our data on complaints for the government offices of consumer affairs are for a two-year period between January 1, 2007 and December 31, 2008. Our data on complaints for the BBB are for a three-year period dating back from a date in March, April, or May 2009. The data from our survey of firms were collected from April to July 2009. Our price data were collected from May 2009 to July 2009.

For the most part, our tables include firms for which we collected 10 or more ratings on our customer survey during the customer survey period mentioned above, but we do not report data for periods prior to firms' changes of name and ownership. As a result, some large firms are not listed at all. If only name or ownership changed, we do report the data. Changes subsequent to the dates listed above may not be taken into account.

Top Ratings

We give checkmarks to firms that score highest on a scoring system that we devise for each service field. Our scoring systems weight the various data in our tables and text based on our subjective judgment of their importance. Since the scores are based entirely on information presented, you can apply your own subjective judgments, and decide whether you prefer firms we have not given checkmarks. Where we do not have important data on a firm, we cannot give our checkmark.


A rough guide for deciding whether the difference between two percentages is important If one firm had this number of ratings: And a second had this number of ratings: Do not give much importance to the difference between percentages unless the difference is at least this many percentage points:
Assuming the average of the two firms' percentages is 50 percent 10
30
60
120
10
30
60
120
45
26
18
13
Assuming the average of the two firms' percentages is 80 percent 10
30
60
120
10
30
60
120
36
21
15
10

Return to the ratings of lawn care services Back to top