Back By Popular Demand... The Ratings Return

After many months and much gnashing of teeth online and print, Home Theater's ratings are in fact returning starting to product reviews with the January issue being assembled now. The ratings are not only coming back, we think the more streamlined version we've come up with is actually better than what we had before.

I've enumerated the reasons the decision was made to remove the ratings in the first place, and plenty of good arguments were presented on both sides. My hope was that readers wouldn't miss the ratings after we'd implemented the wrinkles of including useful "pro and con" highlights at each review's opening and offering our Top Picks across all product categories so readers would know how each product compares and competes in the larger market. We didn't make the decision to cut the ratings rashly, and wanted to make sure these new elements had some time to take hold with the readers before reversing this decision.

But, as time went by even though many readers and respondents to my Blog posting on the subject were in agreement with our adios to the ratings, the majority of feedback we received over these months has remained constant in favor of bringing them back. So, as I promised in my first editorial, Home Theater was and is the readers' magazine. And we very much hope that you agree that this new strategy works its hardest for you, the reader.

Our new rating system is very straightforward: ratings of 1-5 stars with half stars in three to five pertinent areas. This is effectively a ten point scale, and we feel it requires the least explanation in being so visually oriented. Someone picking up the magazine for the first time will see and understand this system immediately, whether he or she has read any of our From the Test Bench boilerplate or not.

Nearly all products will be rated in the four following areas- Performance, Features, Ergonomics, and Value. Speakers will not be rated on Ergonomics since users don't interact with them once they're set up the same way they do other components. But speakers and HTiBs will also include a rating for Build Quality since that's so critical and based so heavily on the aesthetic appeal of the speakers. Build quality used to be rated for all components reviewed, but with electronics and most other products that aren't speakers we felt this rating was based on inherently superficial findings (we can't take everything apart and do a reliable qualitative parts inventory!).

Unlike the previous system, we are not averaging out the ratings to an overall score. This has many inherent issues. Even if we use some sort of calculation to weight the overall rating toward performance (as the previous system did), the fact is that several factors are still speaking louder than performance in the overall rating. We believe this is contributed to some of the artificially high overall ratings in the previous system. We believe that there's more strength in seeing each rating and letting the reader gauge what's most important to him/herself is the best approach. Tell me if you agree or disagree.

We also need you to know that each rating is specific to the product category and the price range of the component under review. Our reviews are broken down by Entry Level, Midrange and High End price points. While we all like the idea of an absolute scale for performance, how do you account for rating the performance of a $350 AV receiver on the same scale as ones that cost $5k? This isn't a perfect solution, but we're hard pressed to think of one better for an absolute scale that wouldn't involve, for example, putting some kind of cap on performance ratings for entry level products (at least). I'm not going to say I told anyone so, but really, these are the compromises that must be made in rating review products if the ratings are to be rational and useful. Again, if you've got better ideas, this Blog is intended to solicit them. I'd like to hear from you on this.

To recap, starting with January, every issue of Home Theater will feature reviews that open with a meaningful capsule of information At a Glance, a Top Pick logo if the product has made the cut, and a streamlined ratings system. In addition, to place the components reviewed in each issue in perspective with the other current products we've reviewed, all of our Top Picks in all categories are in the back of every issue. We are aiming to arm you with all the knowledge you need to get the best gear your money can buy. Let us know if this system succeeds.

Share | |
COMMENTS
Bruce in CO's picture

Tough decision to bring back the ratings. I could live without them, but I think that there is a method of comparing entry level and high-end products. Employ a simple ordering scheme for each area that is updated with every product. It wouldn't be unfair for a Theta component to be rated higher in performance than a Marantz, but the Theta could possibly be rated lower in features. By maintaining a running list, it allows the readers to decide which aspect of a product is most important to them and the trade-offs that go with it. This also allows for a subjective evaluation of products that have the same rating. Of course, it would require a person to read the review to understand why the ranking is the way it is. Four columns, quick comparison, updated every issue. Just a thought.

eVAN's picture

Kudos to Shane for responding to readers requests! That said, I am ambivalent to whether ratings appear or not. They are useful, but can be plagued by problems when they aren't 100% objective. So much of what is in HT gear is subjective and perceptive. That said, I don't think you need to worry about rating an entry level item at five stars and a high-end system also at five stars - I think readers are smart enough to figure out (based on price alone) that a $300 product with 5 stars will still not match a $3000 product with 5 stars. However, it may tell us that the $250 product with 4.5 stars is close in quality/performance etc. to aforementioned entry level model.

Evan (again)'s picture

Hey Shane,You need your webguys to add a report abuse link to your site so that we can report links like the "cheap glasses" above, amongst others. It's really annoying to see this crap where it doesn't belong - they aren't valid comments! Thanks.

Jorge's picture

Congratulations for taking such a difficult decision. It take b..ls to reverse direction and think hard to make it the best possible. I was one of those in favor of a rating system but with major revisions. It seems you are taking the best of comments and your thoughts/experience to come up with the new rating scale. I think it can work, and it will add to the great reviews.

Willie S.'s picture

To set different price categories apart, you could change the color of the stars or use different graphical icons rather than stars for each category. Perhaps dollar signs for the high-end? Maybe pennies for the low end? Also, intuitive and discrete logos and layouts for each of the price categories may also help in this sense. I think this would help in making sure readers don't get too caught up comparing "apples" to "oranges" (uh...well...stars to stars, haha). Thanks for the great magazine! I miss Geoff though, his commentary was always entertaining.

walt 's picture

shane: i too have the D2 unit. i am looking for a compatable b/r player (to replace a sony bd s500) that decodes all codecs. (master. et.al.)what is the (are the) best recommendations? thxwalt

Shane's picture

Among our Top Picks, Panasonic's DMP-BD55 is the least expensive player that offers full decoding over HDMI. Its performance is beyond reproach and the price is right.

Willdao's picture

Well, it seems to me that there is a potential problem with products that get lumped in one category because of price--i.e. the lower or middle categories--but may desereve to be in the upper category in terms of performance. Whether the aforementioned Panny Blu-ray player fits this "cross-category" scheme remains to be seeen (and heard!). Also, we have a couple of newly announced Blu-ray Universal players that may cause a connundrum: Is Denon's $3,000+ unit going to be trumped by Oppo's forthcoming ~$400-$500 unit, with the Anchor Bay Technologies chip--not just in price, but also in performance? Assuming so, for the sake of argument (Oppo has a good rep in thi regard, but let's just be rhetorical for a moment): how to account for such an event with the new ratings system? Maybe a note in the ratings box to the effect that--oblivious to price--the Oppo deseerves to be and is being evaluated in comarison to top-tier products.Again, this is only for illustrative purposes--but I DO

willdao's picture

...hope it happens!

JAI's picture
fzef's picture

[link=http://gmdark.free.fr/makingmoney/"]Make money online[/link]

fzef's picture
fzef's picture
mahmoud's picture

.دليل,اضف موقعك فى دليل حرة,انشر موقع,اشهر موقعك,اكسف ارشفة,ارشف موقعك مجانا,اشهر موقعك معنا مجانا,دليل حرة للتميز عنوانhttp://www.70ra.com/dir-------------------------------------------------... your site in our directory,and take back link free,and win page rank for free.http://www.70ra.com-----------------------------------------------------...منتديات حرة,منتدي متنوع,منوعات,العاب,برامج,برامج معربة,برامج مشروحة,برامج عامة,سيلك روود اونلاين,تعليم سيلك روود,برامج سيلك روود,منتدي كونكر,العاب اونلاين اخري,منتديات الربح من الانترنت,اكسب من الانترنت مجانا,تعليم

mr7-ly's picture
Last minute's picture

In my opinion the best are holidays

Anonymous's picture
hitloop's picture

Tough decision to bring the scores. I could live without them, but I think there is a method of comparing the entry level and high quality products. Employing a simple ordering system for each area that is updated with each product. It would be unfair for a Theta component to be rated higher in performance than a Marantz, but the Theta may be assessed lower duties. By keeping a list, which allows readers to decide which aspect of a product is more important to them and the compensation that goes with it. This also allows a subjective evaluation of products that have the same rating. Of course, it would take a person to read the review to understand why the ranking is the way it is. Four columns, quick comparison, updated each issue. Just a thought. plot-movie.comsearch.plot-movie.com

video izle's picture

The information in this article was trulyVideo izle

Anonymous's picture

http://www.szhqbq.cn深圳搬家公司http://www.jzfbq.cn深圳装修公司http://www.szctzs.cn深圳搬厂公司http://www.szjzfbq.cn深圳搬厂公司http://www.szjcbj.cn深圳装修公司http://www.szyqzx.org深圳空调维修http://www.szryzs.cn

Maç Oyunları's picture

Congratulations for taking such a difficult decision.maç oyunları

Rooriguri's picture

Oh, Good post.so gald to see your views about resveratrol.I'm also looking for resveratrol supplements. I found a lots of websites online. and i have read some other idea about resveratrol-anti-aging: , are they true or not?Anyway, I'll try resveratrol soon.

swiftekfeks's picture

http://wefherfghhnwepppiilkop.com wefherfghhnwepppiilkop wefherfghhnwepppiilkop

laubaxelsossy's picture

The response level to local and national disasters is noble but it's a damn shame that so many citizens take advantage of the sad situations.I mean everytime there is an earthquake, a flood, an oil spill - there's always a group of heartless people who rip off tax payers.This is in response to reading that 4 of Oprah Winfreys "angels" got busted ripping off the system. Shame on them!http://www.cbsnews.com/blogs/2009/08/19/crimesider/entry5251471.shtml

MatEffisM's picture

Good Morning...Words like the earths temperature increase - or global warming are most often disregarded as too scientific - however, earthquakes and mass death cannot be disregarded as another statistic. Hundreds of thousads are dead and homelessPlease offer financial or volunteer assistance to Haitihttp://www.google.com/relief/chileearthquake/

nemebipse's picture

Todd Cowle Municipal Bond Credit Report synthesizes, analyzes and presents aggregate credit information and trends in the municipal bond market. The report includes municipal bond rating information from the three major rating agencies – Moody’s Investor Services, Standard and Poor’s and Fitch Ratings.

crereihoolf's picture

OMG!Today I received a phone call from 9722840600 @ 972-284-0600 and I thought the the person calling was a scammer.So I complained and contacted the gov and yell.I really screwed up... Gulf Coast Western -- the oil drilling company- was trying to make contact who I interviewed with last month - we're calling to tell me I got the job!Any advice or help on how I can fix the complaint - and get the job?!!

RhizeRarpep's picture

Hey There Everybody! I am purchasing a another abode and was looking to acquire a few thoughts from the clever and experienced members of this round-table. The dwelling is in a small subdivision in Hickory Creek.This is a picture of the residence:http://ntreispictures.marketlinx.com/MediaDisplay/42/HR3228442-1.jpgYou can take a look at the whole listing now: Corinth, TX Homes For Sale. I have been looking for a different residence for what seems like forever now. Constantly ever since we had our third kid. We in actual fact could do with a larger residence and this is in our our range for price.Thoughts?

carmen electra sex tape information's picture

What?, http://www.nojazzfest.com/chat/member.php?u=6297 carmen electra sex tape, %(((,

Pages

X
Enter your Sound & Vision username.
Enter the password that accompanies your username.
Loading
setting var node_statistics_87212