Thinking About Reviewing: Ditching the Star-system?
Hey all.
I’ve had a crazy week (still feeling sick, unfortunately!) and will be scrambling to catch up this week. That includes 3–count ‘em, 3!–book reviews, including one of the ARC I stayed up all Saturday night reading, of Beth Revis’ 2011 debut Across the Universe.
I’ve been thinking about what I’d say in my review. My feelings are almost entirely positive (hence the staying-up-all-night-reading), though there were a few flaws in the novel I want to discuss. And so I’ve been ruminating, once again, about how I’d rate it on GoodReads. My internal debate about it–is a flawed book I really enjoyed a 4-star or a 5-star read?–has me wondering, once again, if I should abandon the star-rating system on there completely.
Here’s the thing: I write reviews because I like talking about books, thoroughly and honestly. And I use GoodReads because I adore the community on there, and how it facilitates this dialog. However, their rating system is really pretty inherently flawed, mostly because it’s non-intuitive. This is what GoodReads says their star ratings mean:
- 1 star – didn’t like it.
- 2 stars – it was okay.
- 3 stars – liked it.
- 4 stars – really liked it.
- 5 stars – it was amazing.
So the problem, here, for one thing is that it jumps from a completely subjective descriptor at 1-4 stars to a somewhat objective measure of quality at 5. 5 stars doesn’t indicate “I loved it,” but “it was amazing,” which to me, sounds more like a measure of conceptual and craft success on the part of the writer, rather than an indicator of just enjoyment.
It’s also problematic because almost no one uses the ratings this way, probably because it’s incredibly non-intuitive to have only one negative ranking. To most people, 1-star suggests that they hate a book, and two, perhaps, that they didn’t like it but felt less strongly about it. But that’s not what GoodReads tells us: they tell us that a 2-star rating–a rating less than half of the possible star rating!–indicates a book that’s “okay.”
Finally, there’s no room for half-star ratings, which reduces the possibility of nuance, makes rating a lot more reductive, and forces reviewers to look at things in a kind of black and white way that’s just not realistic, considering the varied and complex responses people have to books!
Most of the time, I follow GoodRead’s guidelines for star ratings, except, usually, for 4- and 5-star reviews. For me, both indicate that a book is very good, but a 4-star ranking usually indicates that there’s something about a book I might change to consider it ideal or perfectly crafted (“amazing”). Here, I’m usually making guesses about authorial intent and how well that intent was carried out. If a book is rated 5-stars, I usually can’t conceive of many, if any, ways to improve it.
However, this also means that there are some books that may be a bit flawed, but that I absolute love! And I may feel slightly less fervent about a book that’s rated 5-stars, despite the fact that it’s pretty perfectly written! I can’t help but think of the review I’m going to write for Revis’ Across the Universe (which, according to my usual rating style, I’d give 4-stars), and for Cynthia Hand’s Unearthly, which I recently reviewed. I really really really liked both books. I think Hand’s Unearthly was pretty perfectly crafted for an angel book. However, I’ll never love any angel book as much as I love a SF-adventure on a generation ship–because I’m a dork, because I love spaceships right down to my toes. And really, I think I loved Across the Universe more, even if there were a few flaws I’d like to discuss, and none that I can think of for Unearthly.
(Of course, sometimes I absolutely totally love books that I also can’t find any flaws in, to which I give unthinking and enthusiastic 5-star ratings without hesitation.)
I try to show these nuances of opinions in my actual reviews, which is where the meat of reviewing inevitably lies. I try to explain my biases, my perspective. I try to give readers a sense of my tastes, so that they can decide whether they, too, would be interested in a given book. And I try to think about authorial intent and whether the author was successful in light of their genre and goals. All this is nuance–I try to make my reviews nuanced, well-considered, careful.
But those stars, those damn stars, sometimes stop readers from seeing the nuance–and I can’t blame them. I’ve had readers of my reviews message me to say things like, “You only gave that book 2-stars? I’m going to skip it then.” I’ve had writers slightly tersely link to my 4-star reviews of books I really loved, then watched them squee over other reviewers’ 5-star reviews. I’ve wondered if these writers–of books I gave 2, and 3, and 4 stars, thought I was just trashing their books, despite the fact that I’m just trying to rate books in line with GoodReads’ guidelines.
And I’ll admit, part of my frustration with this is out of my constantly running internal debate about my insistence at being, publicly, both a reader and a writer. I love writing reviews, love honestly talking about books and how to make them better and when they thrill you even when they’re flawed, and what those flaws are, and what deeper thematics reveal about us as a culture, and what the impact of, say, anti-feminist strains in YA do to us as a society. For whatever reason, this dialog is important to me, and I don’t think it’s one I can have in private. This discourse–with you, gentle reader–has undoubtedly made me a better, more considerate, and more careful writer, and a more thoughtful and articulate reader, too.
But still, many writers don’t feel as I do. Many writers are afraid to openly and honestly dialog about books, particularly in YA. Many loathe the impact it might have on their careers–citing discomfort at conference panels when they have to sit next to someone they reviewed. I’ve worried about this (I’ve had nightmares about this!). But when it comes down to it, the way some writers work around this dilemma–maintaining radio silence about books they’ve read and didn’t like, as if the experience of disliking a book doesn’t exist; or giving every book they read a 5-star rating no matter how they really feel about it or if they’ve even read it; or rating them only, without discussing their reasoning–doesn’t sit right with me. I’m an obnoxiously honest person; I hold myself to rigorous standards of honesty. And many of these ways around conflict don’t sit right with my own moral compass. I’m okay with it if it’s what other authors want to do, but it doesn’t feel right for me. And, while I know that my policies about reviewing may shift and change, and that, inevitably, some authors will have their feelings hurt over the discussion of any flaws in their writing (this, I think, unrealistic of them and also counterproductive, but that’s for another blog), I wonder if eliminating the star rating might reduce that–if only because it forces readers to look at, and consider, my words rather than a reductive and imprecise star rating.
Because those words are what matters, but I realize that it might be difficult to see them when they’re beneath a one- or two-star review (for both authors and readers). When it comes down to it, while I’ve written a few reviews that are unflinchingly positive, I’ve never written one that had nothing good to say about a book. Really. Even my harshest one-star review will acknowledge (okay, grudgingly, I’ll admit) what an author does well. As reviews should! This is about thinking critically about art, not giving a thorough and unrelenting trashing.
And so it’s something I’m considering–ditching the stars, which are simplistic and reductive and probably not entirely accurate–and just talking about books from here on out. What do you think?
13 comments
My favorite movie reviewer has written a post nearly like this, a long time ago. (In fact, I think he blogs about it every now and then.) In the end, he stays with the star system because it draws more traffic. I think you should too, for that reason.
Hee, a fair, if self-serving reason. I think this might be more true for movie reviews, though. Looking back at my google analytics stats, I get lots of hits for "book title + review" but haven't had any for, say, "4 star review of book title."
Oh, if you mean Google traffic, yeah. I was thinking Goodreads itself. I’m more likely to click on someone’s star rating than just a title…
I've had the same issues on a critique site, where now – except for the monthly challenges, where they're part of a scoring system to determine the Member's Choice – I don't use star ratings at all, and many members also don't. Flat numeric ratings come across as a punch in the gut. Anything less than a 5 seems to be more damaging than a negative (or constructive) comment in the review itself.
Maybe it's because you can't argue with the numbers. They feel more objective, even though they aren't. You can read a review and say, "Well, I don't think a lot of sex is a problem," but if the reviewer docked the writer a star for that, it comes off differently. More authoritative, perhaps. I'm just riffing here, though.
I also agree that Goodreads' star system is sort of counter-intuitive, has an odd leap between 4 and 5, and darned, there are so many times when I wish I had half-star ratings. (The critique site I mentioned above did implement them, but obviously, it didn't solve all the issues with numeric ratings.)
I almost feel like you need two sets of stars: one for quality and one for personal taste, but that opens an insane numbers of cans of worms (buckets o' worms) and possibly only writer-reviewers would use it.
They feel more objective, even though they aren’t.
Yes, exactly. In fact, I'd say they're even more subjective than a thorough discussion of something you find problematic in a book. Because there's no acknowledgement of the reasoning, and because they seem so . . . monolithic, and difficult to argue against. Which is ironic, because I really carefully debate (and often waffle over) what ratings I give to different books. It's not as simple as just deciding, "Okay, this book sucked!" even if it doesn't seem like that from the reader's side.
Interesting that you don't use star ratings on the critique site you mentioned. Intuitively, I just suspect it's a more fair way to discuss books, but I'm not sure if I'll lose readers who don't have the patience to read a whole review if I go this route.
And so it’s something I’m considering–ditching the stars, which are simplistic and reductive and probably not entirely accurate–and just talking about books from here on out.
I'm in favour, as I'm sure you will be entirely unsurprised to learn! Stars encourage people to skip the talk.
I'm not surprised! I have to say that the excellent reviews over at SH have been a big influence on my own, helping them to trend longer and more reflective–and to be honest, I could never imagine any of the reviews there headed with stars!
I ditched it too.
Mainly for reasons you so eloquently stated above.
The thing is, I read a beautifully written book – nicely plotted, but felt a bit bored during it. historicals just not my thin, hey. i didn't think it was fair to lump it with 2 stars on my blog when the book is so much better than 2 stars would imply.
also, i feel like the star system rates enjoyment of the book rather than the actual merits of the book and i find it too hard to represent a truthful balance.
i'm in favour on goodreads though – i happily whack 2 stars on if i thought it was okay
Hehe, yeah, part of the problem is that I pretty much just copy and paste the code from SH over here. But I think thinking about things like stars–and their impact–has been a helpful exercise for me.
I've often thought about the negatives of honest reviewing. As you know, William Logan has the title "Most Hated Man in American Poetry" because of his reviews. Ideally, I wish I could be like him.
Not hated, but bold enough to state my well-reasoned opinions without fear of reprisal. The way you talk about the YA world makes it sound like the poetry one — a niche so small that any negative attention draws the ire of the whole community.
But reviews, in my opinion, are meant to evaluate the work under discussion as a whole, not just praising or dissing.
Of course, this doesn't really address your question re: the stars. But, to that point, I say ditch them.
Hey Andrew, I've actually written quite a bit about how William has impacted my reviewing–<a href="http://www.phoebenorth.com/?s=william+logan" rel="nofollow">here's some entries, if you want to take a look. The gist is that, though I often don't agree with William, knowing him has helped me see how honest and well-considered his reviews are, and I think that's incredibly valuable, not mean–even if it's viewed as such.
If you want to get a feeling for how reviewing is viewed by YA authors, <a href="http://lkmadigan.livejournal.com/168623.html" rel="nofollow">this blog post on LK Madigan's blog, and the ensuing comments, are really eye-opening.
I know star ratings are useful for a kind of 'at a glance' assessment, but I honestly go more by the body of the review than anything else. The problem is that people expect reviews to be boiled down to a simple numerical figure – that's why sites like Rotten Tomatoes are so popular.
Yeah. Hmm. Now I'm starting to become almost tempted to offer something akin to Kirkus' "starred reviews"–putting 5-stars up on books I'd freely recommend, along with my review, but no stars and only a review on other books.
But that might be too close to the practice of rewarding all books 5-stars, or only reviewing books I like.