We are considering making two changes to the review framework and would like to know your thoughts before we decide whether or not to make these changes. You can see an example of a review framework below.

Change 1
Get rid of the star ratings. This would leave the comment boxes as the only feedback mechanism. I like the stars because they provide additional feedback. Others hate the stars because they seem so arbitrary. Do you think we should keep, remove, or make the star ratings optional? Is there something you think we should replace the star rating system with?

Change 2
Provide a “not applicable” checkbox to allow reviewers to skip a section of the critique framework. For example, if a story doesn’t have dialogue the reviewer would not be forced make up feedback for the dialog section. Should we continue to require everything to be filled out in the review framework or should we provide a way to skip sections?

Sample Review Framework

Thanks for your help,

Jacob

We had over 1,200 critiques performed last month, about 50 of these critiques where lousy. How should the unfortunate recipients of a rude or hasty feedback react? They could curse the universe, but that really won’t help. They can curse me for helping conceive the idea of Review Fuse, but with the host of curses already trying to do me in their curse will have to wait its turn. Or they could give the reviewer a low feedback score, tell them why they did so, and move on to the next critique.

WHAT? No retaliation! No counterstrike! No retribution!

We are trying to build a community where we help each other improve. Think neighbors not enemies. Helping the bozo who tried to assault your honor understand why they stink, helps cleanse the community of their foul stench. Don’t augment the stench and waste your time by striking back. If you get rude feedback, in any form, then pity the fool who spent part of their life trying unsuccessfully to attack you and move to the next review.

Jacob

Part 2 : Giving Reviews

View Part 1

First and foremost, be honest. If you like something, say so. If you hate something, say so. If you are impartial, say so. If you are not honest in your review of a piece, you are wasting your time and the author’s. Honesty adds more value to a review than any other aspect. Honesty can sometimes seem brutal, so try to mix in a good dose of kindness with your honesty. There is no need to morph into a jerk when telling someone how you think they could improve their work. While reviewing another’s work, think of yourself as a teacher: although you may have to give bad grades sometimes, you can do so gently. Students tend to be more willing to learn and accept suggestions for improvement when encouraged with gentle kindness than barraged with a brow-beating. If honesty demands you to call the author’s story terrible, do so in a way that focuses the criticism on specific examples of items needing improvement. It’s more useful to those being reviewed to have specific examples of areas in which their work is lacking and specific examples for improving those particular sections, rather than a general, overall statement that the entire piece needs improvement. Above all, apply the golden rule liberally: Review unto others as you would have them review unto you.

Second, be encouraging. Take time in your review to point out things the author did well and to offer sincere encouragement to the author with respect to his writing talent or his story. Encourage the author to achieve his best. Part of being encouraging is being friendly. Take time to get to know the people you are reviewing by conversing with them in person or on the phone if you now them, or on their private Review Fuse message board if you don’t. Understanding the author will help you understand their work better and will also help you understand how to better help them.

Third, be prompt. When you submit something for critique, you probably feel like a kid on Christmas morning, just dying to know what others think. Remember, the people waiting for you to review their work feel the same way about their material. So be courteous and try to get back to them as soon as possible.

Fourth, the review process should take place 1,000 feet in the sky, not at ground level. In other words look at the big picture as you review someone’s work. Helping writers develop stronger characters and a better plot is much more useful in the initial phases of writing than pointing out missing commas and nit-picking small details. The latter suggestions should be reserved for reviews of final drafts.

Most importantly, remember to enjoy and learn from the review experience.

Jacob

Part 1 : Getting Reviewed

The process of receiving and performing reviews is exciting, invigorating and educational. From my experience with this process, I have developed a few ideas to help me get the most out of the review process. I thought I’d pass these ideas on in case you find them helpful and request that you reciprocate by passing on any ideas you have about how to get the most out of the review process by commenting below.

Getting Reviewed

First, a good review tells you what you did wrong, points out your strengths and provides suggestions for improving your work. A good review is NOT an endless praising of your literary genius. To brace yourself for the impact of constructive criticism, put on a mental suit of armor that separates you from your work, allowing the story, rather than your psyche, to absorb the bludgeoning. Writers often have a difficult time separating their writing from themselves. Authors tend to internalize the critiques of their works as personal shortcomings. Remember, it is the words you submit that are being critiqued, not you. I remember being upset the first time I received a negative review of a story I wrote. I thought the reviewer was obviously a short-sighted, unimaginative moron, until I realized the reviewer had graciously given me a treasure trove of ways to improve my story.

Second, writing is an art not a science. People prefer different writing styles and techniques, making it your job as the author to pick the styles and techniques you feel are appropriate to your writing. Therefore, as the author, you have the power to judge the comments and critiques you receive and draw out the suggestions most pertinent to your writing goals. Yet, to ensure you judge wisely, be sure not to ignore any comments, especially those that initially offend. Often comments you find initially offensive actually contain shreds of wisdom that can dramatically improve your story. If you find yourself being offended by a review close it and read it later with the mind-set that the reviewer’s goal was to help and not to offend.

Third, be appreciative for every review you receive. As you read the review, assume the goal of the reviewer is to help you. After you have read the review, consider sending a thank-you note to the reviewer when you rate the review in order to show your gratitude for their hard work and effort. You can also use the thank-you note to ask the reviewer follow-up questions about the review to get even more feedback.

Jacob