Creative Bulletin n.108
This week we ran the Beta Test for Edito, our new tool for the editing of manuscripts. Like any other test, it was full of surprises and food for thought. Thank you to those who dedicated some of their time to help us!! š
š¦š¦š¦ What else we did this week
- Matteo worked tirelessly on BADās booklet, thatās our tool Ā for Business-Aware Design. He wakes up early in the morning to write and heās determined to finish it in the next few days. Who knows? Maybe weāll have 2 new products to showcase for the book fair in May! š¤
- Weāre almost ready to launch Fabula Advanced in English! Meanwhile, Andrea threatened to drag Matteo to a recording studio to work on an advanced course on Ā intĆ¹iti (which could be called intĆ¹iti in-depth š„).
ššš Methodology: testing
When working on a product (whether itās an object, an app or a creative tool) itās always a good idea to build a prototype and run some tests on its usage. Itās the best way to ensure not to build a faulty product or, worst case scenario, some nonsense product. So, thereās no excuse: you have to always run some tests. Always.
What is a test. Itās very easy: you give a product to a set number of users and you observe them as they work with it, or you interview them after theyāve had it for a bit. With Edito, we sent a digital version of the cards and booklet to testers, and a week later we sent a questionnaire to collect the ideas and experiences of the users.
What are the questions that should be asked? Thereās no set rule since every product is different. Generally speaking itās important to ask about what we need to know. Are we afraid that the tool is difficult to use? Letās ask questions about its usability! Do we have doubts about how understandable the booklet is? Letās thoroughly investigate the comprehension of the text! Before sending out the questionnaire ask yourself: Ā«Will the possible answers weāll receive help us understand if the product works or if it needs to be modified?Ā».
How many users do you need? According to the Nielsen Norman Group, 5 users who are in target are enough to identify 80% of usability problems, so you wonāt need to recruit an army š
Results. Thatās the most difficult part. Results need to be summarized and understood, and often youāll need to read between the lines. If all testers say that the booklet is clear but at the same time it doesnāt look as if they understood the potential of the product, it could mean that it is well written but is not actually that clear!
ššš What weāve learned
Besides an extremely negative comment (way too vague and angry to tell you the truth Ā š ), Editoās Beta test results were great: high understanding of the text, a positive perception of the product, the usability of the tool was completely recognized. We could have easily closed the survey and popped a bottle to celebrate. But, something wasnāt adding upā¦
From the answers the innovation of the product wasnāt coming through. Everyone agreed in saying that the product is useful, it is valid and definitely well-designed butā¦ whereās the wow effect?!
š Takeaway: truth hides behind what is not said
Beta testers couldnāt tell us because we didnāt ask. We asked if the booklet was understandable, if it was easy to use and they would use it to edit their manuscripts. And they said yes butā¦ there was no enthusiasm! We almost went crazy trying to understand what was missing and when we saw it, we realized that we forgot to put in the extra mile in the product (that something else that would really make a difference). We summarized the parts one should focus on when editing, true, but we didnāt create a real, practical (and new!) method to use while navigating the analysis of a text. And even that one negative feedback, thinking about it now, was talking about this.
The funny thing is that it was in front of our eyes the entire time. We added a couple of cards to build a system that could help grow both the manuscript and the writer.
Now Edito is wow š
With ā¤ļø,
Matteo and Andrea
*** Sefirotās Creative Bulletin ***
In this bulletin we tell you how we run an independent publishing company.
š° If you want to read past Bulletins, you can find them here https://blog.sefirot.it/tag/creative-bulletin
š If you want to share it with friends, please do!
š If someone shared it with you and youād like to subscribe, follow this link
š® Did you know that we also have a Telegram group where you can connect with other creatives?