Sandbook review study codebook, edition 2026-11 (v1.1, 2026-11-18): the written definitions an AI model followed to categorise each App Store review in the study. Licence: CC BY 4.0.
Study, method, agreement figures and counts: https://sandbook.app/blog/text-to-speech-app-complaints

# Codebook: complaints and praise in text-to-speech reader app reviews (v1, 2026-11-18)

Unit: one written App Store review (title + body). Each review is read as a whole and gets **every** code that applies (multi-label). A review can have no complaint code, one, or several.

You see only an opaque id, the star rating (1–5) and the text. Code from the text. Use the stars only to resolve tone when the text is ambiguous (for example "interesting pricing" in a 1-star review is a price complaint; in a 5-star review it is not). Never assign a complaint code from the stars alone.

Reviews may be in any language. Code them the same way.

## What counts as a complaint

Code a complaint category when the reviewer states, **about the app being reviewed**, a problem, a dissatisfaction or a shortcoming that falls in that category. This includes:
- a mild complaint inside a positive review ("wish it were cheaper", "pricey but worth it" = price complaint);
- a missing feature stated as a shortcoming or wish ("no bookmarks", or a wish that it could read Kindle books);
- a problem that the reviewer says was later fixed (crashes that have since stopped) — code it (it is still a reported problem) unless it is only a thank-you for a fix with no problem described.

Do **not** code:
- praise or neutral mentions (a reviewer who pays for the premium tier and likes it, or calls the subscription good value, with no criticism);
- complaints about **another** app (a reviewer who left a different app because of its price is not making a price complaint about this app; code it only if the reviewer criticises the reviewed app too);
- hypotheticals (a reviewer who says they would leave if a subscription were ever added) and plain questions with no dissatisfaction.

## Complaint categories

| Code | Category | Code it when the reviewer complains that… | Not this code |
|---|---|---|---|
| C01 | **Price and subscription** | the app or its premium tier costs too much or is poor value; they dislike paying by subscription, or the move from a one-time purchase to a subscription; features or voices are locked behind a paywall; the free version is unusable without paying; the price went up. | A billing incident (C02) or a usage cap (C03) on its own. "Scam" with only a billing story = C02 only. |
| C02 | **Trial, billing and refunds** | they were charged unexpectedly (free trial converted without clear notice, charged after cancelling, charged twice, charged without agreeing); they cannot cancel or find how to; a refund was refused or never came; the subscription terms at sign-up were unclear; they paid and did not get what they paid for. | Price level alone (C01). |
| C03 | **Usage limits** | there is a cap on how much they can use: minutes or hours of listening, characters or words, number of files, pages or imports, credits or tokens, daily/weekly/monthly allowance, premium-voice time; the free version stops after N minutes. Applies to free or paid tiers. | A general paywall with no cap (C01). |
| C04 | **Ads and upgrade prompts** | ads; pop-ups; repeated upgrade or rating prompts; an upsell that interrupts reading or listening; pushy onboarding. | A one-time paywall that simply blocks use (C01). |
| C05 | **Account and sign-in** | an account, sign-up or e-mail is required; they cannot log in; they were logged out or lost their library because of the account. | |
| C06 | **Voice quality** | voices sound robotic, flat, monotone, unnatural, glitchy or have audio artefacts; the free voices are poor; too few voices; a voice they liked was changed or removed; voice quality got worse. | Wrong pronunciation of particular words (C07). |
| C07 | **Pronunciation, accent and language** | words, names, numbers or abbreviations are mispronounced; there is no way to correct pronunciation; a voice has the wrong accent; their language is missing; the app reads in the wrong language or with an English voice on non-English text. | Symbols, URLs or page furniture read aloud (C10). |
| C08 | **Playback and listening** | audio stops, pauses or cuts out on its own; it will not keep playing in the background or with the screen locked; long delay before it starts; speed control problems; sleep timer; CarPlay, Bluetooth, AirPods or lock-screen controls do not work; audio and text drift apart in time. | A full crash or freeze of the app (C09). |
| C09 | **Crashes and bugs** | the app crashes, freezes, will not open or load, "doesn't work", has bugs or glitches, broke after an update, lost their saved files or library (when not specifically about the account). | |
| C10 | **Documents and files read wrongly** | text is skipped (lines, words, sentences, pages); headers, footers, page numbers, footnotes, citations, URLs or symbols are read aloud; columns or tables come out in the wrong order; formatting is garbled; a file type is not supported; a file (PDF, EPUB, Word, web page, text) fails to import or open; web-page extraction is poor; they cannot see the original page layout. | Scanning or photographing pages (C11). Kindle/library books (C13). |
| C11 | **Scanning and photos** | scanning physical pages or using photos is tedious (one page at a time), misleading (advertised scanning a whole book or cover), inaccurate (OCR mistakes) or broken (scan fails, scans lost). | |
| C12 | **Losing place and navigation** | the app loses their place or progress, restarts from the beginning, has no or broken bookmarks, no table of contents, no search, hard to jump to a chapter or page, cannot start reading from a tapped word or sentence. | |
| C13 | **Kindle, library and protected books** | they cannot read Kindle, Libby/OverDrive, Audible, Apple Books or other DRM-protected books, or the integration with them fails. | DRM-free EPUB import problems (C10). |
| C14 | **Ease of use and design** | the interface is confusing, cluttered or hard to navigate; a redesign made it worse; too many steps; highlighting or read-along does not work or is hard to follow; problems with VoiceOver or other accessibility settings. | |
| C15 | **Customer support** | support does not answer, is unhelpful or cannot be reached. | |
| C16 | **Sync, other devices and export** | no or broken sync between devices; no desktop, Mac, iPad or web version (or it lacks features); cannot export audio or MP3; no cloud-drive integration (Google Drive, Dropbox, OneDrive). | |
| C17 | **Needs internet or privacy** | it does not work offline or needs a connection or Wi-Fi; uses too much data; privacy or data-collection concerns. | |
| C99 | **Other or unspecified complaint** | any other complaint, or a negative review that gives no reason ("Terrible", "Waste of time"). | Use only when no C01–C17 code fits that complaint. |

**PDF flag.** Add `PDF` (in the complaints field) when the review contains a complaint of any category that is explicitly about PDF files (for example skipped lines in PDFs = C10 + PDF; "can't import PDFs" = C10 + PDF; "PDF reading is paywalled" = C01 + PDF).

## Praise categories

Code a praise category when the reviewer praises the reviewed app for it. Generic praise only ("Great app!") gets no praise code.

| Code | Praise for… |
|---|---|
| P1 | **Voices**: natural, human-like, pleasant, good choice of voices. |
| P2 | **Ease of use and design**: simple, intuitive, clean, well made. |
| P3 | **Price and value**: free, generous free version, affordable, one-time purchase, worth the money. |
| P4 | **Helps them read, study or work**: helps with dyslexia, ADHD, vision, eye strain, studying, getting through reading, listening while driving or doing chores. |
| P5 | **Features and file support**: reads their PDFs, EPUBs, web pages, scans or photos well; highlighting; speed control; offline; background or CarPlay listening; export; sync. |
| P6 | **Developer or support**: responsive, helpful, fixed a reported problem. |

## Reader groups (any sentiment)

Code when the reviewer says they, or the people they use it for, belong to the group.

| Code | Group |
|---|---|
| G1 | Dyslexia, ADHD or another learning difference. |
| G2 | Blind, low vision, visual impairment, or eye strain / tired eyes. |
| G3 | Students, studying, school, university, textbooks. |

## Language

Two-letter code of the review's language (en, fr, de, es, pt, it, nl, sv, zh, ko, vi, …).

## Output format (one line per review, tab-separated, in the input order)

```
rid	lang	complaints	praise	groups	note
R0001	en	C01,C02	-	-	
R0002	en	-	P1,P3	G3	
R0003	fr	C07,C06,PDF	P2	-	wants French voice
```

- Use `-` for an empty field. Codes are comma-separated with no spaces.
- `note` is optional, at most 10 words, only when a decision was a close call. No quotations from the review.

---

## v1.1 (2026-11-18): C02 tightened after validation

The validation sample showed the coders splitting on one clause of C02, "paid and did not get what they paid for": some added C02 whenever a one-time buyer lost access after a move to a subscription, or when a subscription required extra payments, others did not. From v1.1, C02 means a **billing event**, and only that:

| Code | Category | Code it when the reviewer describes… | Not C02 (code C01 instead, if price is criticised) |
|---|---|---|---|
| C02 | **Trial, billing and refunds** | (a) a charge they did not expect or agree to: a free trial that converted without clear notice, a charge after cancelling, a double or wrong charge, being enrolled in a paid plan without agreeing; (b) being unable to cancel, or unable to find how to; (c) a refund that was refused, delayed or never arrived. | Losing an earlier one-time purchase when the app moved to a subscription; having to pay extra on top of a subscription (books, credits, a second plan); disliking the trial length or the plan structure; a paid feature that is buggy (C09) or capped (C03). |

C02 under v1.1 is a subset of C02 under v1, so only reviews coded C02 under v1 were re-coded, and the validation sample was re-coded for C02 by the second, separate AI pass.
