New textbook

A Jamaican patty shop is the first test in CAIA’s new language-model textbook

An illustrated patty-site table beside two ways of splitting Mi waan patty into tokens.

Caribbean foundations of Large Language Models, by Adrian Dunkley, is a Caribbean AI Association textbook available in English and Spanish. Both editions use local examples to teach how language models learn, generate text and make errors.

The patty shop problem

Three fictional sites put you in the position of a Jamaican shop owner. The book’s table gives you lunch footfall, monthly rent and distance from a delivery hub for Half-Way Tree, Papine and Cross Roads. Papine leads under the first set of weights. Give more weight to rent and Cross Roads leads.

That exercise sets up a division of labour. A calculator ranks the sites under your rules. A language model can explain the result from the supplied records. Ask the model which site ranks first under each rule and which rows support that answer. You have the table and the calculation to check its reply.

A tokenizer sees pieces of text

A tokenizer breaks text into pieces and assigns each piece an ID. The book shows how two teaching vocabularies split the Jamaican Creole order Mi waan patty (“I want a patty”). One gives Mi | waan | patty. The other gives Mi | wa | an | pat | ty. The message stays the same and the second split uses two more tokens.

In their study of rare-word translation, Sennrich, Haddow and Birch describe using “smaller units than words” to translate certain word classes. The book gives readers the rules to reproduce the sample splits, including short examples in Haitian Creole, Papiamento and Caribbean Spanish. Read the study.

A question about a ferry needs a dated answer

A fictional Antigua-to-Barbuda ferry exercise compares two dispatch notices for 18 May 2031. The later notice corrects the departure time. To answer, the system has to find the record for the requested route, keep its date and issuing authority attached, and show which notice supports the answer. The exercises also test what happens when two notices conflict or the question leaves out the departure island.

Read or teach with either edition

Both PDFs contain worked equations, exercises with solutions, regional source notes and a geographic case index. For a class, give one group the ferry notices and another the questions. Ask them to compare answers before and after the correction appears. The repository provides the teaching data and code for the exercises.

Tong Xiao and Jingbo Zhu’s Foundations of Large Language Models informed the textbook’s academic layout and reading path. Read the reference.

Download the book