Yesterday we deployed two new features to help you evaluate Gemini 3 (and eventually others) results against human transcribed or corrected text. First, we’ve developed a comparison screen that shows the differences between an AI generated page transcription and human created ground truth: Next, we calculate statistics, again comparing the AI draft against the human … [Read more...] about How Do You Know Whether AI Is "Good Enough"?
Uncategorized
Introducing Gemini 3.0 Support in FromThePage
When Ben sent me Mark Humphries’ report on testing a new, unreleased Gemini model, I got scared. And excited. Mark is a historian and digital humanist who’s gone deep on analyzing AI tools for textual transcription. He understands the dangers of “seductive plausibility” in LLM outputs. He knows what researchers and historians need from archival text. He measures errors … [Read more...] about Introducing Gemini 3.0 Support in FromThePage
Is That Transcription Really Human?
Last month, Denyse Allen asked this question on the Genealogy and AI Facebook group:If volunteers use AI to transcribe documents, is that OK? I have strong opinions, but want to explain them. First off, the institutions running big crowdsourcing projects have staff who can automate sending all of their documents to AI engines for transcription. As a software developer, … [Read more...] about Is That Transcription Really Human?
We Got Clobbered by Bots
A behind-the-scenes look at how an invisible attack nearly brought down FromThePage—and what we did next.A Four-Hour Outage, Bots, and a Hard Lesson Learned Last Thursday, June 26th, FromThePage experienced more than a dozen outages totalling four hours. In the days leading up to this, we also saw a noticeable slowdown in performance. This wasn’t just frustrating — it was … [Read more...] about We Got Clobbered by Bots
Can LLMs Help With Boring Forms?
Two weeks ago, I looked at Ben and said "What we obviously should build next is field-based AI-Assist." Transcribing forms or "spreadsheet-like" ledgers and rolls is not as much fun as transcribing letters or field books, so anything that makes the process easier might appeal to volunteers. And because the text is more "data" than "text", it should suffer less from … [Read more...] about Can LLMs Help With Boring Forms?