Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
1

Comparison of Models Used for Aviation Briefings

from John Wiseman [alt+shift+b] in technology

I have a collection of prompts and tools that I give to LLMs to generate daily aviation briefings. The briefings are supposed to be a summary of everything interesting that’s happened in the air in the past several hours, either globally or in a region of interest. The model should contextualize aircraft activity in terms of behavioral analysis, historical patterns, geography, and current events: The fire west of Piñon Hills stood at roughly 2,700 acres and 0% containment in the latest reports, with cooler overnight conditions helping crews strengthen lines. This morning’s air picture is recon and rotary rather than Saturday’s tanker parade: N8PQ, the Aero Commander 690A, is back overhead at 8,000 ft, K-MAX N107MW is working the fire at 4,200 ft, Bell 205 N33HX is staging at Fox Field, and Tanker 104, an Erickson Aero Tanker MD-87, sits on the ramp at San Bernardino International. Writing a worthwhile briefing is a challenging task. It’s agentic, with models using 15-20 tools including querying databases, searching the web, and writing and executing scripts to process data. It also requires judgment from a model on what to include in the briefing and how to put together separate pieces of data to tell a story without overstating a conclusion. The agents filter through a large amount of data looking for interesting items, find corroborating sources, take screenshots, and edit it all into a short (less than 6000 characters) report. I’ve tried Claude Opus 4.8, Fable 5, OpenAI GPT-5.6-Sol, and Kimi K3 on this task. The tl;dr if you’re paying retail API token prices: Opus 4.8 is cheap, fast, and its output is good. Kimi K3 costs about the same as Opus 4.8 and its output is of similar quality (it’s saved by the fact-checker) but it takes 5-6x as long as Opus 4.8. Fable 5 costs 2-5x as much as Opus 4.8 or Kimi K3. I like the feel of its output best, but it needs to be reined in by the fact-checker almost as much as Kimi K3. GPT-5.6-Sol is cheap and fast and makes few...
18th Jul 2026

Stay updated

Get a weekly newsletter with the top 5 articles worth reading every week.

More from John Wiseman

Embedding the Sky

Two projects at the intersection of geospatial data and AI. First, a semantic search engine for aerial imagery, fine-tuned on OpenStreetMap-tagged data. Second, WARP—a custom neural model that learns embeddings of aircraft flight trajectories, trained on roughly a million aircraft tracks. Given any flight path, WARP can instantly retrieve the most similar trajectories from history. It enables applications from OSINT and anomaly detection to safety analysis and flight planning. The same latent structure that made word2vec transformative for language now becomes available for aircraft behavior. Presented at Spec.LA on December 18, 2025. I'm going to quickly show two things tonight. The past few years I've been working mostly in geospatial, aviation, and AI, and that's what these are. One is geospatial semantic search and the other is a foundation model for aircraft. I believe they're both extremely valuable and useful. # Both projects are about embeddings. Embeddings are points inside a latent or conceptual space. Parts of that space that are conceptually similar are closer together. There are neural models that will generate an embedding of an image or text or other things. With the right model, an embedding of a photo of a golden retriever is close to the embedding of the text "golden retriever" and far from the embedding of an image of an aircraft boneyard. # I showed an early version of PIMINTO at Spec a long time ago. I've refined it a lot since then. It uses a model that's fine tuned on satellite imagery and text describing the imagery based on OpenStreetMap tags. I'm going to give a live demo of the new site, which is public. piminto.obliscence.com | Demo video # Next is WARP, which is a model I'm building to create embeddings of aircraft paths. Back to aircraft, big surprise. # I trained the model on about a million aircraft tracks, pretty much everything that flew in the western U.S. over the course of a week. # At this point training takes 18 hours on a 4090 GPU. # I've come up with a custom architecture for this task. # I kept feeding the single file into GPT o3 or GPT 5, either asking it to critique the code or describing specific problems I was running into. Sometimes I'd paste a CSV of the loss curve. It would give me detailed descriptions of what to do next, and I'd paste those into Cline with Sonnet 4.5 doing the actual coding. # How does it do? # I hoped that if I took a few thousand trajectories and clustered their embeddings I would see clear separation and similarities. But that didn't really happen. A few extreme examples looked good, like skydiving aircraft being outliers, but otherwise I couldn't really make sense of it. But then I read someone who said sometimes clustering just looks nonsensical even if the embeddings are good at capturing similarity. # So I wrote an interface to let me compare any of the million trajectories. I can select one trajectory and it will almost instantly show me the other most similar trajectories in the database. In this screenshot the blue is the query trajectory and the red is the most similar trajectory it could find. This one isn't too bad. The altitude and speed profile are very similar but not exactly the same. Promising. # This is the signature of touch and go practice. This is a good match. # These are two different skydiving aircraft. They climb up to altitude, everyone jumps out, then they race back to the field. # These are two different flights by the same aircraft. But what does it really look like? # This is pretty cool. This looks like two training flights, by the same aircraft but on different days. Each time following the same route and including kind of a loop and then some tight circles. # These are two different Thales Watchkeeper drones, flying on different days over Fort Bliss. As a reminder, I chose the track on the left and then the system searched the database in a fraction of a second and determined that the track on the right was most similar to it. # This starts to hint at some potential uses. Both of these helicopters are doing some sort of utility work in forest. Hauling something maybe. Again, the track on the left is the query track, and the one on the right is the best match. # These are two different aircraft on two different days, dropping sterile fruit flies on different parts of Los Angeles. There are many other aircraft flying these sorts of lawnmower patterns, for example doing LIDAR collection, but it determined the one on the right is the most similar. # A useful aircraft embedding model unlocks a lot of interesting and valuable use cases, similar to how word2vec and text embeddings unlocked a whole class of semantic search, clustering, retrieval, anomaly detection, and analogy-style reasoning over language—except now the same kind of latent structure becomes available for aircraft behavior, trajectories, and operational patterns. # # { img.style.cursor = 'pointer'; img.addEventListener('click', () => { lightboxImg.src = img.src; lightbox.classList.add('active'); }); }); function closeLightbox() { lightbox.classList.remove('active'); } document.addEventListener('keydown', (e) => { if (e.key === 'Escape') closeLightbox(); });

27th Feb 2026 • 1 votes

More in technology

FLIP Fluid on Flip Dots

[Hardware] Electromechanical Fluid Simulation

4 days ago • 1 votes
Is This A Joke? In The Auth Header? (F5 BIG-IP UnAuth Heap-Overflow to RCE CVE-2026-94127)

Well, well, well, well, well, well, well, well, well, well, well, well, well, well, well. We're back. Sorry. We've been watching the onslaught of vulnerabilities flood the internet. Every man, dog, and their grandmas (apparently?) are now using LLMs to find and reproduce vulnerabilities - it’

5 days ago • 1 votes
The Reason You Prohibit Things

You want less of them. That’s the reason. You may find that it’s too hard to stop people from doing the thing, literally blood, sweat, and tears trying to prosecute people, but that’s a different thing.

5 days ago
Solitaire Alone Together

Solitaire Alone Together I made a new game. It's called Solitaire Alone Together. It's Windows 98 solitaire, but you can play with everyone else on the internet. Read the full post on my blog! Here's a raw link, if you need it: https://eieio.games/blog/solitaire-alone-together

a week ago • 1 votes
📚 BoredReading

You seem to be enjoying this.

Join free to unlock everything.

Create free account

Already have an account? Sign in