Sightline
Tells Shopify merchants when AI recommends their store.
Problem
A growing share of purchase research now happens inside assistants rather than search engines. There is no rank to check, no impressions to read, and no way for a merchant to know whether ChatGPT recommends them or a competitor.
Approach
- 01
Build a prompt set per merchant that reflects how their buyers actually ask — category, comparison, and problem-first phrasings, not brand-name lookups.
- 02
Query each engine on a schedule from clean sessions, so results reflect the model rather than an accumulated conversation.
- 03
Score two things separately: whether the store surfaced at all, and what was said about it when it did. Presence and sentiment fail independently.
What it taught me
Answers vary enough run to run that a single query says almost nothing. The product only became useful once it reported trends across repeated runs instead of point-in-time results.
Architecture
- App
- Next.js, embedded in Shopify admin
- Engines
- ChatGPT, Perplexity, and Claude, queried on schedule
- Store
- Postgres, time-series per prompt per engine
- Scoring
- Presence rate and sentiment, tracked as separate series