AI and async pipeline

Insight Stream

AI-powered content intelligence

Insight Stream: Topic feedInsight Stream: Trending topics

The problem

Ever scrolled through hundreds of articles and Reddit threads just to find the few that matter to your work?

The product

Insight Stream is a topic-based content intelligence platform that brings relevant information to you, shows public sentiment, and keeps you current on the areas you care about.

It collects content from sources like RSS feeds and Reddit, organises it around the topics each user follows, and uses AI to classify sentiment, surface trends and power semantic search, so people find content by meaning instead of exact keywords.

Inside the product

Insight Stream: Search by meaning
01 / 04Search by meaning

Semantic search over embeddings. Describe what you need and results are ranked by meaning, not by exact keyword matches.

Full size

Redesigned interface screens, shown with sample data.

Key capabilities

  • Personalised, topic-based content feeds
  • Ingestion from RSS feeds and Reddit
  • AI sentiment classification: Good, Bad or Neither
  • Trending topic discovery
  • Semantic search over embeddings
  • Background processing, caching and authenticated access

How it flows

  1. 01RSS and Reddit sources
  2. 02Celery + Redis workers
  3. 03LLM sentiment
  4. 04Embeddings in pgvector
  5. 05Feed and search API

Tech stack

BackendFastAPIPython
DataPostgreSQLSQLAlchemyAlembicpgvector
Jobs, cacheCeleryRedis
AIOpenAIGeminiDeepSeekGroqEmbedding search
FrontendVue 3TypeScriptPinia
InfraDockerDocker ComposeJWT authRate limiting
Next projectMoodVerse