Dimitri

Designing a silver market data pipeline for WSS

· [Markets] [Data]

By Dimitri Lafleur

Wall Street Silver needs reliable market data: CFTC commitment of traders reports, COMEX inventory levels, LBMA prices, and community sentiment signals from Reddit.

The challenge is building a pipeline that ingests from multiple sources with different schemas, normalizes timestamps, handles failures gracefully, and stores everything in a queryable time-series format.

Pipeline components

  • Reddit API ingestion for sentiment extraction
  • CFTC data parsing and normalization
  • COMEX/LBMA price feeds
  • Time-series database for storage
  • Analytics layer for signal extraction
  • Visualization dashboard

This pipeline supports research, community insights, and market analysis tools that help understand silver market dynamics.

Next steps

These adjacent pages connect the WSS workflow to the broader systems and narrative work around it.

Overview

Wall Street Silver

The business context for the research systems, audience workflows, and market tooling described here.

 Related essay

Freedom Is Fragile

A more public-facing piece on why the market and community work matters beyond pure analysis.