AI-Powered Infrastructure Intelligence

Market Data Advisor LLM

A private, on-premise AI system that continuously monitors your low-latency market data infrastructure, diagnoses performance issues, and safely remediates them with dual sign-off approval and automatic rollback, grounded in vendor documentation, not hallucinations.

Market Data Advisor | mds01.prod
[14:02:03] Telemetry received from mds01
[14:02:03] Running rubric evaluation…
[14:02:03] BIOS profile: Max Performance not set
[14:02:03] C-States: C6 enabled
[14:02:03] THP: not disabled
[14:02:03] IRQ affinity: suboptimal
[14:02:04] Retrieving vendor docs via RAG…
[14:02:04] LLM generating recommendations
 
[14:02:04] Recommendation ready
 
health: 62/100 (degraded)
issues: 2 critical · 3 high · 2 medium
grounding: 0.94
latency: 182ms
36
Deterministic Rubric Checks
35,476
Vendor Doc Chunks Indexed
958
Vendor Documents
9
Deployment Targets

Two-Stage Evaluation Engine

Deterministic precision meets LLM intelligence. Every recommendation is grounded in rubric logic and vendor documentation, never fabricated.

1

Deterministic Rubric Pass

The orchestrator applies a comprehensive rule set against live telemetry, evaluating BIOS profiles, kernel parameters, NIC configuration, NUMA topology, and application-specific settings with zero ambiguity.

  • BIOS performance mode, C-state, and Turbo Boost validation
  • RHEL tuned profile, hugepages, THP, and NUMA balancing checks
  • CPU isolation, IRQ affinity, and sysctl verification
  • LSEG RTDS/ADS and Exegy queue depth and error monitoring
  • Deterministic health score: 0–100 with severity-based penalties
2

RAG-Augmented LLM Analysis

Failed checks are enriched with relevant vendor documentation retrieved via FAISS, then fed to a local LLM that generates human-readable recommendations with full justifications and confidence scores.

  • FAISS retrieval of RHEL, Dell, HPE, LSEG, and Exegy documentation
  • Structured prompts with telemetry, failed checks, and doc snippets
  • JSON-schema-validated recommendations with severity and impact
  • Grounding score tracks documentation coverage per issue
  • LLM may adjust health by ±5 pts with written justification

End-to-End Data Flow

From kernel metrics to actionable remediation: a fully automated advisory pipeline running entirely on your infrastructure.

Daemon Agents

Collect OS, hardware, and app metrics from each host

Orchestrator

Rubric evaluation against live telemetry

RAG Retrieval

FAISS fetches relevant vendor documentation

Local LLM

Generates grounded recommendations

Dashboard

WinUI 3 GUI with health gauges and issue detail

Purpose-Built for Market Data Infrastructure

Not a generic monitoring tool. Every feature is designed for the unique demands of low-latency market data environments.

Real-Time Telemetry

Lightweight daemon agents collect OS metrics, kernel configuration, hardware state, LSEG RTDS/Exegy statistics, and application logs every 2–5 seconds with local buffering for resilience.

Ask Advisor (Natural Language Q&A)

Ask infrastructure questions in plain English. Answers are grounded in your vendor knowledge base with clickable citation chips that open a side panel showing the source document. Host-aware: scope questions to a specific server.

Health Scoring Model

Deterministic 0–100 health score with severity-weighted penalties and caps. Critical issues cap health at 60, high issues at 80. Clear thresholds that drive escalation.

Actionable Remediation

Every issue includes a human-readable title, root cause description, expected impact assessment, confidence score, specific remediation steps, and documentation references.

Web & Windows Dashboards

Browser-based SPA and native WinUI 3 desktop client share the same design system. Dense Bloomberg-style data tables with sortable columns, inline sparklines, status pills, and lazy-loaded health trends.

Power-User Productivity

Cmd/Ctrl+K command palette with fuzzy search across hosts, documents, and actions. Vim-style navigation (g d, g h, g a). Real-time toast notifications. Built for engineers who live in tmux.

Full REST API

Complete API for telemetry ingestion, host listing, recommendations retrieval, health history, and system metrics. Integrate with your existing monitoring and ticketing workflows.

LLM Observability

Per-call logging of latency, token counts, grounding scores, and schema validation. Response metadata footer on every chat reply. Gold-set evaluation for drift detection and model version comparison.

Audit Trail

Every recommendation and human-approved change is logged with before/after values, timestamps, user identity, hostname, and operational mode for full regulatory traceability.

Grounded in Vendor Documentation

35,476 chunks across 958 documents from 17 product families, preloaded on day one. Every recommendation cites the exact section it came from.

LSEG RTDS

ADS, ADH, ATS, RTC, RDU 3.8.x admin manuals, performance fact sheets, install & config guides, demo tools, throughput testing, training material

LSEG DACS

DACS 8.0 configuration guide, application permissioning, best practices, web services programmer's guide, data notification analysis

Exegy / MayStreet

nxFeed FPGA feed handler, SMDS software handler, XCAPI quick start, MAMA developer guide, Refinitiv RTD integration, data quality whitepaper

NIC Vendors

Mellanox/NVIDIA OFED 4.9/5.7/5.9, Solarflare OpenOnload, Intel E810 / 700 Series DPDK, Broadcom bnxt, Chelsio T6 100GbE, ef_vi guides

Server BIOS / UEFI

Dell PowerEdge low-latency, HPE ProLiant Gen10/11, Lenovo UEFI Intel Xeon & AMD EPYC, Supermicro low-latency trading, ODM platform settings

Processor Tuning

AMD EPYC 9005 HPC tuning, Intel Xeon 6 latency profiles, NUMA-Per-Socket, P-state & C-state guides, PCIe Gen latency analyses

Network Switching

Arista low-latency cloud networking, 25G STAC trading, Cisco Nexus ULL, NVIDIA Mellanox Exegy ticker plant, cut-through switching guides

RHEL Tuning

Performance tuning guide, low-latency brief, RT kernel guide, IRQ coalescing analysis, 10Gb NIC tuning, hugepages, time sync

Protocols & Standards

FIX/FAST specifications, Eurex T7 EMDI/MDI, HKEX OMD, IEEE1588 PTP synchronization, DPDK optimization, market data infrastructure patterns

BUILT-IN EXTRACTORS PDF HTML DOCX XLSX PPTX JPG / PNG OCR / no external CLI tools required, all bundled

Built for Trading Floors

Bloomberg-grade density. Keyboard-first. Designed for engineers who don't want to touch a mouse.

HOSTS
248
HEALTHY
201
DEGRADED
34
CRITICAL
13
LLM P95
612ms
GROUNDING
84%
HOSTNAME
ROLE
HEALTH
TREND
LAST SEEN
mds01.prod
lseg_ads
42
2m ago
mds02.prod
lseg_adh
68
1m ago
mds03.prod
exegy_host
94
just now

Command Palette

Press Cmd/Ctrl+K from anywhere. Fuzzy search across navigation, hosts, documents, and quick actions. Result list grouped by category, keyboard nav, Enter to activate.

Vim-Style Shortcuts

g d dashboard, g h hosts, g a ask advisor, g c compare, g k knowledge base. / focuses search. ? shows help. j/k navigate tables.

Inline Sparklines

Every metric tile shows a 20-sample trend sparkline. Every host row in the data table lazy-loads its health history as a colored sparkline. No external chart library required.

Citation Side Panel

Every LLM citation in chat is a clickable purple chip. Click to open a side panel showing the source document, product, and a deep link to the Knowledge Base. Verify the answer in one click.

Toast Notifications

Non-blocking status toasts (success, warn, error, info). Auto-dismiss for non-errors. Connection drops and recoveries fire toasts automatically. Sticky errors until dismissed.

Accessible by Default

WCAG 2.1 ARIA roles on landmarks, aria-current on active menu, skip-to-content link, focus rings on every interactive element, high-contrast forced-colors mode support.

Deploy at Your Comfort Level

Start with observation, graduate to assisted enforcement, always with human oversight and dual sign-off approval.

Default

Observe

Evaluate rubric checks and generate recommendations without any automated changes. All issues are advisory-only with generated remediation scripts available for manual review. Recommended for initial deployment.

Available

Enforce

Assisted remediation with full safety controls. Per-check allowlists control which issues can be auto-remediated. Dual sign-off approval requires two authorized operators. Automatic rollback reverts changes if health degrades. Append-only audit trail logs every action. Circuit breaker halts all enforcement after repeated failures.

  • Per-check allowlists: granular control by check ID, severity, and environment
  • Dual sign-off: two different Operator+ users must approve
  • Automatic rollback: reverts on script failure or health degradation
  • Immutable audit trail: append-only log with SQLite triggers blocking modification
  • Circuit breaker: auto-halts after 3 failures in 30 minutes
  • Kill switch: Admin-only emergency halt of all enforcement

Private by Design

Your market data infrastructure telemetry never leaves your network. No cloud dependencies. No external API calls. Complete air-gap capable.

Fully On-Premise

The entire system (daemons, orchestrator, LLM inference, RAG index, and GUI) runs on your internal network. No external network access required. Zero data exfiltration risk.

Dual Sign-Off Enforcement

Remediation requires approval from two different authorized operators. Per-check allowlists control which issues can be auto-remediated. Automatic rollback reverts changes if health degrades.

Multi-Tenant RBAC

API key and JWT authentication with Admin, Operator, and Viewer roles. Team-scoped access restricts visibility by environment and host role. Configurable CORS origins.

Immutable Audit Trail

Append-only audit log with SQLite triggers blocking modification. Every approval, execution, rollback, and configuration change is recorded with timestamps, user identity, and before/after values.

CVE Vulnerability Scanning

Automatic kernel CVE correlation via Red Hat Security Data API and NVD. Patch availability tracking with severity mapping. Integrated into health scoring and compliance reports.

Circuit Breaker & Kill Switch

Enforcement auto-halts after 3 failures in 30 minutes with PagerDuty critical alert. Admin-only kill switch immediately stops all pending executions. Canary mode tests changes on one host first.

Beyond Monitoring: Predict, Protect, Remediate

Network Topology Visualization

Auto-discovered host relationships rendered as interactive Cytoscape.js diagrams. LSEG data flow mapping, environment grouping, health-colored nodes. Export to SVG, PNG, Visio, and draw.io.

Proactive Alerting

Webhook, Slack, and PagerDuty integration. Health degradation thresholds, critical issue notifications, host offline detection. Configurable cooldowns prevent alert fatigue.

Assisted Remediation & Enforcement

Template-based bash script generation for every detected issue. In Enforce mode, scripts are queued for dual sign-off approval, executed securely via posix_spawn on target hosts, and automatically rolled back if health degrades.

Predictive Analytics

Linear regression capacity forecasting predicts queue exhaustion, memory pressure, and drop rate increases days in advance. Cross-site configuration drift detection across global deployments.

Internet Augmentation

Web search integration (Brave, Bing, SearXNG) for knowledge beyond uploaded docs. Claude API escalation for complex queries. CVE vulnerability scanning via Red Hat and NVD databases.

Enterprise Integration

Vendor plugins for Dell iDRAC and HPE iLO Redfish APIs. Prometheus /metrics endpoint for Grafana dashboards. Multi-tenant RBAC with API key and JWT authentication.

9 Deployment Targets, One Codebase

RHEL 8 / 9
RPM + systemd
AWS EKS
Helm + ALB
Azure AKS
Helm + AGIC
GCP GKE
Helm + GCE LB
OCI OKE
Helm + OCI LB
Synology DSM 7
SPK Package
Windows 10/11
WinUI 3 MSI
Docker
Multi-stage
Standalone
Any Linux

Stop Guessing. Start Knowing.

See how Market Data Performance Advisor can transform your team's ability to monitor, diagnose, predict, and safely remediate low-latency market data infrastructure, with AI that cites its sources and enforcement that requires dual human approval.

Request a Demo Watch Demo Video