AI systems & data engineering CV
Summary
Senior back-end engineer, 10+ years across the full data lifecycle: web crawling at scale, processing into clean structured data, with analytics on top of it. Since 2024, increasingly focused on agent harness infrastructure and data-centric systems around large language models. Rust primary, Python secondary.
Experience
2014 - present, freelance / contract. Back-end and data engineering across a range of domains, mostly solo or in small teams, end to end from crawling to delivery:
- Large-scale web scraping and crawling platforms
- Price comparison and data aggregation systems
- ML dataset preparation for training and evaluation
- Agent harness and MCP infrastructure
Core Competencies
Languages🦀 Rust (primary)🐍 Python💩 JavaScript
Rust stackAxumLeptosTokioTowerPolars
FocusAgent harnessMCP serversweb scrapingdistributed crawlerssingle-view dashboardsdata pipelinesREST/gRPC
Cloud & InfraKubernetesDockerAWSGCPTerraformNixGitHub ActionsPrometheus/Grafana
Data StoresPostgreSQLRedisMongoDBSurrealDBQdrantFjallRocksDBVictoriaMetrics
InterestsFully Homomorphic Encryptionabstract algebranatural language processingcontext engineeringLLM orchestrationagentic workflows
Selected Work
- Agent systems and MCP servers. Build agent harness infrastructure - wiring a model to tools, APIs, and memory - and MCP servers that expose data and tools to agents safely. Example: exodata.space serves a stateless streamable-HTTP MCP endpoint with read-only catalog query, insight, and export tools (docs).
- High-scale web crawling. Distributed crawlers handling millions of pages a day on a small infrastructure footprint, with pipelines that keep the data consistent downstream.
- ML dataset preparation. Collecting, processing, and delivering datasets for training and evaluating language models and other AI systems.
- Consulting and mentoring. Architecture reviews, Rust integration, agent/MCP design, and mentoring on practical AI usage.
Open Source
- exodata: NASA exoplanet catalog (Leptos, Axum, Polars) with a REST API and a hosted MCP endpoint - exodata.space
- pageinfo-rs: HTTP-only page analysis for LLMs and agents - extracts identity, URL structure, metadata, feeds, and embedded JSON
- capp-rs: Tower-native async runtime for web crawlers and task pipelines - queues, retries, backpressure, and dead-letter handling
- dom-content-extraction: Rust implementation of the Content Extraction via Text Density (CETD) algorithm
- probabilistic-rs: Probabilistic data structures (Bloom / expiring-Bloom filters) with persistence and Python bindings
- tarts: Terminal screen savers and visual effects in Rust
Education
ITMO University - Information Technology, Optical Design and Engineering (Russia)
Rates
Development$100/hr
Consulting & mentoring$200/hr
Contact
- GitHub: github.com/oiwn
- Email: email me