Duyet Le
Data & AI Engineer building scalable data platforms and AI-powered systems. 8+ years shipping production workloads across ClickHouse, Kubernetes, and cloud infrastructure. Currently exploring LLM agents and Rust.
Experience
dfdfdf-svg%3c/title%3e%3cstyle%3e%20.s0%20{%20fill:%20%23f37735%20}%20.s1%20{%20fill:%20%23000000%20}%20%3c/style%3e%3cg%20id='%23f37735fe'%3e%3cpath%20id='Layer'%20class='s0'%20d='m669.1%20129.7c-13-90.3%2098.1-157.4%20175.8-117.3c80.8%2031.6%2096.9%20151.7%2034.7%20208.5c-24%2024.4-59.1%2028.4-90.4%2037.2c-62.4-8.8-130-58.2-120.1-128.4z'%20/%3e%3c/g%3e%3cg%20id='%23000000ff'%3e%3cpath%20id='Layer'%20class='s1'%20d='m333%20507.8c219.6-161.4%20525.5-192.8%20774.3-82.4c243.3%20104.1%20427.5%20338.2%20465.4%20601.1c-81.6-0.4-163.1-0.4-244.9-0.4c-33.9-160.4-129.2-308.4-268.4-397.1c-130.7-82.2-299.9-101.2-444.1-44.1c-188.8%2070-315.4%20250.6-360%20441.9c-81.6-0.8-163.2-0.5-244.6-0.7c35.9-205.4%20150.4-398.2%20322.3-518.3z'%20/%3e%3cpath%20id='Layer'%20class='s1'%20d='m310%201439.3c166.5-267.6%20319.9-543%20487.4-809.7c158.4%20269.3%20316.3%20538.9%20476.1%20807.4c49.5-103.8%2069.4-219%2064.5-333.4c81.7%200.7%20163.5%200.4%20245.2%200.1c11.9%20197.3-50.4%20399.8-182.4%20548c-46%2050.8-130.7%2050.1-177.9%201.6c-85.1-79.9-163-167.2-248.3-246.8c-96.1-95.2-264.5-97-363.2-4.9c-84.8%2080.2-161.8%20168.2-244.4%20250.6c-46.3%2050.1-132.7%2053.7-180%203.4c-132.4-149.8-196.2-352.4-184.8-551.3c80.7-0.6%20161.5%200%20242.1-0.7c0.8%20115%2019.6%20229.8%2065.7%20335.7z'%20/%3e%3c/g%3e%3c/svg%3e){kind=small}
Sr. Data EngineerOct 2023 – Present
- Migrated from legacy stack (Spark, Iceberg, Trino) to ClickHouse.
- Migrated 350TB+ Iceberg Data Lake to .
- Achieved 300% better data compression and 2x-100x faster queries with ClickHouse compared to Trino + Iceberg.
- Automated operations with Airflow: data replication, data processing, healthchecks, etc.
- Built AI Agents and AI Workflows on top of ClickHouse Data Lake and Documentation with LangGraph, LlamaIndex, Qdrant, Firecrawl, Cube.js, Next.js.
;}%20.st1{fill-rule:evenodd;clip-rule:evenodd;fill:%23FFFFFF;}%20.st2{mask:url(%23b_1_);fill-rule:evenodd;clip-rule:evenodd;fill:%23242424;}%20%3c/style%3e%3cg%3e%3cdefs%3e%3cfilter%20id='Adobe_OpacityMaskFilter'%20filterUnits='userSpaceOnUse'%20x='12.1'%20y='29.8'%20width='100'%20height='21'%3e%3cfeColorMatrix%20type='matrix'%20values='1%200%200%200%200%200%201%200%200%200%200%200%201%200%200%200%200%200%201%200'/%3e%3c/filter%3e%3c/defs%3e%3cmask%20maskUnits='userSpaceOnUse'%20x='12.1'%20y='29.8'%20width='100'%20height='21'%20id='b_1_'%3e%3cg%20class='st0'%3e%3cpath%20id='a_1_'%20class='st1'%20d='M12.1,29.8h100v21h-100V29.8z'/%3e%3c/g%3e%3c/mask%3e%3cpath%20class='st2'%20d='M38.3,47.3c-2.3,0-4.4-0.8-4.4-6.9c0-3.6,0.5-6.9,4.4-6.9c2.3,0,4.4,0.8,4.4,6.9%20C42.7,43.9,42.1,47.3,38.3,47.3%20M38.3,29.8c-5.9,0-9.3,3.8-9.3,10.5c0,6.6,3.5,10.5,9.3,10.5s9.3-3.9,9.3-10.5%20C47.5,33.6,44.2,29.8,38.3,29.8%20M93.5,30.2H89c-0.1,0-0.3,0.1-0.3,0.3V50c0,0.1,0.1,0.3,0.3,0.3c0,0,0,0,0,0h4.5%20c0.1,0,0.3-0.1,0.3-0.3c0,0,0,0,0,0V30.5C93.7,30.4,93.6,30.3,93.5,30.2%20M25.6,30.3H12.4c-0.1,0-0.3,0.1-0.3,0.3c0,0,0,0,0,0V50%20c0,0.1,0.1,0.3,0.3,0.3h4.4c0.1,0,0.3-0.1,0.3-0.3c0,0,0,0,0,0v-7.3h7.6c0.1,0,0.3-0.1,0.3-0.3v-3c0-0.2-0.1-0.3-0.3-0.3l-7.6,0%20v-5.4h8.7c0.1,0,0.3-0.1,0.3-0.3l0,0l-0.1-3C25.8,30.4,25.7,30.3,25.6,30.3%20M60.8,38.7c-3.9-1.3-5.3-2.4-5.1-4%20c0.2-1.6,1.8-1.6,3.9-1.4c1.5,0.1,2.9,0.4,4.3,0.9c0.1,0,0.1,0,0.2,0c0.1,0,0.1-0.1,0.1-0.2c0.1-0.3,0.2-1,0.3-1.6%20c0.1-0.5,0.2-1.1,0.3-1.4c0-0.1-0.1-0.2-0.2-0.3c-2.2-0.7-4.4-1-6.7-1c-4.5,0.1-6.8,2-7.1,6c-0.1,2.1,1.2,4.9,4.7,6l0.6,0.2%20c2.8,1,4.7,1.6,4.4,3.3c-0.2,1.3-1.5,1.8-4.3,1.7c-1.6-0.1-3.1-0.4-4.6-0.9c-0.1,0-0.1,0-0.2,0c-0.1,0-0.1,0.1-0.1,0.2%20c-0.1,0.7-0.3,2.5-0.4,3.1c0,0.1,0.1,0.3,0.2,0.3c2.4,0.6,4.9,0.9,7.3,0.9c4.4,0,6.8-1.9,7-5.7C65.8,41.9,64.2,39.8,60.8,38.7%20M79.3,38.7c-3.9-1.3-5.3-2.4-5.1-4c0.2-1.6,1.8-1.6,3.9-1.4c1.5,0.1,2.9,0.4,4.3,0.9c0.1,0,0.1,0,0.2,0c0.1,0,0.1-0.1,0.1-0.2%20c0.1-0.4,0.2-1.1,0.3-1.8c0.1-0.5,0.2-0.9,0.2-1.2c0-0.1-0.1-0.3-0.2-0.3c-2.2-0.7-4.4-1-6.7-1c-4.5,0.1-6.8,2-7,6%20c-0.1,2.1,1.2,4.9,4.7,6l0.6,0.2c2.8,1,4.7,1.6,4.4,3.3c-0.2,1.3-1.5,1.8-4.3,1.6c-1.6-0.1-3.1-0.4-4.6-0.9c-0.1,0-0.1,0-0.2,0%20c-0.1,0-0.1,0.1-0.1,0.2c-0.1,0.4-0.2,1.3-0.3,2c-0.1,0.5-0.1,0.9-0.1,1.1c0,0.1,0.1,0.3,0.2,0.3c2.4,0.6,4.9,0.9,7.4,0.9%20c4.4,0,6.8-1.9,7-5.7C84.3,41.9,82.7,39.8,79.3,38.7%20M111.9,46.7h-7.5V30.5c0-0.1-0.1-0.3-0.3-0.3h-4.5c-0.2,0-0.3,0.1-0.3,0.3%20c0,0,0,0,0,0V50c0,0.1,0.1,0.3,0.3,0.3c0,0,0,0,0,0h12.1c0.1,0,0.3-0.1,0.3-0.3l0.1-3.1C112.1,46.8,112,46.7,111.9,46.7'/%3e%3c/g%3e%3c/svg%3e){kind=small}
Sr. Data EngineerOct 2018 – Jul 2023
- Optimized monthly costs from $45,000 to $20,000 (GCP and AWS).
- Managed a team of 4 data engineers and 2 data analysts to provide end-to-end analytics solutions to stakeholders. Raised data-driven awareness throughout the organization and encouraged everyone to take a more data-driven approach to problem-solving.
- Designed next-gen Data Platform in Rust ↗︎
- Developed tools for Data Monitoring, Data Catalog, and Self-service Analytics for internal teams with .
FPT Software
Sr. Data EngineerJun 2017 – Oct 2018
- Built data pipelines processing 2TB/day with AWS for a Recommendation System
- Ingested and transformed 1TB+/day into Data Lake using Azure Cloud and Databricks
John von Neumann Institute
Data EngineerSep 2015 – Jun 2017
- Developed data pipelines, data cleaning and visualizations for ad-hoc problems.
- Trained and deployed ML models: customer lifetime value, churn prediction, sales optimization, recruitment optimization, etc.
Education
University of Information Technology
ThesisBachelor's degree, Information System
Technical Skills
Languages & Frameworks: Python, Rust, TypeScript, SQL, Spark
Data & AI: LlamaIndex, AI SDK, LangGraph, ClickHouse, Kafka, Airflow, BigQuery, AWS
DevOps: CI/CD, Kubernetes, Helm Charts, Cloudflare
Data & AI: LlamaIndex, AI SDK, LangGraph, ClickHouse, Kafka, Airflow, BigQuery, AWS
DevOps: CI/CD, Kubernetes, Helm Charts, Cloudflare