Log Data Visualization Platform
Full-stack internal web application for log data visualization and analysis at Bouygues Telecom. Machine log investigation time reduced from several minutes to near-instant access. Designed and built independently from scratch.
Context
Before this tool, data engineers at Bouygues Telecom had to consult pipeline logs directly on their machines — complex due to sheer volume and the rise of containerized workloads (Docker). The Data team (100+ people) had access to ElasticSearch and Kibana, but neither was tailored to their specific internal ETL logs. They needed a purpose-built interface with targeted filters adapted to the team's workflow.
Approach
- ·Acted as sole developer across the full stack: backend, frontend, and data layer design
- ·Built a Spring Boot backend querying ElasticSearch indices containing structured log data
- ·Developed a React frontend with real-time visualization of log streams, error patterns, and pipeline metrics
- ·Designed a filtering and search system adapted to Bouygues Telecom's specific pipeline log structure
- ·Iterated the application design through direct feedback loops with data engineers and analysts
Solution
A unified internal web platform that aggregates, visualizes, and enables analysis of log data from distributed streaming pipelines. Engineers can monitor pipeline health, investigate anomalies, and analyze historical log patterns through a single, purpose-built interface.
Key outcome
Machine log investigation time reduced from several minutes to near-instant access via the platform. Shared filters let teams share context immediately during incidents.
Applications
- ·Streaming pipeline monitoring
- ·Log analysis & anomaly investigation
- ·Real-time data quality visibility
- ·Internal data observability
Project details
Technologies
More projects
View all →YAML Configuration Editor
Custom internal web app that allows non-technical stakeholders at papernest to safely configure data pipelines. Cut pipeline build & test time by ~50% and incident investigation from 30–60 min to under 2 min.
SQL Streaming Module – Documentation & Evolutions
Contributions to an internal SQL-on-Flink streaming module at the core of Bouygues Telecom's ETL. Main deliverable: an automated documentation system and CI/CD integration to make the module production-ready.
EscobAddictions — Global Drug Data Analysis
Exploratory data analysis on global drug phenomena across four independent studies: mortality by substance, consumption by age group, cocaine–crime correlation, and drug-related imprisonment trends. Includes an interactive Power BI dashboard.